KR20190025472A - Electronic device having multi functional human interface and method for controlling the same - Google Patents

Abstract

According to one aspect of the present invention, an electronic device capable of increasing the operation efficiency and having a composite human interface with a keyboard layout comprises a plurality of buttons, a plurality of switches, an electrical connection member, and a controller.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an electronic device having a composite human interface,

The present invention relates to a human interface for receiving text information or pointing position information from a user in a digital device capable of receiving text or pointing position related information such as a computer, a notebook, a tablet PC, a mobile phone, and the like, and transmitting the text information or the pointing position information to the digital device.

A text input device such as a keyboard for text input has been disclosed in personal computers and portable digital devices. Also, a pointing device such as a mouse device for controlling the pointing position of the pointer for controlling the digital device and performing the function has been disclosed.

The conventional text input device and the pointing device are provided as separate devices or the pointing input area is formed at a separate position different from the text input area of the text input device. Therefore, the movement of the user's hand is more than necessary in the work environment in which the text input, the pointing position information input, and the pointer execution command input are frequently changed, thereby lowering the work efficiency.

Another object of the present invention is to provide a pointing device integrated text input device and a control method thereof that perform a keyboard mode, a mouse mode, and a digitizer mode for receiving a keyboard input and are free to switch between these modes.

Another object of the present invention is to provide a pointing device-integrated text input apparatus and a control method therefor, in which it is easy to adjust an adjustment target attribute whose attribute value can be adjusted, such as an audio volume.

Another object of the present invention is to provide a pointing device-integrated text input device capable of processing touch input and hovering input and selecting a control target device through a hovering input in a multi-device environment and a control method thereof.

It is to be understood that the present invention is not limited to the above-described embodiments and that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the following claims .

In the present invention, there is provided a pointing position information input area of a pointing device on a text input area of a text input device, and a switching part for switching between a text input mode and a pointing position information input mode, It is possible to increase the work efficiency by enabling the pointing input while minimizing the movement of the hand of the user.

According to an aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A keyboard mode for ignoring the touch input and outputting only a keyboard input that reflects a key value corresponding to the push input, a control unit for ignoring the push input for at least a part of the plurality of buttons and using a variation value of the touch coordinate value A mouse mode for outputting a mouse input indicating a moving distance and a moving direction of the pointer and a digitizer input for indicating a position of the pointer using the touch coordinate value ignoring the push input for at least a part of the plurality of buttons An electronic apparatus that performs a digitizer mode for outputting the digital data can be provided.

According to another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value corresponding to the push input and a pointer control signal for ignoring the push input for at least a part of the plurality of buttons and reflecting the touch coordinate value The controller calculates a touch coordinate value corresponding to the touch input based on the scan signal, and when the touch mode is a mouse mode, the controller calculates the touch coordinates And when the touch mode is the digitizer mode It may be provided an electronic device for obtaining the absolute coordinates from the touch coordinates.

Outputting only a keyboard input that reflects a key value corresponding to the push input while ignoring the touch input when operating in the keyboard mode; Entering a mouse mode; Outputting a mouse input indicating movement distance and movement direction of the pointer by using the variation value of the touch coordinate value while ignoring the push input for at least a part of the plurality of buttons when operating in the mouse mode; Entering a digitizer mode; And a step of outputting a digitizer input indicating the position of the pointer using the touch coordinate value, ignoring the push input for at least a part of the plurality of buttons .

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for acquiring a key value assigned to a button corresponding to a switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force trooid corresponding to the touch input, A keyboard mode for ignoring input and outputting only a keyboard input reflecting a key value according to the push input and a touch mode for outputting a pointer control signal for ignoring the push input for at least a part of the plurality of buttons and reflecting the touch coordinate value Entering a mode; Calculating a touch coordinate value according to the touch input based on the scan signal when entering the touch mode; Obtaining a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode; Obtaining an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode; And outputting a signal for controlling the position of the pointer based on the obtained value of either the relative coordinate value or the absolute coordinate value.

According to still another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A touch mode for outputting a first touch signal for controlling the position of the pointer according to the touch coordinate value and a keyboard mode for outputting only a keyboard input for reflecting a key value corresponding to the push input, When the key input for the button having the key value assigned with the adjustment object attribute is obtained during the operation in the touch mode, the second touch signal indicating the adjustment of the attribute value of the adjustment object attribute May be provided.

According to still another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, When the key input is obtained, it is determined whether it is a keyboard mode or a touch mode. In case of the keyboard mode, a character value corresponding to the key input is output. In the case of the touch mode, An electronic device performing the attribute adjustment mode to be used may be provided.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force trooid corresponding to the touch input, ; Outputting only a keyboard input that reflects a key value corresponding to the push input while ignoring the touch input when operating in the keyboard mode; Entering a touch mode; Outputting a first touch signal for controlling the position of the pointer according to the touch coordinate value when the touch mode is operated; Receiving a key input for a button having a key value assigned an adjustment object attribute in operation in the touch mode; And outputting a second touch signal instructing adjustment of an attribute value of the adjustment object attribute according to the touch coordinate value.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And if the key input is obtained, determining whether the key input mode is a keyboard mode or a touch mode; Outputting a character value corresponding to the key input in the keyboard mode; And performing an attribute control mode using the touch input for the adjustment of a specific attribute value in the touch mode.

According to still another aspect of the present invention, there is provided an electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, Keycap; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, An electro-optic device for receiving a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction in the longitudinal direction and the width direction; A plurality of buttons each arranged according to the keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group to receive a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the gesture input, An electrical connection member for electrically connecting the electrode; And acquiring a key value assigned to a button corresponding to a switch that has obtained the key input, and when the amount of change in capacitance is greater than a touch threshold value, determining the gesture input as a touch input, And outputs a first signal instructing movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value, The hovering coordinate value is calculated from the change of the capacitance according to the hovering input, and the hovering coordinate value is calculated based on the calculated hovering coordinate value, A second signal indicating the movement of the virtual pointer on the virtual space, the actual space, An output controller for; the electronic apparatus including the can be provided.

According to another aspect of the present invention, there is provided a control method of an electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, A key cap to which a push input of a direction is applied; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; And a drive line for electrically connecting the first group of blocks between the buttons arranged in the first direction and applying a drive signal for inducing electrostatic capacitance to the electroded, And a controller for electrically connecting the second group of blocks between the buttons to form a scan line for receiving a scan signal for sensing a change in the electrostatic capacitance induced in the electro- Obtaining a key value assigned to a button corresponding to a switch for acquiring the key input and outputting a keyboard input reflecting the key value; Determining that the gesture input is a touch input when the amount of change in capacitance is greater than a touch threshold value; Calculating a touch coordinate value from a change in the capacitance according to the touch input; Outputting a first signal indicating movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value; Determining the gesture input as a hovering input if the amount of change in capacitance is less than the touch threshold value and greater than a hovering threshold; And calculating a hovering coordinate value from a change in the capacitance according to the hovering input; And outputting a second signal indicating movement of the virtual pointer on the virtual space, the actual space, or the augmented space based on the calculated hovering coordinate value.

It is to be understood that the solution of the problem of the present invention is not limited to the above-mentioned solutions, and the solutions which are not mentioned can be clearly understood by those skilled in the art to which the present invention belongs It will be possible.

By integrating the separately provided text input device and the pointing device into one human interface device, it is possible to reduce the unit price and the size of the product, and eliminate the unnecessary operation of the user operation, thereby improving the work efficiency.

According to the present invention, a single pointing device integrated text device can be used as a keyboard interface and a mouse interface, as well as a digitizer interface.

According to the present invention, when a pointing device-integrated text device is used, a pointer is used to select an attribute when adjusting an attribute value such as an audio volume, and a pointer is used to adjust the position of an indicator It is possible to easily adjust the value of a desired attribute by simply push input and touch input without the hassle.

According to the present invention, in a multi-device environment, a single pointing device integrated text device can be used as an input interface for a plurality of devices.

The effects of the present invention are not limited to the above-mentioned effects, and the effects not mentioned can be clearly understood by those skilled in the art from the present specification and the accompanying drawings.

1 is an exemplary view of a pointing device-integrated text input device.
2 is a flowchart for explaining an example of the operation sequence according to the mode switching of the pointing device and the text device.
3 is an example of a configuration of a text input device and a pointing device.
Fig. 4 shows examples of the pointer execution command unit integral mode switching unit.
5 is an embodiment for displaying the pointer position information input area.
6 is an embodiment of the pointer execution command unit integral mode switching unit.
FIG. 7 illustrates an embodiment using a cover of a human interface device to which the lower-positioned pointer positional information input device is applied.
8 is an embodiment of a human interface device applied to a portable notebook computer.
9 is an example in which the lower position pointer type position information input device and the lower position type pointer execution command portion are applied.
10 is a configuration diagram of a composite function input button.
11 is an example of the electronic of the compound function input button.
12 is an embodiment of a multiple function input button arrangement.
13 is an embodiment of the electrodeposition of different patterns of the multiple function input buttons
14 is an embodiment of an electrical connecting member of the compound function input button.
15 is an embodiment of a switch for inputting characters of a multi-function input button.
16 is an example of a human interface device having a complex function input button.
17 is an embodiment of an electronic keycap.
18 to 22 illustrate an example of an electronic pattern of a plurality of compound function input buttons.
23 is a flowchart showing a method of switching between a text input mode and a pointer position information input mode.
24 is a flowchart showing a method for switching the permanent touch mode.
25 is a multi-function input button module in which a plurality of multi-function input buttons are provided in a plate form.
26 is an example of the detailed structure of the electronic part.
Fig. 27 is an example of an adhesion site of a conductive adhesive.
28 is an embodiment of the compound function input button.
29 is an embodiment of a wireless type electrical connecting member.
30 is an example of a configuration diagram of a pointing device-integrated text input device.
31 is an example of signal processing of text input of the pointing device-integrated text input device of Fig. 30;
32 is an example of signal processing of a mouse input of the pointing device-integrated text input device of FIG.
33 and 34 show an example of the operation of the pointer according to the mouse input according to FIG.
35 and 36 show another example of the operation of the pointer according to the mouse input according to Fig.
37 is an example of signal processing of the digitizer input of the pointing device-integrated text input device of Fig.
FIG. 38 is an example of the operation of the pointer according to the digitizer input according to FIG.
39 is another example of the operation of the pointer according to the digitizer input according to FIG.
40 is an example of mode switching of the pointing device-integrated text input device of FIG.
41 is an example of a setting of the touch area according to the digitizer mode of the pointing device integrated text input device of FIG.
FIG. 42 and FIG. 43 show examples of the relationship between the touch area according to the digitizer mode of FIG. 41 and the touch area according to the mouse mode.
FIGS. 44 and 45 show another example of the setting of the touch area according to the digitizer mode of the pointing device-integrated text input device of FIG.
FIG. 46 is an example in which a touch area is set outside the touchable area in the setting of the touch area according to FIGS. 44 and 45.
FIG. 47 is an example of resetting the touch area according to the digitizer mode of FIG.
FIG. 48 is another example of resetting the touch area according to the digitizer mode of FIG.
FIG. 49 is a flowchart illustrating an example of a mode switching method of the pointing device-integrated text input device of FIG.
50 is a flowchart of a touch input processing method in a mouse mode and a digitizer mode of the pointing device-integrated text input device of FIG.
FIG. 51 is a flowchart illustrating an example of a method of setting a touch area in the digitizer mode of the pointing device-integrated text input device of FIG.
52 is a flowchart of another example of a method of setting a touch area in the digitizer mode of the pointing device-integrated text input device of FIG.
FIG. 53 is a flow chart of a touch area resetting method in the digitizer mode of the pointing device-integrated text input device of FIG. 30; FIG.
54 is a diagram showing some examples of the attributes to be adjusted.
55 is a diagram showing a matching relationship between the adjustment target attribute and the button of the pointing device-integrated text input device.
56 and 57 are diagrams showing an example of adjustment of an adjustment target attribute of the pointing device-integrated text input device.
FIG. 58 is a diagram illustrating another example of adjustment of an adjustment target attribute of the pointing device-integrated text input device. FIG.
FIG. 59 is a diagram illustrating another example of adjustment of an adjustment target attribute of the pointing device-integrated text input device. FIG.
FIG. 60 is a diagram relating to a first example of processing of a touch input for adjustment of an adjustment object attribute of a pointing device-integrated text input device. FIG.
FIG. 61 is a diagram related to a second example of a touch input process for adjusting an adjustment object attribute of the pointing device-integrated text input device. FIG.
FIG. 62 is a diagram relating to a third example of processing of touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device. FIG.
Fig. 63 is a diagram relating to a fourth example relating to the touch input processing for adjusting the adjustment object attribute of the pointing device-integrated text input device. Fig.
FIG. 64 is a diagram relating to a fifth example relating to processing of touch input for adjustment of an adjustment object attribute of a pointing device-integrated text input device. FIG.
65 is a diagram relating to a sixth example relating to processing of touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device.
66 is a diagram relating to a seventh example relating to the processing of touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device.
67 is a flowchart of an example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device.
68 is a flowchart of another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device.
69 is a flowchart of another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device.
70 is a flowchart of another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device.
71 is a flowchart of yet another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device.
72 is an example of a hovering input of a pointing device-integrated text input device;
73 is an example of a multi-device environment using the pointing device-integrated text input device of Fig.
FIG. 74 is a diagram illustrating an example of selection of a control target device using a hovering input in the multi-device environment of FIG. 73; FIG.
FIG. 75 is a diagram illustrating another example of selection of a control target device using a hovering input in the multi-device environment of FIG. 73; FIG.
FIG. 76 is a diagram illustrating another example of selection of a control target device using a hovering input in the multi-device environment of FIG. 73; FIG.
77 is a flowchart of an example of a multi-device control method of a pointing device-integrated text input device.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to be illustrative of the present invention and not to limit the scope of the invention. Should be interpreted to include modifications or variations that do not depart from the spirit of the invention.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, they are generally used in general terms. However, the present invention is not limited to the intention of the person skilled in the art to which the present invention belongs . However, if a specific term is defined as an arbitrary meaning, the meaning of the term will be described separately. Accordingly, the terms used herein should be interpreted based on the actual meaning of the term rather than on the name of the term, and on the content throughout the description.

The drawings attached hereto are intended to illustrate the present invention easily, and the shapes shown in the drawings may be exaggerated and displayed as necessary in order to facilitate understanding of the present invention, and thus the present invention is not limited to the drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of known configurations or functions related to the present invention will be omitted when it is determined that the gist of the present invention may be obscured.

According to an aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A keyboard mode for ignoring the touch input and outputting only a keyboard input that reflects a key value corresponding to the push input, a control unit for ignoring the push input for at least a part of the plurality of buttons and using a variation value of the touch coordinate value A mouse mode for outputting a mouse input indicating a moving distance and a moving direction of the pointer and a digitizer input for indicating a position of the pointer using the touch coordinate value ignoring the push input for at least a part of the plurality of buttons An electronic apparatus that performs a digitizer mode for outputting the digital data can be provided.

Wherein the controller calculates a variation value of the touch coordinate value by performing a difference operation between a touch coordinate value of a current scanning period and a touch coordinate value of a previous scanning period in the mouse mode and outputs the pointer in the digitizer mode The digitizer input may be output from the touch coordinate value in consideration of a matching relationship between the screen region and the touch coordinate values.

The controller may set the matching relationship so that the touch coordinate value of the first touch input when the digitizer mode is entered corresponds to the position of the pointer on the screen area.

Wherein the controller calculates a variation value of the touch coordinate value by a difference operation between a touch coordinate value of a current scanning period and a touch coordinate value of a previous scanning period in the mouse mode and performs a first operation when the digitizer mode is entered in the digitizer mode The digitizer input may be obtained by performing a difference operation between the touch coordinate value of the touch input and the current touch coordinate value.

Wherein the controller determines whether the left-handed mode or the right-handed mode is entered when entering the mouse mode, activates only the left-handed buttons of the entire touch sensing area in the left-handed mode, It is possible to activate only the electrodes of the buttons located on the right side among the entire touch sensing areas and activate all of the buttons located in the entire touch sensing area when entering the digitizer mode.

The controller may set a touch area matched to a screen area in which the pointer is displayed such that a touch coordinate value initially performed at the time of entering the digitizer mode matches a position in the screen area of the pointer.

The controller may reset the touch area according to a touch input to the out-of-area when a touch input to an area out of the touch area occurs in the entire touch sensing area.

The controller may set different touch areas matching the screen area displaying the pointer according to a touch input performed first when entering the digitizer mode.

According to another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value corresponding to the push input and a pointer control signal for ignoring the push input for at least a part of the plurality of buttons and reflecting the touch coordinate value The controller calculates a touch coordinate value corresponding to the touch input based on the scan signal, and when the touch mode is a mouse mode, the controller calculates the touch coordinates And when the touch mode is the digitizer mode It may be provided an electronic device for obtaining the absolute coordinates from the touch coordinates.

Wherein the relative coordinate value is calculated from a difference operation between a touch coordinate value of a current scanning period and a touch coordinate value of a previous scanning period, and the absolute coordinate value is calculated from a difference between a touch region and a touch region, Can be calculated from the touch coordinate value.

The controller may set the matching relationship based on the touch coordinate value input first after entering the digitizer mode.

The relative coordinate value is calculated from the difference between the touch coordinate value of the current scanning period and the touch coordinate value of the previous scanning period, and the absolute coordinate value is calculated from the touch coordinate value of the current scanning period and the first coordinate value Can be calculated from a difference operation between input touch coordinate values.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force trooid corresponding to the touch input, ;

Outputting only a keyboard input that reflects a key value corresponding to the push input while ignoring the touch input when operating in the keyboard mode; Entering a mouse mode; Outputting a mouse input indicating movement distance and movement direction of the pointer by using the variation value of the touch coordinate value while ignoring the push input for at least a part of the plurality of buttons when operating in the mouse mode; Entering a digitizer mode; And a step of outputting a digitizer input indicating the position of the pointer using the touch coordinate value, ignoring the push input for at least a part of the plurality of buttons .

The step of outputting the mouse input may include calculating a variation value of the touch coordinate value through a difference operation between a touch coordinate value of a current scanning period and a touch coordinate value of a previous scanning period, The step of obtaining the digitizer input may include obtaining the digitizer input from the touch coordinate value in consideration of a matching relationship between the screen area of the display outputting the pointer and the touch coordinate values.

And setting the matching relation such that a touch coordinate value of a first touch input when the digitizer mode is entered corresponds to a position of the pointer on the screen area.

The step of outputting the mouse input may include calculating a variation value of the touch coordinate value through a difference operation between a touch coordinate value of a current scanning period and a touch coordinate value of a previous scanning period, The method may further include acquiring the digitizer input through a difference operation between a touch coordinate value of a touch input first performed at the time of entering the digitizer mode and a current touch coordinate value.

Determining whether the left-handed mode or the right-handed mode is entered when entering the mouse mode; In the case of the left-handed mode, activating only the left-side buttons of the entire touch sensing area; Activating only the electrodes of the buttons located on the right of the entire touch sensing area in the right hand mode; And activating all the electrodes of all the buttons located in the entire touch sensing area upon entering the digitizer mode.

And setting a touch area matching the screen area in which the pointer is displayed such that a touch coordinate value, which is first performed at the time of entering the digitizer mode, is matched with a position of the pointer in the screen area.

Obtaining a touch input for an area of the entire touch sensing area that is out of the touch area during operation in the digitizer mode; And resetting the touch area according to a touch input to the off-area.

And setting the touch area matched to the screen area displaying the pointer differently according to a touch input performed first when entering the digitizer mode.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for acquiring a key value assigned to a button corresponding to a switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force trooid corresponding to the touch input, A keyboard mode for ignoring input and outputting only a keyboard input reflecting a key value according to the push input and a touch mode for outputting a pointer control signal for ignoring the push input for at least a part of the plurality of buttons and reflecting the touch coordinate value Entering a mode; Calculating a touch coordinate value according to the touch input based on the scan signal when entering the touch mode; Obtaining a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode; Obtaining an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode; And outputting a signal for controlling the position of the pointer based on the obtained value of either the relative coordinate value or the absolute coordinate value.

Calculating the relative coordinate value from the difference between the touch coordinate value of the current scanning period and the touch coordinate value of the previous scanning period; And calculating the absolute coordinate value from the touch coordinate value in consideration of a matching relation between the screen area displaying the pointer and the touch area.

And setting the matching relationship based on the first touch coordinate value inputted after entering the digitizer mode.

Calculating the relative coordinate value from the difference between the touch coordinate value of the current scanning period and the touch coordinate value of the previous scanning period; And calculating the absolute coordinate value from the difference between the touch coordinate value of the current scanning period and the first touch coordinate value inputted after entering the digitizer mode.

According to still another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, A touch mode for outputting a first touch signal for controlling the position of the pointer according to the touch coordinate value and a keyboard mode for outputting only a keyboard input for reflecting a key value corresponding to the push input, When the key input for the button having the key value assigned with the adjustment object attribute is obtained during the operation in the touch mode, the second touch signal indicating the adjustment of the attribute value of the adjustment object attribute May be provided.

The controller may output a signal for instructing activation of the adjustment object attribute when a key input for a button having a key value to which an adjustment object attribute is assigned during operation in the touch mode is obtained.

The activation of the adjustment object attribute may include an indication of a graphic object for adjustment of the adjustment object attribute.

The controller may generate the second touch signal based on only one of a vertical value and a horizontal value of the touch coordinate value when the adjustment object attribute has a one-dimensional attribute value.

The controller may generate the second touch signal based on a value corresponding to a moving direction of the indicator on the graphic object for adjusting the adjustment object attribute among the vertical value and the horizontal value of the touch coordinate value.

The controller may generate the second touch signal based on the difference between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period.

The controller can set a touch area relating to adjustment of the adjustment object attribute corresponding to the range of the attribute value of the adjustment object attribute.

The controller sets the touch area so that the maximum value of the attribute value of the adjustment object matches the top or right side of the touch area and the minimum value of the attribute value matches the lowermost or leftmost end of the touch area have.

The controller may generate the second touch signal so that the touch coordinate value and the current property value of the adjustment object attribute correspond to each other.

Wherein the controller generates a matching relationship between a touch coordinate value of an initial touch input and an attribute value of the adjustment object attribute after a key input for a button having a key value assigned the adjustment object attribute is obtained, And the second touch signal based on the matching relationship.

Wherein the controller performs a difference operation between the touch coordinate value of the first touch input performed after the key input for the button having the key value assigned the adjustment object attribute is obtained and the touch coordinate value for adjusting the adjustment object attribute, The second touch signal can be generated.

The controller may generate the second touch signal according to the touch coordinates obtained while the sensed touch input is held together with the key input of the button having the key value assigned with the adjustment object attribute.

The controller may generate the second touch signal based on a touch coordinate value of a touch input sensed by an electrode of a button having a key value to which the adjustment object attribute is assigned.

The controller generates the second touch signal indicating either the increase or the decrease of the attribute value when the touch input sensed by the button of the button having the key value assigned with the adjustment object attribute is counterclockwise And a second touch signal indicating another one of the increase or decrease of the attribute value when the touch input sensed by the button of the button having the key value assigned with the adjustment object attribute is clockwise.

According to still another aspect of the present invention, there is provided an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force toroid according to the touch input, When the key input is obtained, it is determined whether it is a keyboard mode or a touch mode. In case of the keyboard mode, a character value corresponding to the key input is output. In the case of the touch mode, An electronic device performing the attribute adjustment mode to be used may be provided.

The controller may enter the attribute control mode when the key input occurs in the touch mode, and may return to the touch mode when the key input occurs in the attribute control mode.

The controller may maintain the attribute adjustment mode while the key input is maintained in the touch mode.

In the touch mode, the controller may use one touch input after the key input has occurred to adjust the specific attribute value.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And a controller for obtaining a key value assigned to a button corresponding to the switch for which the key input is obtained and acquiring a touch coordinate value calculated from a change in capacitance of the force trooid corresponding to the touch input, ; Outputting only a keyboard input that reflects a key value corresponding to the push input while ignoring the touch input when operating in the keyboard mode; Entering a touch mode; Outputting a first touch signal for controlling the position of the pointer according to the touch coordinate value when the touch mode is operated; Receiving a key input for a button having a key value assigned an adjustment object attribute in operation in the touch mode; And outputting a second touch signal instructing adjustment of an attribute value of the adjustment object attribute according to the touch coordinate value.

And outputting a signal instructing activation of the adjustment object attribute when a key input for a button having a key value to which an adjustment object attribute is assigned during operation in the touch mode is obtained.

The activation of the adjustment object attribute may include an indication of a graphic object for adjustment of the adjustment object attribute.

The generating of the second touch signal may include generating the second touch signal based on only one of a vertical value and a horizontal value of the touch coordinate value when the adjustment object attribute has a one-dimensional property value can do.

The generating of the second touch signal may include generating the second touch signal based on a value corresponding to the moving direction of the indicator on the graphic object for adjusting the adjustment object attribute among the vertical value and the horizontal value of the touch coordinate value And a step of generating the data.

The generating of the second touch signal may include generating the second touch signal based on a difference between the touch coordinate value of the current scanning period and the touch coordinate value of the previous scanning period.

And setting a touch region relating to adjustment of the adjustment object attribute corresponding to the range of the attribute value of the adjustment object attribute.

Wherein the setting step includes setting the touch area so that the maximum value of the attribute value of the adjustment object attribute matches the top or right side of the touch area and the minimum value of the attribute value matches the lowermost or leftmost end of the touch area And a step of setting the step.

The generating of the second touch signal may include generating the second touch signal such that the touch coordinate value and the current property value of the adjustment object attribute correspond to each other.

The generating of the second touch signal may include generating a matching relationship between a touch coordinate value of the first touch input and an attribute value of the adjustment object attribute after the key input for the button having the key value assigned the adjustment object attribute is obtained And generating the second touch signal based on the touch coordinate value and the matching relation.

The step of generating the second touch signal may further include a step of generating a second touch signal based on a touch coordinate value of a touch input performed first after a key input for a button having a key value assigned with the adjustment object attribute is obtained, And generating the second touch signal through a difference operation between the values.

The generating of the second touch signal may include inputting a key for a button having a key value to which the adjustment object attribute is assigned and the second touch signal according to the touch coordinate value obtained while the sensed touch input is maintained And a step of generating the data.

The step of generating the second touch signal may include generating the second touch signal based on a touch coordinate value of a touch input sensed by an electrode of a button having a key value to which the adjustment object attribute is assigned have.

Wherein the step of generating the second touch signal comprises the steps of: when the touch input sensed by the button of the button having the key value assigned with the adjustment object attribute is counterclockwise, And a second touch signal indicating a second one of the increase or decrease of the attribute value when the touch input sensed by the button of the button having the key value assigned with the adjustment object attribute is in the clockwise direction, For example.

According to still another aspect of the present invention, there is provided a control method of an electronic apparatus having a composite human interface having a keyboard layout, the electronic apparatus comprising: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, An electrical connection member for electrically connecting the electrode; And if the key input is obtained, determining whether the key input mode is a keyboard mode or a touch mode; Outputting a character value corresponding to the key input in the keyboard mode; And performing an attribute control mode using the touch input for the adjustment of a specific attribute value in the touch mode.

Entering the attribute control mode when the key input occurs in the touch mode; And returning to the touch mode when the key input occurs in the attribute adjustment mode.

And maintaining the attribute control mode while the key input is held in the touch mode.

In the touch mode, one touch input may be used to adjust the specific attribute value after the key input is generated.

According to still another aspect of the present invention, there is provided an electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, Keycap; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, An electro-optic device for receiving a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction in the longitudinal direction and the width direction; A plurality of buttons each arranged according to the keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group to receive a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the gesture input, An electrical connection member for electrically connecting the electrode; And acquiring a key value assigned to a button corresponding to a switch that has obtained the key input, and when the amount of change in capacitance is greater than a touch threshold value, determining the gesture input as a touch input, And outputs a first signal instructing movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value, The hovering coordinate value is calculated from the change of the capacitance according to the hovering input, and the hovering coordinate value is calculated based on the calculated hovering coordinate value, A second signal indicating the movement of the virtual pointer on the virtual space, the actual space, An output controller for; the electronic apparatus including the can be provided.

The controller may set any one of the output devices as a control target when the touch input is acquired in a state where a virtual pointer corresponding to the second signal is located at a position corresponding to any one of the output devices.

Wherein the multi-device environment further comprises a virtual or augmented object,

The controller can set the object as a control target when the touch input is acquired in a state where a virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object.

The multi-device environment may further include an HMD for processing a virtual reality or augmented reality, and the second signal may indicate a location of a virtual pointer displayed by the HMD.

According to another aspect of the present invention, there is provided a control method of an electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, A key cap to which a push input of a direction is applied; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout; A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; And a drive line for electrically connecting the first group of blocks between the buttons arranged in the first direction and applying a drive signal for inducing electrostatic capacitance to the electroded, And a controller for electrically connecting the second group of blocks between the buttons to form a scan line for receiving a scan signal for sensing a change in the electrostatic capacitance induced in the electro- Obtaining a key value assigned to a button corresponding to a switch for acquiring the key input and outputting a keyboard input reflecting the key value; Determining that the gesture input is a touch input when the amount of change in capacitance is greater than a touch threshold value; Calculating a touch coordinate value from a change in the capacitance according to the touch input; Outputting a first signal indicating movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value; Determining the gesture input as a hovering input if the amount of change in capacitance is less than the touch threshold value and greater than a hovering threshold; And calculating a hovering coordinate value from a change in the capacitance according to the hovering input; And outputting a second signal indicating movement of the virtual pointer on the virtual space, the actual space, or the augmented space based on the calculated hovering coordinate value.

Obtaining the touch input in a state where a virtual pointer according to the second signal is at a position corresponding to any one of the output devices; And setting one of the output devices as a control target.

Wherein the multi-device environment further includes a virtual or augmented object, the method comprising: acquiring the touch input in a state where a virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object; And setting the object to be controlled as a control object.

The multi-device environment may further include an HMD for processing a virtual reality or augmented reality, and the second signal may indicate a location of a virtual pointer displayed by the HMD.

The present invention relates to a human interface for receiving text information or pointing position information from a user in a digital device capable of receiving text or pointing position related information such as a computer, a notebook, a tablet PC, a mobile phone, and the like, and transmitting the text information or the pointing position information to the digital device.

As a conventional text information input device, a keyboard composed of an elastic body and a plurality of physical buttons connected to a switch is widely used.

In a digital device having a touch interface, a virtual keyboard is displayed on a display. When a part of a user's body is touched with a virtual keyboard displayed on the display, a gesture or an electrical signal of the user is sensed, A method of inputting text on a virtual keyboard displayed in a portion is also used.

The touch interface recognizes the movement of a part of the user's body or recognizes the contact with a specific contact surface, senses the flow of current through the user's body, or intercepts or interferes with light or sound waves by a part of the user's body The touch of the user can be recognized by sensing or the like.

Examples of touch interfaces include a pressure sensitive touch screen, an electrostatic touch screen, an optical touch screen, and an ultrasonic touch screen.

A resistive touch screen or a pressure sensitive touch screen is a pressure sensitive touch screen.

Resistive touchscreen is cheap, and it is advantageous to write in handwriting or small cell with stylus pen. However, because it uses pressure, it is not recognized by pressing hard, and touch feeling is slightly duller than electrostatic touch method. It is known as a disadvantage.

The resistive touchscreen consists of several layers.

Among these several layers are conductive layers, with the two layers facing the air layer.

Pressing the outer screen will cause the two conductive layers to touch each other, which causes the resistance and current to change and recognize the touch.

* Capacitive sensing or electrostatic touching is a type of sensing the operation using the capacitive coupling effect.

The electrostatic touchscreen is made of highly conductive glass, indium tin oxide, unlike pressure-sensitive touchscreens that use pressure.

By attaching the sensor to the four corners of the glass, current flows through the glass surface.

It is the electrostatic principle to recognize the change of current through this.

At this moment, the moment the finger moves on the screen, the electrons that flowed through the glass flow into the body through the finger, and the sensor senses the position where the change occurred.

The electrostatic touch method is known to have a feeling of operation and smoothness compared with a pressure sensitive touch screen because the touch is recognized by touching the screen rather than pressing the screen by force.

In addition, the electrostatic touch method enables multi-touch that can touch various places.

Since the electrostatic touch method is a method of operating by using a change in electric current, it may not be used with a leather glove which does not communicate with electric current, or may not be operated with a nail or a stylus pen.

However, you can touch the screen with a separate electrostatic stylus pen.

Sensors are sensitive and may be affected by peripheral devices.

The optical touch screen operates by measuring coordinates with the infrared camera mounted on the apex of the touch screen and the infrared light illuminates with the shadow of the object to be touched.

The ultrasonic touch screen emits ultrasonic waves on the screen, detects the interference effect by the user's touch, and operates by measuring the coordinates.

Various touch input techniques that can be used to detect positional information of a part of a user's body by sensing contact or movement of another user and controlling position information of the pointer can be used in the present invention.

1 is an exemplary view of a pointing device-integrated text input device.

The pointing device-integrated text input device may have a housing (100) for supporting a text input device and a pointer location information input area.

The housing has a strength enough to withstand the pressure of a user input and receives text input information and pointer position information input information and transmits the information to a digital device connected to the pointing device integrated text input device by wire or wireless A control unit, a memory unit, a battery unit, an encoding unit, and a transmission unit.

The pointing device-integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be configured as physical buttons or virtual buttons.

The physical button may include a button connected to the elastic body, or may have a feature that the button itself is elastic and moves to the position when the user receives the input, and returns to the original position when the pressure of the user is removed.

The physical button is connected to the electrical switch, and the user's pressure is applied to the physical button, so that the position of the button is shifted and the phase of the switch is changed, so that the text input value of the corresponding button is generated.

The physical button is structured to have elasticity without an electrical switch, and moves to a position when the user's pressure is removed. The user's text input information is input by the touch input device The user's pressure or gesture can generate textual input information based on the recognized location information.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button can display an arbitrary button by projecting light onto a transparent, semi-transparent or opaque object.

The virtual button is not perceived by the user's eyes but can generate corresponding text input information based on user's pressure or gesture information with unique position information per text.

The pointing device-integrated text input device may have a text input area 107 and pointing location information input areas 108a and 108b having at least a part thereof as a common area.

The pointing position information input areas 108a and 108b are areas located at the upper or lower end of the button for text input. The pointing position information input area 108a and 108b may have at least a part of the pointing position information input area common to the text input area have.

The pointing location information input area may include the text input area or the text input area may include a point location information input area.

The pointing position information input area and the text input area are at least partially common and at least partially used as the pointing position information input area but not used as the text input area and at least partially used as the text input area, May not be used.

The pointing device integrated text input device includes a pointer position information input device 105 for forming a virtual text input area or a virtual pointing position information input area for inputting text, for inputting pointing position information, or for inputting text and pointing position information May be configured on the pointing device-integrated text input device or on the outside of the pointing device-integrated text input device.

The pointer position information input device 105 may be provided on the surface of the housing 100 or on the housing 100 such as an infrared ray generator and an infrared ray receiver or an RGB camera, an ultrasonic generator, an ultrasonic receiver, an infrared ray generator, It is possible to receive position information and gesture information.

The pointer location information input device may be configured as a plurality of devices to enhance the accuracy or sensitivity of the pointer location information input area.

For example, a pointer position information input device 105b for configuring a text input or pointing position information input area 108b of the right hand.

Or a pointer position information input device 105a for configuring the left hand text input or pointing position information input area 108a.

The text input area or the pointing position information input area 108b for the right hand may include an area of the J button of the English standard keyboard.

The text input area or the pointing position information input area 108a for the left hand may include an area of an F (F) button of an English standard keyboard.

The pointer position information input device may include both the J and F buttons of the English standard keyboard.

Wherein the pointing position information input area is capable of moving a pointer position on the plurality of display parts when the pointing device integrated text input device is connected to a plurality of digital devices having a display part have.

For example, the pointer position information input region may be divided into regions so as to be matched with the respective display portions, or a separate button indicating the display portion may be operated to transmit pointer position information on the display portion, or a plurality of display portions may be referred to as a virtual single The pointer position information can be transmitted so that the pointer can be moved on the virtual single display unit.

The pointing device-integrated text input device includes a pointing position information input device that constitutes a pointing input area and receives pointer position information from a user, and the pointing device integrated text input device includes a button, an image, a space, an icon, And a pointer execution instruction unit 101 or 102 for executing at least one function on the text input window.

The pointer execution command section can be composed of one or two buttons, which are responsible for the first function and the second function, respectively, and can be located on the left side of the housing, in the mail, or in the center.

The first function may function as a left click of a computer mouse and the second function may function as a right click of a computer mouse, for example.

The pointer execution command unit composed of one or two buttons may be configured on both the left side and the postal side of the housing so as to be convenient to use both the left-handed and the right-handed.

The pointer execution command unit may be configured to be operated by touching or light interception of a part of the user's body, interference of ultrasonic waves, or shadow of a part of the user's body using the above-described touch technology.

The pointer execution command unit may be configured as an elastic physical button.

The pointer execution command unit may operate using at least one button of a text button located in the text input area in addition to the pointing position information input area.

The pointer execution command unit can operate by selecting a physical or virtual text button on the pointing position information input area.

For example, when a virtual input device is used as a pointing position information input device and a physical button is used as a text input device, the position information of the pointer is input in the virtual pointing position information input area in the pointing position information input mode, You can issue a pointer execution command by pressing the text button.

The pointer execution command unit may receive the pointer position information to the user first gesture in the pointing position information input area and generate the pointer execution command by the user second gesture at the same position.

The pointer execution command unit may be configured to perform a first function by a first gesture of the user's body, a first voice, a first blink, a first mouth shape, or the like.

The pointer execution command unit may be configured to perform a second function by a second gesture of the user's body, a second voice, a second blink, a second mouth shape, or the like.

The pointing device-integrated text input device may include a text input mode for inputting text information through the text input device and a pointing position information input mode for inputting pointing position information through the pointing position information input device.

The text input mode and the pointing position information input mode can be switched by the mode switching unit 103.

The mode switching unit 103 may be a switch located separately on the housing.

The mode switching unit 103 may detect the simultaneous reception of at least one text input button or a plurality of text inputs included in the text input device and perform mode switching.

The mode switching unit 103 may switch the mode by receiving control information from the digital device connected to the pointing device-integrated text input device by wire or wirelessly.

The mode switching unit 103 may be integrated with the pointer execution command unit 102.

For example, a first gesture such as a contact of a part of the user's body on the pointer execution command unit 102 that performs a first reaction to a first touch or a first pressure and a second reaction to a second touch or a second pressure, Such as switching a mode by sensing a first touch or a first pressure and pressing a button, to generate a pointer execution command by reacting to a second touch or a second pressure by a second gesture such as pressing a button.

The mode switching unit 103 may be configured as a temporary mode switching mode and a permanent mode switching mode.

For example, in response to a first touch or a first pressure, a mode is changed from a text input mode to a pointing position information input mode, and when a first touch or a first pressure is removed, have.

Alternatively, in the pointing position information input mode in response to the first touch or the first pressure, the mode may be switched to the text input mode, and when the first touch or the first pressure is removed, the mode may be set to return to the pointing position information input mode. .

The user may switch from the text input mode to the pointing position information input mode in response to the second touch or the second pressure or the pivot switch and configure the permanent switching mode so that the pointing position information input mode is maintained even if the second touch or the second pressure is removed .

The temporary mode can be switched by the first control information received from the pointing device integrated text input device and the wired or wirelessly connected digital device.

The permanent mode can be switched by the second control information received from the pointing device integrated text input device and the wired or wirelessly connected digital device.

The mode switching unit 103 may be integrated with the pointer execution command unit.

For example, when the first touch or first pressure is detected on the pointer execution command unit, the pointer mode is switched from the text input mode to the pointer position information input mode. When the second touch or the second pressure is detected, And when the third touch or the third pressure is applied, it is set to the permanent switching mode that operates in the pointer position information input mode even if the third touch or the third pressure is removed.

At this time, it is possible to configure to be able to input a pointer execution command even in the permanent switching mode.

The mode switching unit may be formed on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b formed on the left side, right side, left side, and right side of the housing may be configured to include a virtual button or a physical button, and configured to operate by sensing a user's touch input or pressure.

The mode switching units 106a and 106b formed on the left, right, left, and right sides of the housing may have an input area of 3 centimeters or more and less than 15 centimeters along the side surface of the housing.

The pointing device-integrated text input device may have a transmission unit 104 for transmitting data wired or wirelessly to a digital device including an external or pointing device-integrated text input device.

The digital device can receive text input or receive pointer location information.

2 is a flowchart for explaining an example of the operation sequence according to the mode switching of the pointing device and the text device.

The pointing device-integrated text input device may have a separate power source, receive power from the outside by wire or wireless, and may have a separate switch for controlling the power source.

If the power is supplied to the pointing device-integrated text input device by the switch for controlling the power device, the text input device can determine whether the pointing device integrated text input device is in the text input mode or the pointing position information input mode.

As a result of the determination, if the text input mode is selected, the text input device may be activated and a text input may be received from the user (201).

The text input of the input user can be transmitted to a digital device connected by wire or wireless (202).

When the mode is switched to the pointing position information input mode during the text input mode, the text input mode can be switched to the pointing position information input mode.

Or the pointing position information can be input simultaneously with the text input.

When the mode is switched to the pointing position information input mode, the pointing position information may be received by the user (204).

The input pointer location information may be transmitted to a digital device connected by wire or wireless connection (205).

When the pointing device integrated text input device receives the pointer first execution command (206), the pointer first execution command may be transmitted to the digital device connected by wire or wireless (207).

When the pointer-integrated text input device receives (208) the pointer second execution command, the pointer first execution command may be transmitted to the digital device connected by wire or wireless (209).

When the temporary mode switching is canceled or the permanent mode switching is released, the pointing device-integrated text input device can switch to the text input mode.

If the power of the power source unit is turned off, the power of the pointing device integrated text input device is cut off, or there is no digital device connected or the connection is disconnected, or there is no input of the user for a certain period of time, Can

3 is an example of a configuration of a text input device and a pointing device.

The pointing device-integrated text input device may include a first housing 301 including a power unit, a control unit, or a communication unit, and a second housing 302 for configuring a text input area and a pointing location information input area.

The pointing device integrated text input device may have a text input device and a text input area 303 for receiving text input from a user.

At this time, the text input area 303 may be composed of a virtual button or a physical button.

The pointing location information input device may be configured as a pressure sensitive or capacitive touch pad type and may be located 304 above the physical buttons of the text input device.

At this time, if the text input device is constituted by a physical touch pad type such as a pressure sensitive type or capacitive type, the touch pad can be used as a text input device and a pointing position information input device.

In this case, a physical touch pad such as a depressurizing type or a capacitance type can be configured as a large area touch pad type pointing device integrated type text input device 300 including a touch pad 304 including a plurality of text button areas of a text input unit.

Alternatively, the physical touch pad such as a depressurizing type or capacitive touch type can be configured as a plurality of touch pad type integrated text input device 310 including a plurality of touch pads 311 including a text button area of a text input unit.

Or an upper camera-type pointing device-integrated text input device 320 that receives (321) the pointing position information input by an infrared camera or an RGB camera 222 located at the upper end of the pointing position information input area have.

At this time, the upper camera-type pointing device-integrated text input device 320 can configure the virtual text input button 303 using the upper camera.

And a lower camera 332-type pointing device-integrated text input device 330 configured to receive the pointing position information input 331 located at the lower end of the second housing.

At this time, the lower camera-type pointing device-integrated text input device 330 may configure the virtual text input button 303 to replace the physical text button using the lower camera.

Or a pointing position information input by an infrared ray transmitter or an ultrasonic wave transmitter or an infrared ray receiver or an ultrasonic receiver which receives interfered information by a part of the user's body, Receiving type pointing device-integrated text input device 340 that receives text information through the pointing device 341.

At this time, the virtual pointing position information input area formed as a pair can be used as a virtual text button input means in place of the physical text button by the mode switching unit.

Fig. 4 shows examples of the pointer execution command unit integral mode switching unit.

An elastic body 403 for returning the position to the original position when the pressure is removed, a button 402 for receiving the pressure of the user, and a pointer operation command A mode switching unit 401 for switching between a text mode and a pointing position information input mode by detecting a user's touch input at an upper portion of a button in a button-type pointer execution command unit having switches 404 and 405 for generating a touch input The pointer execution command unit integrated mode switching unit 400 can be configured.

An elastic body 403 for returning to the original position when the pressure is removed, a button 402 for receiving the pressure of the user, and a pressure sensor A second switch unit 411 which is connected by a user second pressure smaller than the user first pressure to generate a mode switching execution command in a button-type pointer execution instruction unit having first switches 404 and 405 for causing execution commands to be generated, 412), and a pressure discriminating pointer execution command unit integrated mode switching unit 410.

 The pressure difference type pointer execution command unit integrated mode switching unit 410 moves the button unit 402 and fixes the button unit 402 so that the elastic unit 403 does not return to the original position.

In this case, the position where the button is fixed can be configured to be set to the position where the second switches 411 and 412 are joined and the first switches 404 and 405 are not joined, and to operate in the permanent mode switching mode when the button is fixed .

 The pointer execution instruction unit integrated mode switching unit 400 using the touch input can be configured to operate the permanent mode changeover switch 414 through position shifting such as slipping the button unit and the permanent mode changeover switch 414 The pointer execution command switches 404 and 405 can be configured to operate when additional pressure is applied in the operated state.

When the contact area of a part of the user body which is composed of the touch pad 421 and touches the touch pad is in the first predetermined range, the pointer execution command instruction part integrated mode switching part 410 operates as the mode switching part, It can be operated as a pointer execution command section.

5 is an embodiment for displaying the pointer position information input area.

The human interface apparatus of the present invention may be designed to further include pointer position information input area display units 701 and 702 for visually displaying the pointer position information input area in the pointer position information input mode.

The mode switching unit of the present invention is provided separately from the button of the text input unit and recognizes that a part of the user's body is touched to a part of the human interface body to switch to the text input mode and the pointer position information input mode, It can be designed to operate in the pointer position information input mode and to operate in the text input mode in non-touch.

At this time, when a part of the body used for the mode switching is the right hand (106b), the hand which performs the pointer position information input 108a can be designed to be a left hand.

In this case, it is desirable that the pointer position information input region is designed to be closer to the opposite corner of the corner where the mode switching unit is located, and the same principle can be also applied when the left and right hands are reversed. (106a, 108b)

On the other hand, a part of the body used for the mode switching may be a right hand, and a hand for inputting the pointer position information may be designed to be a right hand.

In this case, it is preferable that the pointer position information input area is designed to be closer to the corner where the mode switching part is located than the opposite corner of the corner where the mode switching part is located, and the left hand can be designed on the same principle.

The mode switching unit may determine the text input mode and the pointer position information input mode based on the number of user fingers recognized by the pointer position information input unit.

The number of the recognized user fingers when determining the pointer position information input mode is smaller than the number of the recognized user fingers when determining the text input mode.

For example, while controlling the mode switching unit with the left hand, the finger of the left hand may be untouched from the text input button, and the index of the right hand may be touched for inputting the pointer position information, Is one.

On the other hand, when the finger of the left hand and the right hand are touched on the keyboard for text input, the number of the fingers of two to eight recognized users is recognized.

The pointer position information input mode display unit displays the pointer position information input area from the point of time when the mode switching unit is switched to the pointer position information input mode to the time point when the mode is switched to the pointer position information input mode, It can be displayed visually.

The pointer position information input mode display unit may be displayed by the visible light generator from the text input button or the reflected light by the text input button or through the space between the text input buttons.

The pointer position information input mode display unit includes non-visible light generators 701a and 701b and surfaces 702a and 702b coated with a dye that optically react with the non-visible light to emit visible light, Can be applied to the interval between the input button or the text input button.

The mode switching unit may further include a hand side determining unit for determining whether the user inputs the pointer position information with a left hand or a right hand.

The display area of the pointer position information input display unit can be flexibly displayed according to the hand side determination unit.

It is possible to flexibly switch the button arrangement and operation of the pointer execution command unit according to the hand side judgment unit.

For example, when the pointer execution command includes a right-click and a left-click, the hand-side determination unit may switch the button to perform the right-click and left-click operations.

The pointer position information input area display unit may display (702a, 702b) different pointer position information input areas according to the determination result of the hand side determination unit.

The mode switching unit may be designed to automatically switch to the text input mode when the pointer position information input from the user is not input for a predetermined time in the pointer position information input mode or when the input is received by the text input button.

The pointer position information input area display unit may apply a dye to a part of the text input button or the text input area so that the pointer input area is visually displayed irrespective of the mode of the mode switching unit so that the pointer input area can be recognized even in the text input mode .

6 is an embodiment of the pointer execution command unit integral mode switching unit.

When the input operation in which the text input mode and the pointer position information input mode are frequently changed is performed, the number of times the mode switching and the pointer execution command are input is increased.

For example, in case of right-handed person, when you want to input pointer position information while text input mode is being performed in text input mode, you need to input the pointer position information after inputting to pointer real name command with left hand after switching mode with left or right hand do.

In general, while performing a quick operation, the user is required to input text and pointer position information and a pointer execution command while keeping a gaze on the monitor. If a mode switching unit and a pointer execution command input unit are provided separately, hand movement frequently occurs It is not possible to find the exact position, so it may not be able to perform properly, or it may be troublesome to look at the keyboard with eyes.

In order to solve this problem, for example, in the case of a right-handed person, when a hand is placed on the mode switching unit with the left hand after inputting text in the text input mode, a mode switching command is generated and the mode is changed to the pointer input mode. When the user places the hand position on the mode switching unit and inputs the pointer position information with the right hand and applies pressure to the mode switching unit, the pointer execution command unit receives the user's input.

Thereby, the user can share the position of the mode switching unit for mode switching and the position of the pointer execution command unit for the pointer execution command.

For example, the mode switching unit may include a touch switch capable of accepting a touch input of a user's hand, and the pointer execution command unit may be disposed under the mode switching unit, which includes a switch responsive to a pressure such as a tact switch.

In this case, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other by a conductor material capable of recognizing a touch from the user's hand or commonly connected to the mode switching unit 1201 So that the user can perform the same mode switching regardless of whether the user touches the first pointer execution command unit or touches the second pointer execution command unit.

At this time, the mode switching is operated in the pointer position information input mode while the touch is being performed, and in the text input mode when the touch is released.

The mode switching by the touch may be composed of another switch operating at a pressure smaller than the pressure for executing the pointer execution command, or a sensor capable of sensing the position of the user's finger.

At this time, the mode switching and pointer execution command unit is located in an area different from the text input area. Preferably, in the case of right handedness, it is located in the left outer area of the text input area. If the mode switching unit and the pointer execution command unit are located outside the text input area, the possibility that the pointer position information input unit is confused with the pointer position information input disappears and the pointer position information input area can be expanded.

The hybrid human interface apparatus of the present invention may include a second mode switching unit 1202. The second mode switching unit switches to a text input mode and a pointer position information input mode each time an input is received from a user with a switch operating as a toggle switch. Thus, even if the user does not touch the mode switching unit with the left hand, the pointer position information can be input with only the right hand.

At this time, when the compound human interface apparatus is in the text mode by the second mode switching unit, when the mode switching command by the touch is received, the compound human interface apparatus of the present invention operates in the pointer position information input mode. In addition, when the compound human interface apparatus by the second mode switching unit is in the pointer position information input mode, when the mode switching command by touch is received, the pointer position information input mode is maintained but the mode switching command by touch is released When a text input is received by the text input unit, the mode is switched to the text input mode.

At this time, if the text input mode is switched to the text input mode, at least the first text input is ignored, and when at least two or more text inputs are received, the mode is switched to the text input mode.

In this case, when at least two or more text inputs are received and the mode is switched to the text input mode, the composite human interface device transmits the text input including at least the first text, which has been ignored, to the digital device, Lt; / RTI >

7 is an embodiment utilizing a cover of a composite human interface device.

The composite human interface device requires space of at least 1 millimeter to 2 millimeters on the top of the text input device plane in which the pointer position information input device is constituted by the physical device to form the pointer position information input area, Or a border for locating the reflector may be required at the edges of at least three sides surrounding the text entry area.

At this time, a difference of at least 1 to 2 millimeters occurs between the height of the edge of at least three corners and the height of the plane of the text input area, and a cuboid type space is formed substantially.

The complex human interface apparatus of the present invention may further include a multipurpose cover 1310 for protecting the text input area from an external impact in the space of the substantially rectangular parallelepiped type.

The multi-purpose lid 1322 is separated from the composite human interface device 1320 and can be coupled and separated by a magnet or a physical structure.

The multipurpose cover 1322 may be folded several times. Preferably, the width of at least one area of the divided area of the multipurpose cover may be less than the width of the other area (1341).

This can further reduce the slope of the composite human interface device when the multipurpose cover is folded down and then mounted to adjust the inclination of the composite human interface device.

When the multipurpose cover is folded and then mounted on the bottom surface of the composite human interface device, a part of the folded surface that is in contact with the ground surface may be provided with an inclined surface 1342 so that an area contacting with the ground surface can be widened.

The slope of the composite human interface device desired by the user can be adjusted by the number of times of folding of the multipurpose cover 1322.

The multi-purpose lid may have a built-in rechargeable battery 1323 inside the lid.

The power source of the rechargeable battery 1323 may be located in a part of a region protruding from the portion covering the text input area covering the text input area of the lower end of the multipurpose cover 1331, If the cover covers the text input device (1310), it is connected to the electrode provided at the upper end of the composite human interface device.

Also, when the multipurpose lid is folded and mounted on the lower end to adjust the inclination of the composite human interface device, it can be connected to the electrode provided on the bottom surface of the composite human interface device.

The composite human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multipurpose lid or separately charge the multipurpose lid.

At this time, the bottom surface of the composite human interface device has a region 1332 covering a protruding edge area where the electrode 1331 is located and a text input area having a height difference, and a magnet or a physical coupling device And a groove into which the cover is inserted.

The rim of the multi-purpose lid is coated with a substance that can remove minute dust, oil, and moisture, and can remove foreign substances from the absorption plate, the reflector, the optical emitter, and the front surface of the camera have.

If the versatile cover covers the text input area, it can detect the text input area and turn off the power of the composite human interface device.

When the multipurpose lid is mounted on the underside of the composite human interface device, the composite human interface device can be powered on.

Also, if there is no input by the user for a certain period of time after the power is turned on, the power can be cut off or the apparatus can be switched to the standby mode.

When the multi-purpose cover covers the text input area (1310), the composite human interface device 1321 has a substantially rectangular plate-like rectangular shape. When the multi-purpose cover is placed on the ground, it is designed not to have a slope, And can increase portability.

On the other hand, if the multipurpose cover is folded and mounted on the bottom of a composite human interface device, the inclination can be secured like a general keyboard.

The multipurpose lid can be constructed in a removable manner, but it can be designed in such a way that it is folded down from the upper surface to the lower surface of the composite human interface device by the hinge.

8 is an embodiment of a human interface device applied to a portable notebook.

The human interface device 1420 of the present invention can be utilized as an input device of a portable notebook computer.

The portable notebook having the human interface apparatus of the present invention is constructed such that the display unit composed of the display panel 1411 and the frame 1410 supporting the display panel is bound by the hinge 1427 and the human interface device of the present invention, It can be designed as a high-opening structure.

At this time, the display unit is inserted into the wall formed by the reflection plate or absorbing plate 1424 of the human interface device of the present invention. Thus, the thickness of the portable notebook using the human interface device of the present invention can be minimized.

To this end, the display unit of the portable notebook should be designed to have a width smaller than the width of the human interface apparatus 1420 of the present invention by at least twice the thickness of the reflector or absorbing plates 1423 and 1424.

In other words, in Fig. 13, the display unit must be designed so that the multipurpose cover can be inserted into the place.

The display unit has a feature 1413 that allows both corners to be rounded or cut into oblique lines.

The pointer position information input devices 1421 and 1422 are characterized in that when the display unit is folded, the pointer position information input devices 1421 and 1422 are positioned toward the outer edge of the rounded or obliquely cut portion.

This is to collapse the portable notebook so as to maintain a thin thickness without being disturbed by the pointer position information input devices 1421 and 1422 when the portable notebook is folded.

At this time, the mode switching unit and the pointer execution command unit may be located outside the side of the human interface apparatus.

(1425, 1426), and more preferably, can be located outside the text input area.

At this time, it is preferable that the mode switching unit and the pointer execution command unit are integrally formed as shown in FIG. 12, but they may be separately disposed.

In this case, when the mode switching unit or the pointer execution command unit is located outside the text input area, when the user places a finger to control the mode dial unit or the pointer execution command unit, the pointer position information input devices 1421 and 1422 input The pointer position information input area must be set excluding the area where the mode switching unit or the pointer execution command unit is located so as not to malfunction by inputting the position information of the pointer.

For this purpose, it is possible to design an optical signal to be prevented from reaching the mode switching unit or the pointer execution command unit by adjusting an area covered by the optical signal generated from the pointer position information input device.

Or an optical signal receiving angle of the camera is adjusted so that the camera does not receive an optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode switching unit or the pointer execution command unit, The optical signal can be ignored.

The portable notebook is designed to have at least three corners of an absorbing plate or a reflecting plate for absorbing or reflecting a light source generated from the pointer position information input device.

At this time, the two faces are located on the side of the human interface device (1423, 1424), and the other face is on the face where the display unit is in contact with the human interface device, the pointer position information input device 1421 , 1422 are placed in a certain region 1412 such that the light source generated by the light source

9 is an example in which the lower position pointer type position information input device and the lower position type pointer execution command portion are applied.

The human interface apparatus includes a text input unit 1501 including a plurality of physical buttons, a pointer position information input unit for inputting information related to the pointer position from a user, a pointer for inputting a user command to perform at least one function, A pointer execution command receiving unit for receiving a signal of the execution command units 1505 and 1506, a mode switching command receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode, A pointer position information input unit for transmitting pointer information to a digital device connected to the human interface device through a wired or wireless connection; and a pointer position information input area for inputting pointer position information of at least a part of a text input area of the text input unit, Of And the pointer position information input unit may include optical signal reflectors or absorbers 1503a, 1503b, and 1503c formed on the first to third surfaces 1502a, 1502b, and 1502c that are higher than the height of the text input unit, And the fourth surface 1502d surrounding the texting input unit is formed to be lower than the height of the first to third surfaces and the fourth surface may include the pointer execution command units 1505 and 1506 The first surface and the third surface may be located on the left and right sides of the text input unit, the second surface may be on the upper side of the text input unit, and the fourth surface may be on the lower side of the text input unit.

The pointer location information input unit may include at least two sensor modules, and the two sensor modules may be located at a lower left corner and a lower right corner of the text input unit, respectively.

The mode switching unit may be operated by a first input of a user inputting a first button and the pointer execution command receiving unit may be operated by a second input of a user inputting to the first button.

The first button may be formed of a material capable of detecting an electrical signal generated by a finger touch, and the first input may be generated by recognizing the electrical signal.

The pointer position information input mode is released while the first input is released and the first input is generated by the physical pressure when the first input is released.

The mode switching unit may be operated by a second input of the user inputting to the second button, and when the second input is inputted once, it is activated when the pointer position information input mode is released and the pointer position information input mode If it is activated, it can be released.

At this time, it is preferable that the light source and the image receiving device generated by the pointer position information input devices 1421 and 1422 are directed toward the center of the keyboard.

However, in order to secure a pointer position information input area of a small size or a wider area of the keyboard, it is preferable that the absorption plate or the reflection plates 1423 and 1424 located on the side of the human interface device are used as reflective plates other than absorption plates, The light sources of the input devices 1421 and 1422 and the image receiving device may be disposed to face the reflectors 1423 and 1424.

That is, the pointer position information input device 1421 can receive the pointer position information reflected by the reflection plate 1423 and received.

In addition, the parallax interleaved position information input device 1422 can receive pointer position information reflected by the reflection plate 1424 and received.

Thus, it is possible to obtain the effect that the installation positions of the pointer position information input devices 1423 and 1424 are located on the left and right outside portions of the actual compound human interface device, thereby obtaining a wider mouse pointer position information input area.

At this time, the angle of the reflection plate can be set to be 1 degree to 15 degrees. In other words, the lower ends of the reflectors 1423 and 1424 can be made wider than the upper ends thereof.

In this case, the installation position of the pointer position information input devices 1423 and 1424 is located at the left and right outer portions of the actual compound human interface device, and at the same time, the pointer execution command input device located at the lower end of the keyboard You can get the effect of moving to the top of a certain distance.

Wherein the composite human interface device includes a reflector for reflecting a light source generated from the pointer position information input unit, wherein at least two pointer position information input units are provided on the left and right sides of the human interface device, The pointer position information input unit on the left side receives a light source which is installed on the left side reflecting unit and is input through the left side reflecting unit, and the pointer position information input unit on the right side is located on the right side And a light source that is installed toward the reflection portion and is input through the right reflection portion.

The left and right reflectors may not be parallel to each other and may extend toward the portion where the left and right pointer position information input portions are located.

The pointer location information input area may be divided into a first area and a second area. That is, for example, the pointer position information input signal input from the right hand is received from the first area, and the pointer position information input signal input from the left hand is received from the second area.

Generally, the multi-touch control determines a control command according to a later movement pattern of the plurality of touch input signals after receiving a plurality of touch input signals.

However, in the present embodiment, the first pointer position information input signal received from the first pointer position information input area can be used to determine the number of touch inputs.

The second pointer position information input signal received from the second pointer position information input area may be used to receive the movement signal of the touch input.

That is, for example, when the upper and lower sliding touch inputs are inputted with one finger of the right hand while the two-finger touch is held by the left hand, when the touch signal is inputted with two touch signals of general multi- Can be substituted. In general, when a sliding touch input is performed up and down with two touches on an Apple MacBook, an up and down scroll input of the Internet browser is performed. In this case, when a right-handed finger is tapped, since the left-hand touch input is two, it is possible to perform the same function as when tapping with two fingers.

As another example, when the left-handed sliding touch input is input with the right hand while holding the three-touch input with the left hand, this signal is replaced with the case where the three-touch touch input of the general multi- can do. In general, when a user performs a sliding touch input with three touches on an Apple MacBook, he / she performs functions such as flicking a full screen app or dragging with three fingers. In this case, when one finger of the right hand is tapped, the left hand performs three touch inputs, so that the same function as that of tapping with three fingers can be performed. Examples of the left hand and the right hand may be replaced with examples of the right hand and the left hand. The number of input signals for determining the number of touches is not limited to the above two and three, and includes one or four or five touches .

The information related to the pointer position received by the pointer position information input unit includes information related to the first pointer position for moving the pointer position and a second pointer for switching the human interface apparatus from the text input mode to the pointer position information input mode. And location-related information.

For example, when a pointer position information input signal having a predetermined threshold or more is generated in the text input mode, the mode can be switched to the pointer position information input mode.

10 is a configuration diagram of a composite function input button.

The multi-function input button includes a character input unit 303 for inputting at least one character in a human interface such as a keyboard, and a capacitance type for inputting pointing position information for a user's touch or 3D gesture input on the screen The physical touch pad 311 may be a button for configuring the pointing device-integrated text input device 310 configured together.

In the present embodiment, only the pointing position information input unit is explained using the electrostatic touch method. The mode switching unit of the complex human interface apparatus described using the pointing position information input unit in the optical system, the pointer execution command input unit, the special function key, The contents of the switching unit and the pointer execution command unit, the connection with the inside or the display unit, the battery built-in method using the cover unit and the angle control function of the human interface unit, the text character input area and the mouse pointing position information input area are applied .

The pointing device-integrated text input device 310 may include a plurality of compound function input buttons.

The multi-function input button includes a cover 1010 to which a user's finger is touched, an electronic part 1020 including a transmitter and a receiver for forming an electric field, a base part 1020 for protecting the electronic part, 1030 < / RTI >

The elastic portion may include an elastic body 1050, an upper support portion 1040, and a lower support portion 1060.

The upper support portion and the lower support portion may be formed in a cylindrical or angular polygonal tube shape. The upper support portion and the lower support portion may be moved through an elastic body, and the lower support portion may guide movement of the upper support portion.

The upper support part may be fixed to the cover part, the electronic part, and the base part.

The lower support portion may serve as a guide for the reciprocating movement of the upper support portion.

The upper support part and the lower support part connect the lower structure including the elastic part and the upper structure including the electro part to the pantograph structure and guide the movement of the upper structure.

The elastic body may be a resilient dome-shaped elastic material, a plate-shaped elastic material having a restoring force, an elastic material having a spring shape, or a plurality of magnets facing different polarities, or a combination thereof .

The elastic portion may receive the second pressure from the cover portion and move to a third height, and may be restored to the first height when the second pressure of the cover portion is released. Moving to the third height means that the position is moved physically, or the object is bent by the pressure, or the second pressure is detected due to software or the like.

When the first pressure is detected, a pointer execution command is generated, and when a second pressure is detected, an additional pointer execution command may be generated.

For example, a first pressure may indicate an execution command of the application where the pointer is located, and a second pressure may be used to perform additional options or preview of the application.

Wherein the electrical signals representing the input of the predetermined character generated through the switches of the first to fifth compound function input buttons are electrical signals representing the input of different characters, The change of the user's finger contact position or the contact position determined from the route received via the de-part may be for controlling the position of one pointer in a connected manner.

The human interface device may further include a mode switching unit for switching between a character input mode and a pointing position information input mode.

The mode switching unit may be operated by the multi-function input button, a separate physical switch unit, a touch switch unit, or a predetermined touch pattern.

Wherein the human interface device comprises a character input device configured by a plurality of combinations of a plurality of compound function input buttons capable of inputting one character and a pointing position information input device for continuously controlling one pointing input device on the plurality of compound function input buttons, Lt; / RTI >

The human interface device may include a mode switching unit and a pointer execution command unit separately from the plurality of multi function input buttons.

The mode switching unit and the pointer execution command unit are a single button composed of an electro and a switch capable of recognizing a user's touch, and after the mode is switched by touch, a pointer execution command is generated as a pressure signal without moving or releasing a finger .

The multi-function input button may include a light emitting portion 1070.

The light emitting unit may illuminate a character indicating a character input of the multi-function input button or illuminate a position of the multi-function input button itself.

The light emitting portion may be located on an upper structure including an electrode, or may be located on a lower structure including an elastic body.

The upper structure may include a cover portion, an electro portion, a base portion, and the like as a portion including the electro portion and moving by the pressure of the user.

The lower structure may be a portion that does not move when the pressure of the user including the structure for guiding movement of the upper structure and transmitting or receiving an electrical signal to the electronic portion is applied.

11 is an example of the electronic of the compound function input button.

The electrostatic touching type electrodevice is composed of a plurality of transmitters and receivers.

In the case of the general electrostatic touch method, the electro-parts constitute a quadrangle of a certain size with a grid of 5 to 30 rows of transmitter parts and 5 to 30 rows of receiver parts.

In this embodiment, the multi-function input button may be composed of an electronic part having one character input button size generally having a width of 10 to 20 millimeters.

The electronic unit can be used as a pointing position information input device by independently configuring a small touch pad and can be used as a pointing position information input device having connectivity with a plurality of adjacent multiple function input buttons in a wider area.

The electronic part may be composed of one to three transmitters and receivers.

In this embodiment, the electronic part of one multi-function input button will be described as an example of a multi-function input button composed of three rows of transmitters having different drive signal periods and two rows of receivers having different scan periods.

Here, the period may mean a timing at which a signal is generated.

The number and shape of the transmitter and receiver according to the size and shape of the button include portions that can be easily modified by a person skilled in the art.

1102, 1103 with a first drive cycle and second transmitters 1104, 1105, 1106 with a second drive cycle, third transmitters 1107, 1108, 1109 with a third drive cycle, Lt; / RTI >

A first receiver 1110, 1111 having a first scan period, and a second receiver 1112, 1113 having a second scan period.

The first to third transmitters may be short-circuited to the circuit board or connected to one another without a separate connection member.

The first and second receivers may be printed on the circuit board in a state where they are short-circuited to each other, connected by a separate connecting member, or independently configured to scan electrical signals such as capacitance in the same scan period.

The electronic part in this embodiment is configured such that a plurality of electronic parts formed on a plurality of composite function input buttons are recognized as one large area of the electronic part, Particular design is required.

For example, the width of the second transmitter may be wider than the sum of the widths of the first and third transmitters.

The combined width of the first to third transmitters may be narrower than the sum of the widths of the first and second receivers.

In the case of a general capacitive touchpad, receivers having one scan period are interconnected. However, in this embodiment, the first receiver having one scan period is constituted by at least two receiver blocks 1110 and 1111, and the at least two receiver blocks are short-circuited, can do.

The scan signals can be signal-processed by summing the capacitance signals received from the respective receiver blocks.

In this embodiment, the transmitter is horizontally and the receiver is longitudinal, but the receiver can be arranged horizontally and the transmitter vertically arranged on the same structure.

The transmitter and receiver may be electrically shorted to the insulators 1114, 1115.

The electronic unit may include a bridge 1120 for sending and receiving an external drive signal and a scan signal that are stacked or connected downward.

The bridge may transmit a drift signal to the electronic part and receive a capacitance signal from the receiver.

12 is an embodiment of a multiple function input button arrangement.

In this embodiment, a composite human interface device composed of a plurality of composite function input buttons may include at least five composite function input buttons.

The second composite function input button 1220 and the third composite function input button 1230 are located on the left and right sides of the first composite function input button 1210 and the center point of the second composite function input button is located in the first composite And a center point of the third complex function input button is arranged on an imaginary X-axis extending from the center point of the function input button to the left and right, As shown in FIG.

A fourth composite function input button 1240 and a fifth composite function input button 1250. The center point of the fourth composite function input button includes a virtual Y extending from the center point of the first composite function input button And a center point of the fifth compound function input button is located on the right side from a virtual Y axis extending from the center point of the second compound function input button and extending upward from the center point of the second compound function input button, And the fourth and fifth composite function input buttons are located on the right side from the extended imaginary Y axis and on the left side from the imaginary Y axis extending downward from the center point of the third composite function input button, And can be positioned adjacent to the input button.

The distance that the center point of the fourth complex function input button is spaced to the left from the imaginary Y axis extending upward from the center point of the first complex function input button may be determined by the center point of the fifth complex function input button, Axis may be shorter than the distance spaced to the right from the imaginary Y-axis extending downward from the center point of the button.

For example, in the case of the fifth multifunctional input button, the first multifunctional input button may be shifted from the Y axis to the right by 40 to 60 percent of the length of the width of the first multifunctional input button.

In the case of the fourth multi-function input button, the first multi-function input button may be shifted from the Y-axis to the left by 15 to 35 percent of the length of the width of the first multi-function input button.

The first transmitter of the first through third composite function input buttons may have the same drive signal period as the third transmitter of the fourth composite function input button.

The second receiver of the first multi-function input button may have the same scan period as the first receiver of the fifth multi-function input button.

The first receiver of the first multi-function input button and the second receiver of the fifth multi-function input button may have different scan periods.

Wherein the second receiver of the first multi-function input button and the second receiver of the fourth multi-function input button are arranged in the virtual Y-axis direction and are arranged leftward The second receiver of the first complex function input button and the second receiver of the fourth complex function input button may have the same scan period.

Distortion of the pointing position information signal may occur, and it may be necessary to further correct by software.

The human interface device further includes a sixth complex function input button 1560 and the center point of the sixth complex function input button is located on a virtual Y axis extending downward from the center point of the fifth complex function input button Wherein the human interface device comprises:

Fig. 13 is an embodiment of the electronic arrangement of different patterns of the multiple function input buttons.

The first composite button input button and the fourth composite button input button may be located on the imaginary Y axis and not shifted in a line and shifted to the left by a first distance.

This may cause signal distortion of the receiver of the first composite button input button and the fourth composite button input button.

In order to prevent this or minimize the distortion, the pattern of the fourth composite button input button may be modified and designed.

For example, the pattern of the first distance from the left side of the electrode 1130 shown in FIG. 11 may be composed of the second electro-shape 1350 moved to the right side of the electrode have.

 The second electrode shape has an effect of aligning the receivers of the first and second composite function input buttons with a virtual Y-axis.

The seventh compound function input button 1360 configured in the second electro configuration may be positioned to the right of the fourth compound function input button.

At this time, the scan period of the receiver 1351 located at the far right of the fourth multi-function input button may be the same as the scan period of the receiver 1361 located at the leftmost of the seventh multi-function input button. At this time, the second receivers 1112 and 1113 of the first complex function input button may also have the same scan period.

14 is an embodiment of an electrical connecting member of the compound function input button.

The transmitters of the first, second and third complex function input buttons may be connected to one another by a first electrical connection member and the receivers of the first, fourth and fifth complex function input buttons may be connected to each other by a second electrical connection member have.

In the first embodiment of the connecting member, the connecting member may include a first conductor which is in contact with or joined to the electro-part while moving from the first height to the second height by virtue of pressure applied to the multi-function input button, A second conductor provided on an unmoving part of the function input button to receive an electrical signal from the first conductor, and a base PCB connected to the second conductor of the adjacent multi-function input button have.

The base PC may simultaneously transmit and receive a drive signal or a scan signal from a control unit to a transmitter or a receiver of a plurality of composite function input buttons.

The first conductor and the second conductor may move in a sliding manner while maintaining the connection.

The first conductor and the second conductor maintain contact when no pressure is applied to the multi-function input button or when the pressure is lower than a predetermined threshold, and the pressure is applied to the predetermined conductor It can be a structure that maintains contact and is short-circuited.

The first conductor and the second conductor may be formed in a non-contact manner (1450). The first conductor and the second conductor may be provided in the form of a conductive plate having a predetermined area so as to be in contact with each other at regular intervals.

The predetermined interval may be filled with a nonconductive material 1443 having a dielectric constant such as air, plastic, silicon, glass, or scrap.

In this case, the electrical signal can carry an electrical signal in the form of a radio signal having a frequency.

By doing so, it is possible to reduce the occurrence of wear of the conductor or noise due to friction between the first conductor and the second conductor, minimize the occurrence of friction which interferes with the pressure applied to the multi-function input button, There is an advantage that the process is simplified.

At least one of the first and second electrical connection members may be a printed conductor with the electronic part on the flexible film or may be an electrical connection member provided in the elastic part in close contact with or joined to the electronic part.

15 is an embodiment of a switch for inputting characters of a multi-function input button.

Switches 1511, 1512, and 1513 that generate an electrical signal indicative of an input of a predetermined character when the pressure is applied to the multi-function input button and move from the first position to the second position.

When the switches 1512 and 1523 located on the base PCB or the separately provided membrane are connected by a terminal 1511 located on the moving part of the multi function input button, an electrical signal for indicating a predetermined character input To the control unit.

The switch can detect and generate a separate push switch, magnetic or electric field change, light intensity, sound, and the like.

16 is an example of a human interface device having a complex function input button.

17 is an embodiment of an electronic keycap.

A plurality of the electro keypads 1700 may be positioned on one plane of the cavity to form the electro keycap layer 1620. [

For example, one electro-keycap accepts one character input according to the mode and can detect a certain amount of change in the touch position.

On the other hand, the electro keypad layer can accept a plurality of character inputs, and can detect the amount of touch position change in proportion to the number of the electro key caps.

The hybridizable human interface device includes a control unit, a cover unit 1010 in which a user's finger is contacted, an electronic keycap including first conductors 1741, 1742, 1713, 1714, 1746, and 1748 and the electronic parts 1020 and 1701, A second conductor 1700, and a second conductor.

The second conductor may be included in the first circuit layer 1630.

When the user's finger is brought into contact with the cover portion closely attached to the upper end of the electro key cap, the electrostatic capacity is changed by affecting the electric field between the transmitter and the receiver provided in the electro.

A plurality of the first conductors may be provided, and the first conductors may be respectively provided to the transmitter and the receiver of the electronic part.

When a drive signal is applied at a predetermined signal period through the first conductor connected to the transmitter, a capacitance is formed between the transmitter and the receiver, and the generated capacitance is connected to the receiver by the receiver Is transmitted through the first conductor to the second conductor electrically connected to the first conductor, and the controller senses the change in the transmitted capacitance.

Wherein the electronic portion is electrically connected to the second conductor through the first conductor, the electronic portion is located on a first surface (1702) of the electronic keycap and the first conductor is electrically connected to the first surface And an area defined by the column formed perpendicularly to the column.

At least two columns formed perpendicularly to the first surface may be formed, and the first conductor may be formed on each of the at least two columns.

The electronic parts 1020 and 1701 may include a transmitter and a receiver, and the first conductors formed respectively on the at least two columns may be electrically connected to the transmitter and the receiver, respectively.

The first conductor may be formed to surround the surface of the column.

The column may be in the shape of a tube with a hole (1703) through the column, the hole passing through the first surface (1702) and through the inner wall of the hole, the electronic part and the first conductor And can be electrically connected.

The electronic part has a plurality of pattern blocks 1701 having a specific shape on the first surface and at least a part of the pattern blocks may be electrically connected to each other through the second surface 1731 of the electro keypads.

The plurality of pattern blocks 1704 electrically connected through the second surface may be electrically connected to the second conductor through a first conductor 1713 formed on one column.

For example, three top triangular pattern blocks on the first side 1702 may be electrically connected due to the conductors provided on the sides 1731 adjacent to the triangular pattern block.

In the same manner, three of the lowermost triangular pattern blocks may be electrically connected to each other by three conductors provided on adjacent sides of the three lowermost triangular pattern blocks.

At this time, a new one of the uppermost or lowermost triangular pattern blocks may be electrically connected through a hole provided in one of the columns provided on the back surface and the prong column.

In addition, the triangular, rhombic, and triangular pattern blocks in the middle are electrically connected at the first surface and electrically connected to the first conductor through a hole in the column and a column at the back surface And the pillars used here can be used simultaneously for the purpose of being located at the center of the back surface and transmitting pressure to the elastic portion.

At this time, the pattern blocks provided at the uppermost stage, the lowermost stage and the middle stage may transmit transmitter signals and may have different signal periods.

In addition, two rhombic pattern blocks arranged horizontally at the upper end and two rhombic pattern blocks arranged horizontally at the lower end are electrically isolated from the first surface, Lt; RTI ID = 0.0 > electrically < / RTI >

The first conductor may be provided on a plurality of pillars on the back surface of the electronic keycap.

The plurality of pattern blocks electrically connected through the second surface may be transmitters having the same signal period.

The electronic part has at least three pattern blocks 1704 having a specific shape on the first surface and the three pattern blocks are electrically connected to the second conductor through a first conductor formed on one of the pillars .

At least two of the plurality of pattern blocks may have a first signal period and at least one pattern block may have a second signal period.

The at least three pattern blocks may be receivers.

The composite human interface device further includes an elastic portion 1050, the column transmits pressure of the user applied to the cover portion to the elastic portion, and the position of the cover portion and the electro keycap is changed from a first position to a second position, And when the pressure of the user is released, the cover portion and the electronic keycap can be restored from the second position to the first position by receiving pressure from the elastic portion.

The electronic part and the first conductor may be formed by plating a conductive material on at least one flat plate and a non-conductive material formed of at least two columns connected to the flat plate and having holes penetrating the flat plate and the column.

The electronic part may have a plurality of pattern blocks having a specific shape on the first surface and a plurality of pillars may be formed on a third surface 1710 located on the back surface of the first surface.

The first conductor may be formed on the plurality of pillars, and the first conductor formed on the plurality of pillars may be electrically short-circuited by the third surface.

Wherein the electronic part has a plurality of pattern blocks having a specific shape on the first surface and the plurality of pattern blocks are electrically connected to a fourth surface 1732 located on one side of the first surface, The plurality of pattern blocks may be electrically short-circuited to each other by an electrical short 1733 formed in the pattern block 1733. [

The pattern block is not limited to the example illustrated in the drawings, but may also include various patterns such as a rectangle, a comb or the like.

Wherein the composite human interface device comprises a plurality of the electro keypads and the first conductor provided in the plurality of the electret keypasses transmits an electrical signal to the plurality of second conductors, May be configured in one first circuit layer 1630.

Wherein the human interface device further comprises a light source at a lower end of the electrocap, the column has a tubular shape having a hole penetrating the column, and the cover portion is made of a light guide plate material through which light is diffused, It can emit light by receiving light from a light source.

The hole may be essentially used to electrically connect the first conductor with the electronic portion of the electronic keycap in a plating manner.

However, when the plating is done, the electronic keycap becomes opaque and the keyboard keyboard emits light, making it difficult to give the function for convenience in the dark place.

However, the light source can be transmitted through the hole, so that the hole can be used as a path for the electrical connection path and the light source.

The cover portion may have a printed or stamped character for guiding the text input on the face where the user touches, or a film with a perforated hole in the shape of the character.

The first conductor and the second conductor face each other in a non-contact manner and a high frequency electric signal can be transmitted through the predetermined area in a non-contact manner.

For example, when the column has a cylindrical shape, the surface facing the first conductor and the second conductor in a non-contact manner may have a band shape having a constant width. When the column is a rectangular column, It can be a square band with a square. Alternatively, the first conductor may be provided only in a part of the column to provide a facing part having a desired shape and area.

18 to 22 illustrate an example of an electronic pattern of a plurality of compound function input buttons.

The composite human interface device can be used in various electronic devices such as a desktop input device, a tablet PC input device, a notebook input device, a home theater control input device, an automatic driving vehicle multimedia control input device, a virtual reality or augmented reality input device.

The electronic device having the composite human interface may include first through fifth composite function input buttons.

The first to fifth compound function input buttons may receive different character input and may receive a touch input for controlling one pointer position information from the user.

The first through fifth composite function input buttons may be positioned in the X axis or the Y axis, respectively, without being aligned in a line.

For example, the first to third composite function input buttons may be aligned in the X-axis direction, and the fourth to fifth composite function input buttons may be located at the upper and lower sides of the X-axis, respectively.

Also, the fourth multi-function input button 1240 may not be aligned with respect to the Y-axis with respect to the first multi-function input button, but may be positioned about 25 percent away from the left.

The fifth multifunctional input button 1250 may not be aligned with the first multifunctional input button with respect to the Y axis but may be positioned about 50 percent away from the right.

In order for the first to fifth composite function input buttons to control one pointer position information, the plurality of transmitters and the plurality of receivers must be aligned in a line between transmitters having the same drive signal, They must be aligned in a line.

On the other hand, since the first to fifth compound function input buttons are not aligned in line with respect to the X axis or the Y axis, the compound function input button has a receiver or a transmitter parallel to two to four X axis Y axis, The receiver or transmitter can be aligned even though the function input buttons are not aligned in line with respect to the X or Y axis.

Each of the composite function input buttons includes an electronic part 1020a, 1020b, 1020c, 1020d, 1020e, 1020f, 1020g, 1020a, 1020b, 1040a, 1020h, 1020i, 1020j, 1020k, and 1020l.

The electronic part may include a transmitter and a resister such that the transmitter is parallel to the X axis. (1020a, 1020c, 1020e, 1020g, 1020i, 1020k)

Next, in the above-described embodiments, the above-described electro-optic portion basically describes the case of a transmitter parallel to the X-axis and a receiver parallel to the Y-axis. However, the configuration in which the transmitter and the receiver are changed, The same configuration is possible for parallel receivers and transmitters parallel to the Y-axis.

The electronic part may include a transmitter and a resister such that it is parallel to the X axis. (1020b, 1020d, 1020f, 1020h, 1020j, 1020l)

18 shows an example of an electronic pattern of a plurality of compound function input buttons, wherein the electronic part may include four transmitters and four receivers.

In the embodiment to be described in the following, it is described based on an embodiment composed of four transmitters parallel to the X axis and four receivers 1020a parallel to the Y axis, but four receivers parallel to the X axis and parallel to the Y axis The same description can be applied to one of the four transmitters 1020b.

The transmitter unit may have first to fourth transmitters having at least two driver signal periods, and the receiver unit may have first to fourth receivers (R1, R2, R3, R4) having at least two different scan signal periods.

The first receiver of the fourth complex function input button 1240 may have the same scan signal period as the fourth receiver of the second complex function input button 1220. [

The second receiver of the fourth complex function input button 1240 may have the same scan signal period as the first receiver of the first complex function input button.

The third receiver of the fourth composite function input button may have the same scan signal period as the second receiver of the first composite function input button.

The fourth receiver of the fourth complex function input button may have the same scan signal period as the third receiver of the first complex function input button and the first receiver of the fifth complex function input button 1250 .

The electronic device having the composite human interface has a sixth multi-function input button 1260, and the sixth multi-function input button is adjacent to and aligned with the fifth multi-function input button in the Y- The first to fourth receivers of the multi-function input button may have the same scan signal period as the first to fourth receivers of the fifth multi-function input button, respectively.

On the other hand, the fifth compound function input button and the sixth compound function input button may have different driver signal periods.

The electronic device having the composite human interface may have a seventh composite function input button 1270.

The first receiver of the seventh multifunctional input button may have the same scan signal period as the fourth receiver of the first multifunctional input button and the second receiver of the fifth multifunctional input button.

The second receiver of the seventh multifunctional input button may have the same scan signal period as the first receiver of the third multifunctional input button and the third receiver of the fifth multifunctional input button.

The first transmitter of the first through third composite function input buttons may have a first driver cycle and the second transmitter of the first through third composite function input buttons may have a second driver cycle.

Wherein the first multi-function input button and the first multi-function input button have a third driver cycle, and the fourth multi-function input button and the seventh multi- May have a fourth driver period.

The first transmitter of the fifth composite function input button may have a fifth driver period and the second transmitter of the fifth composite function input button may have a sixth driver period.

The first transmitter of the sixth composite function input button may have a seventh driver period and the second transmitter of the sixth composite function input button may have an eighth driver period.

Wherein at least two of the first to fifth composite function input buttons have the same scan signal cycle as the first to the second receivers and the same scan signal cycle as the third to fourth receivers, ,

Wherein at least two of the first to fifth composite function input buttons have the same scan signal cycle as the second to the third receivers, respectively, and the first and fourth receivers have different scan signal cycles Lt; / RTI >

For example, the first to second receivers of the first complex function input button have a first scan signal period, the third to fourth receivers have a second scan signal period,

Wherein the first to second receivers of the third complex function input button have a third scan signal period and the third to fourth receivers have a fourth scan signal period,

 Wherein the first receiver of the fourth complex function input button has a fifth scan signal period, the second through third receivers have the first scan signal period, and the fourth receiver has a second scan signal period have.

Wherein the first receiver of the seventh compound function input button has a second scan signal period, the second through third receivers have the third scan signal period, and the fourth receiver has a fourth scan signal period have.

19 shows an example of an electronic pattern of a plurality of compound function input buttons. The electronic part may include two transmitters parallel to the X axis and four receivers 1020c parallel to the Y axis.

In the embodiment to be described hereinafter, an example is described in which two transmitters parallel to the X axis and four receivers parallel to the Y axis are described, but two receivers parallel to the X axis and four transmitters 1020d parallel to the Y axis ) Can be similarly explained.

The electronic device having the composite human interface may include first to fifth composite function input buttons, and each of the composite function input buttons may include an electronic unit including a transmitter unit and a receiver unit.

The transmitter unit may have first and second transmitters having different driver signal periods, and the receiver unit may have first and second receivers having different scan signal periods.

Wherein the second receiver of the first complex function input button has the same scan signal period as the first receiver of the fifth complex function input button and the first receiver of the third complex function input button is the same as the first receiver of the fifth complex function input button, It may have the same scan signal period as the second receiver of the input button.

Wherein the first transmitter of the first through third composite function input buttons has a first driver signal period and the second transmitter of the first through third composite function input buttons has a second driver signal period, Wherein the first transmitter of the function input button has a third driver signal period, the second transmitter of the fourth multi-function input button has a fourth driver signal period, and the first transmitter of the fifth multi- Driver signal period and the second transmitter of the fifth complex function input button may have a sixth driver signal period.

Wherein the center points of the first to third complex function input buttons are on a virtual X axis and the first to second transmitters of the first to fifth complex function input buttons are substantially parallel to the virtual X axis, The first receiver and the second receiver of the first through fifth composite function input buttons may be located substantially orthogonal to the imaginary X axis.

The second receiver of the first complex function input button and the first receiver of the fifth complex function and the second receiver of the fourth complex function input button may have the same scan signal period.

Alternatively, the first receiver of the first composite function input button and the first receiver of the fifth composite function, and the first receiver of the seventh composite function input button may have the same scan signal period.

The second receiver of the first complex function input button and the first receiver of the fifth complex function are aligned in a line orthogonal to the X axis and the second receiver of the fourth complex function input button and the seventh composite And may be spaced apart by a first distance 2010 between the first receivers of the function input buttons.

This may be necessary to unify the pattern to reduce the manufacturing cost of the multi-function input button. At this time, it may be necessary to calibrate the user's touch input in a software manner.

When the user's touch is input continuously from the first multi-function input button to the fourth multi-function input button and orthogonal to the X-axis, the coordinate of the input touch of the user corresponds to the first distance in the X- And a control unit for correcting the image.

The first to fifth compound function input buttons may include a control unit for continuously controlling the position of one pointer by sensing a touch of a user continuously input in a region including the surfaces of the first to fifth compound function input buttons .

The first to fifth compound function input buttons may include a controller for sensing a user's pressure signal and generating first to fifth character input signals, respectively.

That is, each of the plurality of composite function input buttons takes charge of one key of the keyboard and generates one character, and at the same time, consecutively occurs between the buttons and the buttons within the touch surface area of the adjacent plurality of composite function input buttons The pointer position information such as one mouse pointer can be generated by the touch input of the user and the position movement of the pointer can be controlled.

When a plurality of touches are simultaneously performed within the touch surface area of the adjacent multiple function input buttons, the multi-touch function, i.e., zoom in, zoom out, scroll, screen change, and the like can be performed.

In the case of the electronic device 1020h having the receiver parallel to the X axis and the transmitter parallel to the Y axis, the electronic device equipped with the composite human interface device is composed of first through fifth composite function input buttons And each of the multiple function input buttons comprises an electronic part including a transmitter part and a receiver part, wherein the transmitter part has first and second transmitters each having a different driver signal period, and the receiver part has a first To 2 receivers.

The second transmitter of the first complex function input button has the same drive signal period as the first transmitter of the fifth complex function input button and the first transmitter of the third complex function input button has the same drive signal period as the first composite transmitter And may have the same drive signal period as the second transmitter of the input button.

Wherein the first receiver of the first through third composite function input buttons has a first scan signal cycle and the second receiver of the first through third composite function input buttons has a second scan signal cycle, Wherein the first receiver of the function input button has a third scan signal period, the second receiver of the fourth multi-function input button has a fourth scan signal period, and the first receiver of the fifth multi- Scan signal period, and the second receiver of the fifth multifunction input button may have a sixth scan signal period.

Wherein the center points of the first to third complex function input buttons are on a virtual X axis and the first to second receivers of the first to fifth complex function input buttons are substantially parallel to the virtual X axis, The first to second transmitters of the one to five complex function input buttons may be located substantially orthogonal to the imaginary X-axis.

The second transmitter of the first complex function input button and the first transmitter of the fifth complex function are aligned in a line orthogonal to the X axis and the second transmitter of the fourth complex function input button and the seventh composite And may be located between the first transmitters of the function input buttons.

23 is a flowchart showing a method of switching between a text input mode and a pointer position information input mode.

The electronic device having the composite human interface may be provided with a right-handed mode and a left-handed mode.

In the right-handed mode, a touch area may be set so that a user's touch input can be easily input from a user's right hand.

In the left-handed mode, the touch area may be set so that the touch input of the user can be easily input from the left hand of the user.

The right-handed mode and the left-handed mode include a separate switch on the electronic device equipped with the composite human interface device, at least two simultaneous text inputs, a predefined touch pattern, a combination of text input and touch input, And the like.

The first pointer execution command button and the second pointer execution command button are operated by the pressure of the user, and the first pointer execution command button and the second pointer execution command button are operated by the pressure of the user, The electronic device according to claim 1, further comprising a sensor capable of sensing a touch input of a user. When a touch input is received on the first pointer execution command button and the second pointer execution command button, . ≪ / RTI >

In the temporary touch mode, when the user's touch is released to the first pointer execution command button or the second pointer execution command button, the temporary touch mode is canceled and the mode is switched to the text input mode.

The first pointer execution command button may be located on the left side of the second pointer execution command button and may be adjacent to the left hand thumb of the user and the second pointer execution command button may be adjacent to the right thumb of the user.

When switching to the temporary touch mode through a touch sensor provided on the first pointer execution command button, the electronic device having the composite human interface can be switched to the right-handed mode.

In the case of the right-handed mode, the right-handed touch area 108b for receiving pointer position information can be set to facilitate touch input with the right hand.

 The right-handed touch area 108b can be set except the area where the user's left hand puts a finger for text input.

For example, in the case of a composite human interface of a general keyboard type, the left side of the Y axis including the text F key may be set as the touch inactive area, and the right side of the Y axis including the text G key as the touch activation area.

When switching to the temporary touch mode through the touch sensor provided on the second pointer execution command button, the electronic device having the composite human interface can be switched to the left hand mode.

In the left-handed mode, the left-handed touch area 108a for receiving the pointer position information can be set so that the left-handed touch input is easy.

 The left-handed touch area 108a can be set except the area where the user's right hand puts a finger for text input.

For example, in the case of a composite human interface of a general keyboard type, the right side of the Y axis including the text J key can be set as the touch inactive area, and the left side of the Y axis including the text H key can be set as the touch activation area.

In addition, the left or right hand mode can be preset in an external device connected to the electronic device having the composite human interface.

The temporary touch mode is a mode in which when the user's touch input is simultaneously generated from at least two of the plurality of compound function input buttons for generating text input signals of characters Q, W, E, and R in the US international keyboard layout, Mode, and when the at least two user touch inputs are released, the right-handed touch mode is canceled and the mode is switched to the text input mode.

Wherein the temporary touch mode is a mode in which when a user's touch input is simultaneously generated from at least two of the plurality of compound function input buttons for generating a text input signal of Z, X, C, V in a character US International keyboard layout, Mode, and when the at least two user touch inputs are released, the right-handed touch mode is canceled and the mode is switched to the text input mode.

 The temporary touch mode is a mode in which when a user's touch input is simultaneously generated from at least two of the plurality of compound function input buttons for generating text input signals of characters U, I, O, and P in the US international keyboard layout, Mode, and when the at least two user-touch inputs are released, the left-handed touch mode is canceled and the user can switch to the text input mode.

 The temporary touch mode includes the letters M, <,>,? Wherein when at least two of the plurality of compound function input buttons for generating a text input signal simultaneously input a touch of a user, the mode is switched to the left hand touch mode, and when the at least two user touch inputs are released, And switch to the text input mode.

The multi-function input button, in which the at least two touch inputs are generated at the same time, includes a first pointer execute command input of a pointer controlled during execution of the temporary touch mode or a second pointer execute command input of a second pointer execute command when a pressure signal is further received, It can function as a pointer execution command input.

When the temporary touch mode is activated, the text input mode may be deactivated.

If the text input mode is disabled, at least one text entry may be allowed to be enabled.

24 is a flowchart showing a method for switching the permanent touch mode.

When the first pointer execution command button and the second pointer execution command button are simultaneously pressed for a preset time, the electronic apparatus having the composite human interface apparatus can be set to the permanent touch mode.

The electronic device equipped with the composite human interface may be provided with a separate switch, at least two simultaneous text inputs, a predefined touch pattern, a combination of text input and touch input, The device can be set to the permanent touch mode.

The permanent touch mode is a mode in which a pointer position information input of the user can be received without having to maintain a separate user input for inputting the pointer position information.

For example, in the temporary touch mode, the electronic device having the composite human interface is set to the text input mode, and while the input of another user is maintained, the electronic device is switched to the temporary touch mode, The temporary touch mode is canceled and the text input mode is switched to the text input mode.

On the other hand, in the permanent touch mode, the electronic device having the composite human interface is basically set to the permanent touch mode and the text input mode is inactivated.

The permanent touch mode may be released under predefined conditions.

For example, if the permanent touch mode is set and the user does not have a touch input for a predefined time, the permanent touch mode may be canceled.

When the permanent touch mode is set, a predefined touch pattern, an input of a predefined button, an input of an exceptional text input button, a repetitive text input, or a plurality of text inputs are simultaneously input The permanent touch mode can be canceled.

The permanent touch mode may include at least a part of the touch area in the right-handed touch mode and the touch area in the left-hand touch mode, and the touch area in the right- It can be wider than the touch area.

The touch area may be a combination of the touch area in the right-hand touch mode and the touch area in the left-hand touch mode.

25 is a multi-function input button module in which a plurality of multi-function input buttons are provided in a plate form.

The module having the plurality of composite function input buttons fabricated in the plate shape can be used as a composite keyboard module used in a notebook computer, a portable keyboard, a desktop keyboard, and an Internet TV input device.

The module includes a plurality of cover parts 1010, a plurality of electronic parts 1020, an electrical connecting member 2610, a plurality of base parts 1030, and a balance holding part 2620 for helping the cover part to move up and down in parallel ), And a plurality of elastic portions 1050.

26 is an example of the detailed structure of the electronic part 1020. Fig.

The plurality of electronic parts may be manufactured by printing (1020b) the transmitter part and the receiver part with the conductive ink on the film 1020a cut to fit the size of the cover part, or by a flexible printed circuit board (FPCB) method.

The electrical connecting member 2610 may be manufactured by the FPCB method, and may have a contact with at least one transmitter of the electronic part and at least one receiver.

The electrical connecting member 2610 and the electronic part 1020 may be joined with a conductive adhesive 2611 to allow electricity to flow through the contact.

The electrical connection member 2610 may be made of FPCB integrated with the electronic part.

Fig. 27 is an example of an adhesion site of a conductive adhesive.

The conductive adhesive may bond a part of the electrically connecting member and a part of the electronic part to each other.

At this time, the portion 2712 removed from the bonding portion may be a structure 2711 that can move in accordance with the movement of the cover portion while being connected to the electrical connecting member of the adjacent multi-function input button.

The fluidically movable electrical connecting member may be configured in the form of an alphabet capital letter U with an adjacent electrical connecting member in the form of an uppercase L letter.

In this case, when the cover portion moves up and down, the electrical connecting member exhibits the optimum performance to maintain the energized state while minimizing the physical resistance to the user even if the up and down positions are different from those of the adjacent multi function input button.

The electrical connecting member may be connected to the circuit layer located on the first and second surfaces while interconnecting the plurality of theelectrode portions.

The circuit layer 2613 located on the first surface generates a drive signal for transmitting a drive signal to the transmitters of the first through fifth composite function input buttons and the circuit layer 2612 located on the second surface transmits the drive signal to the first, 5 It is possible to receive the scan signal from the receiver of the multi function input button.

The circuit layer may be connected to a controller to generate a drive signal and receive a scan signal.

28 is an embodiment of the compound function input button.

An expanded view of the composite function input button 2810, an assembled view of the composite function input button 2820, a section view 2830 of the composite function input button, and a cross section view 2840 of the composite function input button when the cover portion is moved.

The composite function input button includes a cover portion 2811, an electronic portion 2818, a first base portion 2812, a balance holding portion 2813, an elastic portion 1050, a first circuit layer 2816, A first circuit layer 2815, a third circuit layer 2814, a second base portion 2803, and an electrical connecting member 2819.

The multi-function input button may further include a light emitting unit 2817, and the light emitting unit may be located in an electronic part or a circuit layer.

The electronic part, the electrical connecting member, and the circuit layer may be made of one FPCB.

The first circuit layer 2816 may receive both the pointer position information input signal and the text input signal.

The elastic portion may be attached to the circuit layer. This eliminates unnecessary layers and allows thinner thicknesses.

The cover portion and the base portion may have binding members 2820 and 2821 so that they can be coupled to each other.

Alternatively, the cover and the base may be provided with a hole 2801 in the cover portion and may be connected to each other.

The electronic part is inserted between the cover part and the base part, and can be connected to the circuit layer through the electrical connecting member.

The circuit layer may be attached to the second base portion.

The circuit layer may be connected to an electrical connection member of one composite function input button, and may be connected to the control unit through a separate circuit layer.

The circuit layer may be connected to an electrical connection member of a plurality of compound function input buttons at the same time and connected to a control unit.

The width 2832 of the electronic part may be wider than the width 2831 of the circuit layer. Thus, when the position of the cover part is moved, the movement of the electrical connecting member can be minimized and the physical resistance to the user can be minimized.

The electrical connecting member 2819 may be made of a soft material so that the shape of the cover may be changed when the cover moves.

The electrical connecting member 2891 may be deformed while moving to a position 2843 lower than the second base portion when the cover portion moves.

29 is an embodiment of a wireless type electrical connecting member.

And a portion 2930 of the composite function input button except for the elastic portion and the balance holding portion of the composite function input button.

The composite function input button includes a cover portion 2902, an electronic portion 2901, first electrical connecting members 2903 and 2904, second electrical connecting members 2933 and 2934, a base portion 2932, a circuit layer 2931, &Lt; / RTI &gt;

The first electrical connecting member may be composed of an electrical connecting member 2903 connected to the transmitter and an electrical connecting member 2904 connected to the receiver.

The second electrical connecting member may be composed of an electrical connecting member 2933 corresponding to the electrical connecting member 2903 connected to the transmitter and an electrical connecting member 2934 corresponding to the electrical connecting member 2904 connected to the receiver.

The first electrical connecting member and the second electrical connecting member can transmit an electric signal wirelessly without being physically joined to each other.

The first electrical connecting member and the second electrical connecting member can transmit an electrical signal wirelessly using a high frequency signal.

The first electrical connecting member and the second electrical connecting member can transmit an electrical signal wirelessly using an electrostatic induction method.

The first electrical connecting member and the second electrical connecting member may be at least one of a coiled winding method (2940), a spiral method (2950), or a method of winding around a non-conducting material (2960).

An electronic device having a composite human interface comprises first to fifth compound function input buttons and a circuit layer for transmitting a signal received from the input button to a control unit, And a switch for generating a text input signal in response to a physical pressure of the user, wherein the transmitter unit includes a switch having a timing for generating different driver signals, Wherein the receiver section has 1 to 2 transmitters and the receiver section has first to second receivers having at least two different scan timings, wherein the electrical connecting member changes the relative position of the electronic layer and the circuit layer by the physical pressure of the user But also electrically connected You can rock.

The first receiver of the fourth composite function input button has the same scan timing as the second receiver of the second composite function input button and the second receiver of the fourth composite function input button has the same scan timing as the first composite function And may have the same scan timing as the first receiver of the input button.

Wherein the first transmitter of the first through third composite function input buttons has a first drive signal generation timing and the second transmitter of the first through third composite function input buttons has a second drive signal generation timing, The first drive signal generation timing and the second drive signal generation timing may be different from each other.

The second transmitter of the fourth multi-function input button has a third drive signal generation timing, the first transmitter of the fifth multi-function input button has a fourth drive signal generation timing, the third drive signal generation timing, The first drive signal generation timing, the second drive signal generation timing, and the fourth drive signal generation timing may be sequential.

The first receiver of the fifth composite function input button has the same scan timing as the second receiver of the first composite function input button and the second receiver of the fifth composite function input button has the same scan timing as the second composite receiver of the third composite function input button, And may have the same scan timing as the first receiver of the input button.

A composite human interface may be provided in which the circuit layer, the electronic part of the first complex function input button, and the electrical connection part of the first complex function input button are composed of one flexible printed circuit board (FPCB) .

Wherein the electronic connection member of the first to fifth composite function input buttons and the first to fifth composite function input buttons and the circuit layer are formed of a flexible printed circuit board (FPCB) A complex human interface may be provided.

Wherein the electrical connection member comprises a first lead connected to the electronic part and a second lead connected to the circuit layer, wherein the first lead and the second lead have relative positions when they are pressed by the user, As shown in FIG.

Wherein the electrical connection member comprises a first lead connected to the electronic part and a second lead connected to the circuit layer, wherein the first lead and the second lead change relative positions when there is a user's pressure signal, The first lead and the second lead are spaced apart from each other by a predetermined distance or more and can transmit an electrical signal by electromagnetic induction.

Wherein the electrical connection member comprises a first lead connected to the electronic part and a second lead connected to the circuit layer, wherein the first lead and the second lead change relative positions when there is a user's pressure signal, The first lead and the second lead are separated from each other by a predetermined distance or more and can transmit an electrical signal using a high frequency signal.

The electrical connecting member is made of an elastic material that electrically connects the electronic part and the circuit layer. When the position of the electronic part is moved by a pressure signal of the user, a force in a direction opposite to the pressure signal of the user And when the pressure signal of the user is removed, the electronic part can be returned to the pre-movement position.

Wherein the first receiver of the fourth composite function input button has the same scan timing as the first receiver of the first composite function input button and the second receiver of the fourth composite function input button has the same scan timing as the first composite function button. The second receiver of the input button and the first receiver of the fifth multifunctional input button may have the same scan timing.

The first transmitter of the fourth composite function input button has the same driver signal generation timing as the first transmitter of the first composite function input button and the second transmitter of the fourth composite function input button has the same The first transmitter of the first complex function input button and the first transmitter of the fifth complex function input button may have the same drive signal generation timing.

Wherein the first receiver of the first through third composite function input buttons has a first scan timing and the second receiver of the first through third composite function input buttons has a second scan timing, The timing and the second scan timing may be different from each other.

The second receiver of the fourth complex function input button has a third scan timing, the first receiver of the fifth complex function input button has a fourth scan timing, and the third scan timing and the first scan timing The second scan timing and the fourth scan timing may be sequential.

The first transmitter of the fourth composite function input button has the same driver signal generation timing as the second transmitter of the second composite function input button and the second transmitter of the fourth composite function input button has the same The same drive signal generation timing as the first transmitter of the first complex function input button can be obtained.

The first trammeter of the third complex function input button may have the same timing of generating a driver signal as the second transmitter of the fifth complex function input button.

The multi-function input button may further include a first control unit, and the control unit may process the touch signal and the text input signal received from the multi-function input button and transmit the processed touch signal and the text input signal to the second control unit.

The circuit layer may include a drive signal generator for transmitting a drive signal to the transmitters of the first to fifth composite function input buttons and a scan signal receiver for receiving a scan signal from a receiver of the first to fifth composite function input buttons. have.

Wherein the first to fifth composite function input buttons have a plurality of electrical connection members, the first composite function input button is connected to the electrical connection members of the second, third, fourth and fifth composite function input buttons, The second composite function input button is connected to the electrical connection member of the first and the fourth composite function input button and the third composite function input button is connected to the electrical connection member of the first composite function input button, The fourth composite function input button is connected to the electrical connection members of the first and second composite function input buttons and the fifth composite function input button is connected to the electrical connection members of the first and third composite function input buttons .

1 to 29 illustrate an example of a pointing device-integrated text input device as an electronic device having a complex human interface device to be described in the present invention, and the type of text input device pointing position information input device and the techniques used are described by those skilled in the art And includes the ability to change or replace without changing the basic purpose.

30 is an example of a configuration diagram of the pointing device-integrated text input device 3000. As shown in FIG.

Referring to FIG. 30, the pointing device-integrated text input device 3000 according to an embodiment of the present invention includes a button 3100 for receiving a push input or a touch input from a user, An electric connection member 3300 for forming a circuit 3400 to obtain a capacitance change according to a touch input of theelectrode 3130 included in the button 3100 and an electrostatic capacitance change And a controller 3500 for processing various kinds of information including the calculation of the touch coordinate value based on the electric signals and processing of the electric signals.

The push input is a user input for applying physical pressure to the button 3100. The push input causes the button 3100 to lower the predetermined distance or more so that the button 3100 touches the switch 3200 or presses the switch 3200 Quot; means a user input that causes the switch 3200 to output a key value assigned to the switch 3200. [ In this specification, the push input is mainly used as a user input for text input when the pointing device-integrated text input device 3000 is utilized as a keyboard interface.

Here, the touch input is a user input for touching the button 3100, which is a user input for inducing a change in the electrostatic capacity of the electronic device 3130 incorporated in the button 3100. At this time, a case where the capacitance change is equal to or greater than a predetermined touch threshold value can be understood as a touch input. In this specification, the touch input is mainly used as a user input for controlling the position of the pointer P when the pointing device integrated text input device 3000 is utilized as a mouse interface or a digitizer interface.

The pointing device-integrated text input device 3000 may be provided in a keyboard form similar to that shown in Fig. 9 as a whole or may be provided in a notebook form in which a display and a keyboard are combined as shown in Fig.

The pointing device-integrated text input device 3000 may include a plurality of buttons 3100 arranged in accordance with a predetermined keyboard layout. Here, the button 3100 may correspond to the multi-function input button described with reference to FIG. 10, FIG. 14, FIG. 25, or FIG.

The button 3100 may include a keycap 3110, a button body 3120, and an electrode 3130. Here, the key cap 3110 and the button body 3120 are disposed at the upper and lower portions, respectively, and theelectrode 3130 is interposed between the key cap 3110 and the button body 3120. [ That is, the button 3100 may be formed by stacking a keycap 3110, an electrode 3130, and a button body 3120 in this order.

The keycap 3110 is disposed on the upper surface of the button 3100, that is, on the exposed surface on the keyboard layout. The keycap 3110 may be in direct contact with the user's finger. That is, the user can press the keycap 3110 to perform a push input for typing, or touch the keycap 3110 to perform a touch input for manipulating the pointer (e.g., moving the mouse cursor). In addition, characters and the like assigned to the buttons may be printed on the keycap 3110 for convenience of typing.

The button body 3120 is disposed below the key cap 3110. The button body 3120 can move up and down in the vertical direction when a push input in a vertical direction is inputted through the keycap 3110. [ When the button body 3120 is lowered, the switch 3200 can be physically pressed or electrically contacted with the switch 3200. [ By this operation, as will be described later, the switch 3200 can obtain the key value assigned to the button 3100. [

Electrode 3130 is interposed between key cap 3110 and button body 3120. Electrode 3130 changes its electrostatic capacity when it is input to touch input to key cap 3100, thereby sensing touch input.

Electrode 3130 may be comprised of a plurality of blocks 3130 '. Some of these blocks 3130 'may form a first block group 3131 electrically connected according to a first direction which is either the longitudinal direction or the width direction of the keyboard layout. The remaining portion of the block 3130 'may form a second block group 3132 electrically connected in a second direction, which is one direction other than the first direction, of the longitudinal direction and the width direction of the keyboard layout. The reason why the first block group 3131 and the second block group 3132 are electrically connected is that the blocks 3130 'forming the block groups 3131 and 3132 are physically directly connected and electrically connected It should be interpreted to include the indirect connection physically through electrical connection means such as electric wires or conductors.

Specifically, the electronic 3130 may be provided similarly to the electronic part 1130 shown in FIG.

Here, the electronic block 3130 may include a plurality of blocks 1101, 1102, 1103, 1104, 1105, 1106, 1107, 1108, 1109, 1110, 1111, 1112, 1113 in the same manner as the electronic block 1130 have. Here, some blocks may be electrically connected in the horizontal direction or the vertical direction to form a block group. For example, a block group formed by three blocks 1104, 1105, and 1106 different from a block group formed by three blocks 1101, 1102, and 1103 in a block group connected in the horizontal direction in FIG. And the block group formed by the other three blocks 1107, 1108, and 1109 may be either the first block group 3131 or the second block group 3132. [ 11, a block group formed by two blocks 1110 and 1111 and a block group formed by two blocks 1112 and 1113 different from each other are arranged in a vertical direction, (3131) or a second block group (3132).

The keycap 3110 may correspond to the cover portion, the button body 3120 may correspond to the above-described base portion or the upper support portion, and theelectrode 3130 may correspond to the above-describedelectrode portion. For example, the keycap 3110 may be the cover portions 1010 and 2811 described with reference to FIGS. 10, 14, 25, and 28. For example, the button body 3120 may be the base portion 1030, 2932 or the upper support portion 1040 described with reference to FIGS. 10, 14, 25, and 28. For example, the electronic 3130 may be the electronic part 1020 described with reference to FIGS. 10, 14, 25, and 28.

The structure of the button 3110 has already been described fully with reference to Figs. 10, 14, 25, and 28, and thus a detailed description of the structure of the button 3110 will be omitted. Similarly, the shape of the electrode 3130 has already been fully described with reference to FIGS. 11 to 13 and FIGS. 18 to 22. Therefore, a more detailed description of the shape of the electrode 3130 will also be omitted here.

The switch 3200 is located at the bottom of the button 3100. For example, the switch 3200 may include a button 3100 such that a plurality of buttons 3100 are disposed on the lower portion of the button layer arranged in accordance with the keyboard layout, corresponding to each of the plurality of buttons 3100 according to the keyboard layout, As shown in FIG.

When the button 3100 is lowered in accordance with the up-down direction pushing input of the user, the switch 3200 may be contacted with the button 3100 or pressed by the button 3100. [ Accordingly, the switch 3200 can acquire or output a key value corresponding to the corresponding button 3100. [

The specific structure of the switch 3200 has already been described in detail with reference to FIGS. 4, 10 and 28, and a detailed description thereof will be omitted.

The electrical connection member 3300 can form the circuit 3400 by connecting the block groups 3131 and 3132 between the plurality of buttons 3100. [ Here, the electrical connecting member 3300 includes first conductors 1080 and 1441 attached to the upper support portion 1040 and second conductors 1040 and 1040 attached to the lower supports 1050 and 1060, 1090, 1442). In addition, the electrical connecting member 3300 may be provided in the form shown in Figs. 10, 14, and 27 to 29. As a typical example of the electrical connection member 3300, a form implemented through a pattern to be printed on the FPCB, a form on which a switch 3200 is mounted, .

The electrical connecting member 3300 is electrically connected between the blocks 3130 'of the electronic part 3130 belonging to the single button 3100, which are not physically directly connected on the surface of the electrode 3130 Connection can be established.

The electrical connecting member 3300 is connected to the plurality of buttons 3100 in a form of connecting block groups 3131 and 3132 formed in theelectrode 3130 of each button 3100 between adjacent buttons 3100 The block groups 3131 and 3132 can be connected.

For example, the electrical connecting member 3300 may include a first block group (not shown) of an electronic part 3130 belonging to a plurality of buttons 3100 arranged in a first direction which is either the longitudinal direction or the width direction of the keyboard layout 3131 can be continuously connected to form a drive line. For example, the electrical connecting member 3300 may be connected to the second block group of the electronic block 3130 belonging to the plurality of buttons 3100 arranged in the second direction which is either the longitudinal direction or the width direction of the keyboard layout The scan lines can be formed by connecting the scan lines 3132 continuously.

Here, the first block group 3131 arranged on the drive line may correspond to the above-described transmitter, and the second block group 3132 arranged on the scan line may correspond to the above-described receiver.

A drive signal is applied to the drive line and the drive signal is applied to the first block groups 3131 located on the drive line by the electrical connection member 3300 to induce electrostatic capacitance to the electrode 3130 . Also, in the scan line, a scan signal may be processed that reflects that the capacitance induced by the drive signal to the electrode 3130 is changed by the user's touch input. The scan signal may be a signal that senses a change in capacitance in the second block groups 3132 located on the scan line by the electrical connection member 3300. [

A more detailed description of the drive line, the scan line configuration, the processing of the drive signal and the scan signal, and the like has been already described above with reference to FIGS. 11 to 13 and 18 to 22, and will not be described here.

The controller 3500 may be implemented as a CPU or similar device depending on hardware, software, or a combination thereof. The controller 3500 may be provided in the form of an electronic circuit that performs a control function by processing an electrical signal in hardware. Further, the controller 3500 can be provided in the form of a program, an application, firmware, or the like that is processed by a controller 3500 as a software in hardware.

The controller 3500 can process electronic signals, process information, and perform calculations. Accordingly, the controller 3500 may process the overall operation of the pointing device-integrated text input device 3000 or may control each component of the pointing device-integrated text input device 3000. For example, the controller 3500 may acquire a scan signal from a scan line and calculate a touch coordinate value based on the scan signal. For example, the controller 3500 may perform a mode switching operation of the pointing device-integrated text input device 3000. [

In addition, the controller 3500 can process and perform various functions and operations of the pointing device-integrated text input device 3000. A more detailed description thereof will be described later. Meanwhile, the functions and operations of the pointing device-integrated text input device 3000 can be interpreted as being performed by the controller 3500, unless otherwise noted.

31 is an example of signal processing of text input of the pointing device-integrated text input device 3000 of FIG.

31, when the predetermined button 3100 receives a push input from the user, the pointing device integrated text input device 3000 moves down the button 3100 and the lowered button 3100 moves to the corresponding button 3100, Or pushes the switch 3200, thereby causing the switch 3200 to generate an electrical signal. The generated electrical signal may include identification information for the switch 3200, i.e., a key identifier. The controller 3500 receives the electric signal and outputs a key value corresponding to the button 3100, which receives the push input, as a keyboard input based on the received electric signal.

Here, the key value reflected or included in the keyboard input may be a character value. However, the key value and the character value are not always the same. For example, a button 3100 corresponding to a function key ('F1' to 'F12' or 'END', 'SHIFT', 'Print Screen', 'ESC' It can be a key value. In the present specification, however, there are many cases in which there is no benefit in distinguishing a key value from a character value, and therefore, it is deemed that the key value and the character value correspond to each other if necessary.

On the other hand, the key value and the key identifier are different concepts. For example, two or more key values may be set in one button 3100. For example, a button with an uppercase 'A' assigned may be assigned a lowercase letter 'a'. At this time, although the controller 3500 receives the same key identifier from the switch 3200, the controller 3500 selects a key value of 'A' and 'a' depending on whether the pointing device-integrated text input apparatus 3000 is in the uppercase letter input mode or the lowercase letter entry mode .

32 is an example of signal processing of the mouse input of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 32, the pointing device-integrated text input device 3000 can receive and receive a drive signal and a scan signal from the electronic device 3130. The drive signal and the scan signal are transmitted from the controller 3500 to the first block group 3131 and the second block group 3132 through the drive line and the scan line formed by the electrical connection member 3300 have. The electrostatic capacity induced by the drive signal to the electrode 3130 is changed by the touch input of the user, and the controller 3500 receives the scan signal reflecting the change amount.

The controller 3500 calculates a touch coordinate value in consideration of the drive signal cycle, the scan signal cycle, and the capacitance change value reflected by the scan signal for each scan signal cycle in a plurality of drive lines and a plurality of scan lines. It is possible to acquire and output the touch information. In general, the touch coordinate value may have an (x, y) shape including an x coordinate value corresponding to the horizontal direction on the display and a y coordinate value corresponding to the vertical direction on the display. Also, the controller 3500 may acquire touch information to which time information is added to the touch coordinate value. The touch information may have the form of (x, y, t) which further includes the touch input time t of the touch input that generated the corresponding touch coordinate value. However, in the present specification, there is almost no benefit in distinguishing between the touch coordinate value and the touch information. Accordingly, the touch coordinate value and the touch information should be interpreted as being compatible unless otherwise noted.

The controller 3500 can acquire and output a mouse input based on the touch coordinate value (or touch information). Here, the mouse input may be slightly different from the touch coordinate value. Typically, the mouse input can take the form of (x ', y') or (x ', y', t). A detailed description of the differences between mouse input and touch coordinate values will be given later.

Here, the mouse input may mean an input mainly output from the mouse interface for controlling the position of the pointer P displayed on the display. For example, an electronic device such as a personal computer (PC), a notebook computer, a smart phone, or a tablet may use a mouse input for controlling the position of a pointer P displayed on a display. The controller 3500 of the pointing device integrated text input device 3000 can generate a mouse input based on the touch coordinate value or the touch information and transmit the mouse input to the electronic device. When the mouse input is received, the electronic device can move the position of the pointer P displayed on the display according to the mouse input using an operating system or a mouse driver interface.

8, the controller 3500 may move the position of the pointer P according to the mouse input generated directly. Alternatively, if the text input device 3000 is provided as embedded in the electronic device, Or a separate arithmetic unit handling an operating system or a mouse driver interface may transmit the mouse input to a separate arithmetic unit to control the position of the pointer P. [

The above-mentioned mouse input can be generated by the following process.

When the user inputs a touch input to the touch area 3010 formed on the pointing device-integrated text input device 3000, the controller 3500 reflects the change in capacitance sensed by the electrode 3130 from the scan line It is possible to receive the scan signal in real time and calculate the touch coordinate value based on the scan signal. Here, the touch area 3010 is an area formed in the pointing device-integrated text input device 1000, and is an area capable of calculating a touch coordinate value by sensing the touch input of the user. In general, the touch region 3010 may be formed on the buttons 3100 having the plurality of the buttons 3100 including the electrodes 3130.

Next, the controller 3500 can calculate the touch coordinate variation value based on the touch coordinate value. Here, the touch coordinate value corresponds to the above-mentioned (x, y) shape, and the touch coordinate variation value corresponds to the (x ', y') shape. Specifically, the controller 3500 can calculate the touch coordinate change value through a difference operation between the current touch coordinate value and the previous touch coordinate value. In this case, the current touch coordinate value is a touch coordinate value calculated from the scan signal obtained in the scan signal cycle of the present time, and the previous touch coordinate value is the touch coordinate value calculated from the scan signal obtained in the scan signal cycle immediately before the scan signal cycle May be a touch coordinate value.

Here, the touch coordinate variation value may be referred to as a 'relative coordinate value' because it is the difference between the current touch coordinate values for the previous touch coordinate values.

The controller 3500 can acquire and output the touch coordinate variation value as a mouse input. The electronic device that has acquired the mouse input or a separate internal operation unit or the controller 3500 itself can move the pointer P on the display or control the position of the pointer P according to the mouse input.

The controller 3500 transmits identification information indicating that the corresponding touch information is a mouse input, along with the touch information, instead of acquiring and outputting the touch coordinate variation value as a mouse input, It is also possible to induce the electronic device or another internal arithmetic unit to directly generate the mouse input to perform the position control of the pointer P

33 and 34 show an example of the operation of the pointer P according to the mouse input according to FIG.

33, the user can input a drag-type touch input from the first position L1 to the second position L2 on the touch region 3010. [ The controller 3500 calculates the touch coordinate value corresponding to the touch input in real time, obtains the touch coordinate variation value through the difference calculation of the calculated coordinate values, and outputs the touch coordinate variation value to the mouse input.

34, the pointer P on the screen 10 being displayed by this mouse input can be processed to move along the path corresponding to the drag path, and finally the first position on the touch region 3010 From the first point D1 on the screen 10 corresponding to the first point L1 to the second point D2 corresponding to the second point L2.

35 and 36 show another example of the operation of the pointer P according to the mouse input according to Fig.

Referring to FIG. 35, a user may input a touch input that touches a first position L1 on a touch region 3010, and a touch input that touches a second position L2 without another touch input. For example, the user touches the first position L1, then moves the finger to the air, and touches the second position L2. When two touch inputs are generated, the controller 3500 does not generate a touch coordinate change value since the two touch inputs are spaced apart from each other by a predetermined time interval or more. That is, the controller 3500 can calculate the relative coordinate value of the mouse input as '0'.

36, the pointer P on the screen 10 displayed by the mouse input is moved to the third point (P) at which the pointer P on the screen 10 is displayed at the time of touching the first position L1 It can be handled as not moving the pointer P on the third plane D3.

FIG. 37 shows an example of signal processing of the digitizer input of the pointing device-integrated text input device 3000 of FIG.

The touch information described with reference to FIG. 37 can be processed with a digitizer input which is somewhat different from the mouse input.

The mouse input is used to move the position of the pointer P in the form of the difference value of the sensing point generated in accordance with the movement of the mouse or the movement of the touch to the touch screen, that is, the relative coordinate value. On the other hand, the digitizer input is an input in which the touch region 3010 and the screen 10 to be displayed correspond to each other. That is, in the digitizer input, the touch coordinate values of the touch region 3010 correspond to specific points on the screen 10. Typically, the digitizer input is advantageous in that the touch area 3010 itself is matched to the screen 10, so that the conventional digitizer interface can be used instead of a mouse in various industrial areas, arts, and design areas, etc. .

In this specification, the controller 3500 of the pointing device-integrated text input device 3000 includes a personal computer (not shown) for generating a digitizer input based on a touch coordinate value or touch information and performing position control of the pointer P according to a digitizer input PC: Personal Computer) or electronic equipment such as a laptop, a smart phone, or a tablet. When the digitizer input is received, the electronic device can use an operating system or a digitizer driver interface to control the position of the pointer P displayed on the display according to the digitizer input. 8, the controller 3500 may control the position of the pointer P in accordance with the digitizer input generated directly. Alternatively, the controller 3500 may control the position of the pointer P, A separate arithmetic unit handling the operating system or the digitizer driver interface can transfer the digitizer input to a separate arithmetic unit to control the position of the pointer P. [

The above-mentioned digitizer input can be generated through the following process.

When the user inputs a touch input to the touch area 3010 formed on the pointing device-integrated text input device 3000, the controller 3500 reflects the change in capacitance sensed by the electrode 3130 from the scan line It is possible to receive the scan signal in real time and calculate the touch coordinate value based on the scan signal.

Next, the controller 3500 calculates the point value of the screen 10 corresponding to the touch coordinate value in consideration of the relationship between the touch area and the resolution of the screen 10, and acquires and acquires the point value of the screen 10 as a digitizer input. Here, the point value of the screen 10 may be a coordinate value on the screen 10 resolution.

The electronic device or computing unit or controller 3500 itself that has obtained the digitizer input can control the position of the pointer P on the display according to the digitizer input. Specifically, the position of the pointer P is set to a point value of the screen 10. [

Here, the digitizer input may be referred to as the 'absolute coordinate value' since the touch coordinates in the touch region 10 are matched with the points in the screen 10 on the display.

The controller 3500 converts the touch coordinate value into a point value on the screen 10 in consideration of the resolution of the screen 10 and obtains the touch coordinate value itself as a digitizer input It is also possible that the electronic device or the arithmetic unit directly calculates the point value (resolution value) to induce the position control of the pointer P to be performed.

FIG. 38 shows an example of the operation of the pointer P according to the digitizer input according to FIG.

38, the user can input a drag-type touch input from the first position L1 to the second position L2 on the touch region 10. [ The controller 3500 can calculate the touch coordinate value corresponding to the touch input in real time and output the digitizer input based on the calculated coordinate value.

The pointer P on the screen 10 being displayed by this digitizer input may be processed to move along the path corresponding to the drag path and may be eventually processed to move to a position corresponding to the first position L1 on the touch region 3010 To a second point (D2) corresponding to the second position (L2) from the first point (D1) on the screen (10).

Fig. 39 is another example of the operation of the pointer P according to the digitizer input according to Fig.

39, the user may input a touch input that touches the first position L1 on the touch region 10, and input a touch input that directly touches the second position L2 without dragging. When the two touch inputs are generated, the controller 3500 separates the two touch inputs by more than a predetermined time interval in terms of time. However, since the first position L1 and the second position L2 are matched to the first point D1 and the second point D2 on the screen 10, respectively, the digitizer input by the first position L1 And the digitizer input by the second position L2 may point to the second (D2) point. The pointer P on the screen 10 being displayed by this digitizer input is positioned at the first point D1 on the screen 10 at the time of touching the first position L1, L2 from the first point D1 to the second point D2 at the time of touching.

FIG. 40 is an example of mode switching of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 40, the pointing device-integrated text input device 3000 may perform a keyboard mode, a mouse mode, and a digitizer mode.

Here, the keyboard mode is a mode in which the pointing device-integrated text input device 3000 performs a push-up operation in the up-and-down direction with respect to the button 3100 arranged in the keyboard layout by the user, whereby the button 3100 descending by the push- The keyboard input that reflects the key value assigned to the button 3100 to which the push input is applied is inputted by activating the switch 3200. [ On the other hand, since the keyboard mode is mainly used for text input, it may be expressed in terms of 'text mode' or 'text input mode'.

The mouse mode is a mode in which the pointing device-integrated text input device 3000 performs a touch input to the touch area 3010 formed by the electronic device 3130 by using the mouse input, In the present embodiment.

In the digitizer mode, when the pointing device-integrated text input device 3000 performs touch input to the touch area 3010 formed by the electronic device 3130, the pointer P ) Of the vehicle.

Meanwhile, since the mouse mode and the digitizer mode are mainly used for controlling the pointer P, they can be referred to as a 'pointing mode'. In addition, since both the mouse mode and the digital zero mode are based on the touch input, it is also possible to express them in terms of 'touch mode' or 'touch input mode'.

In the present embodiment, the controller 3500 in the pointing device-integrated text input device 3000 can perform the switching between the above three modes. The mode switching method may be similar to the mode switching method and the mode switching method described above, so a detailed description thereof will be omitted. However, in the switching of the operation mode of the pointing device-integrated text input device 3000, direct switching between the keyboard mode and the digitizer mode may not be allowed. In this case, it is also possible that the mode switching between the text mode and the digitizer mode is performed only through the mouse mode.

When the pointing device-integrated text input device 3000 enters the digitizer mode by mode switching, the controller 3500 can process the touch input as a digitizer input.

For this purpose, the pointing device-integrated text input device 3000 can set the touch area 3010 corresponding to the screen 10. [

FIG. 41 is an example of setting of the touch area 3010 according to the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 41, the touch area 3010 may be formed by a button 3100 having an electrode 3130 for touch input sensing. Typically, the touch region 3010 for the digitizer input may be formed in a rectangular or the like shape on the keyboard layout. This rectangular-shaped touch area 3010 may be matched with the screen 10.

In the above, it has been mentioned that the touch area for mouse input can be realized as the right / left touch areas 108a and 108b as shown in FIG.

42 and 43 show an example of the relationship between the touch region 3010 according to the digitizer mode of FIG. 41 and the touch region according to the mouse mode.

Referring to FIGS. 42 and 43, the entire touchable area 3010 'provided in the pointing device-integrated text input device 3000 is set as the touch area 3010 used in the digitizer mode. Since the touch area 3010 is matched with the screen 10, it can be set to include both the right-hand / left-hand touch areas 108a and 108b.

For example, as shown in FIG. 42, when the pointing device integrated text input device 3000 enters the digitizer mode from the right-hand mouse mode receiving a touch input from a user through the right-handed touch area 108b of FIG. 1, The entire area where the left-handed touch areas 108a and 108b are combined can be changed to the touch area 3010. [ Of course, when the mode is switched to the mouse mode again in this state, the pointing device-integrated text input device 3000 will again be able to sense the touch input to the right-handed touch area 108b.

On the other hand, for example, as shown in FIG. 43, when the pointing device-integrated text input device 3000 enters the digitizer mode from the left-handed mouse mode receiving the touch input from the user through the left-handed touch area 108a of FIG. 1, The entire area where the right-hand / left-hand touch areas 108a and 108b are combined can be changed to the touch area 3010. [ Of course, when the mode is switched to the mouse mode again in this state, the pointing device-integrated text input device 3000 will again be able to sense the touch input to the left-hand touch area 108a.

In the above description, the touch region 3010 is matched to the entire screen 10 in the digitizer mode. However, in this specification, the pointing device-integrated text input device 3000 may set the touch area 3010 in the digitizer mode based on the position of the pointer P on the screen 10 at the time of entering the digitizer mode.

FIGS. 44 and 45 show another example of setting of the touch area 3010 according to the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

44 and 45, when the pointing device-integrated text input device 3000 enters the digitizer mode, when the touch input is generated for the first time after entering the digitizer mode, the controller 3500 calculates the touch coordinate value And the touch area 3010 can be set so that the calculated touch coordinate value and the point value of the pointer P on the current screen 10 match with each other. Therefore, even if the user enters the same digitizer mode as shown in FIGS. 44 and 45, the matching relation between the screen 10 and the touch region may be different if the first touch input is inputted to a different position after entering the mode.

41, the entire touch sensing enabled area 3010 'on the pointing device-integrated text input device 3000 is set as the touch area 3010 in the digitizer mode and the pointing device integrated text input device 3000 is set as the digitizer The touch region 3010 in the low mode and the entire screen 10 are matched with each other. Accordingly, the touch region 3010 is always fixed to the screen 10. 41, since the touch coordinate value corresponding to the point where the pointer P exists in the touch area 3010 is not known precisely, It may be difficult to carry out a predetermined operation directly at the point of the pointer P located on the screen. For example, when the user is working in the mouse mode and switches to the digitizer mode to digitally sign a point at which the current pointer P is on the display, the user may enter a pointer (&quot; P), that is, the start point of the signature.

However, in this example, in this example, the point at which the current pointer P is located is matched with the touch coordinate value of the touch input first after entering the mode, and the touch region 3010 is set accordingly, P). Therefore, in the setting of the touch area 3010 according to the method shown in FIGS. 44 and 45, it is possible that the user does not need to precisely know the touch coordinate value corresponding to the position of the pointer P in the entire touch area 3010 It is possible to perform a predetermined operation immediately at a point where the pointer P is present on the screen 10 after the entry. For example, when the user is operating in the mouse mode and switches to the digitizer mode to sign a point where the current pointer P is on the display, the user may press the pointer P The signing operation can be performed from the point where the pointer P exists by simply starting the signing at an arbitrary touch position without a troublesome operation of searching for the point where the pointer P exists.

However, as shown in FIG. 44 and FIG. 45, the touch area 3010 is set so that the pointer P on the screen 10 at the time of entering the digitizer mode and the touch coordinate value of the first touch input after entering the digitizer mode match A problem may occur that the touch area 3010 covers only a part of the screen in some cases.

FIG. 46 is an example in which the touch region 3010 is set outside the region 3010 'where the touch can be performed when the touch region 3010 according to FIGS. 44 and 45 is set.

46, after the user enters the digitizer mode in a state where the pointer P is located at the lower right end of the screen 10, the actual touch of the pointing device-integrated text input device 3000 When a first touch input is performed at the upper left of the entire region 3010 'in which the user can perform the touch operation and the touch region 3010 of the digital interest mode is to be matched to the actual screen 10, Out of the entire area 3010 'where the actual touch is possible.

When the touch area 3010 is set as described above, the remaining part of the area 3010 'that can be actually touched in the pointing device-integrated text input device 3000, except for the part overlapping the touch area 3010, The touch area 3010 can not be used in the digitizer mode because the matching can not be performed.

Therefore, by setting the touch area 3010 in the digitizer mode by matching the touch coordinates of the first touch input after entering the digitizer mode with the coordinates of the pointer P on the screen 10 on the screen 10, There is an advantage that the digitizer type touch input can be started from a position where the pointer P is present on the screen 10 when the digitizer input is desired, that is, when the digitizer mode is entered. However, For example, the pointer P is located on the left side, the right side, the upper side, or the lower side of the screen 10, respectively, when the touch coordinates at which the touch point on which the touch point , The first touch coordinates after entering the mode are located on the right, left, bottom, or top of the entire touch area 3010 '- part of the screen 10 does not match the touch area 3010 Or a large part of the whole touch area (3010 ') may be a problem that can not be matched to the screen (10).

Fig. 47 is an example of resetting the touch area 3010 according to the digitizer mode of Fig. 46, and Fig. 48 is another example of resetting the touch area 3010 according to the digitizer mode of Fig.

47 and 48, a touch region 3010a corresponding to the screen 10 at the time of entering the digitizer mode is a coordinate value (e.g., a coordinate value) on the screen 10 of the pointer P positioned at the lower right end portion of the screen 10 And the touch coordinate values located at the upper left portion of the entire touchable area 3010 'are matched with each other and set as a reference. In this state, as described above with reference to FIG. 46, part of the touch region 3010a is deviated from the touchable region 3010 '. Accordingly, touch input is not possible for an area on the screen 10 that matches the touch area 3010a deviating from the touchable area 3010 '. In contrast, as described above with reference to FIG. 46, since many portions of the touchable area 3010 'do not correspond to the screen 10, the use of the touchable area 3010' is also low.

Therefore, it is necessary to move the touch region 3010a so that the touch region 3010a and the screen 10 can be properly matched with each other.

Accordingly, the pointing device-integrated text input device 3000 can reset the touch area 3010 in the digitizer mode matched to the screen 10.

Referring to FIG. 47, when a multi-finger touch input (touch input using two fingers in FIG. 47) is received for a predetermined touch area 3010a in the digitizer mode, the pointing device- The touch area 3010 can be reset by changing the touch area 3010b so that the touch area 3010 corresponds to the movement of the touch coordinates of the multi-finger touch input.

can do.

48, when a touch input is received in an external area that is not included in the predetermined touch area 3010a in the touchable area 3010 'in the digitizer mode, the pointing device integrated text input device 3000 ) Can reset the touch area 3010 by changing the touch area 3010b so as to correspond to the movement of the touch coordinates of the touch input.

According to another example, the pointing device-integrated text input apparatus 3000 may be configured such that the touch region 3010 is matched with the screen 10 in the digitizer mode by a predetermined user input through the mode switching unit It is possible to enter a waiting state for receiving an input for resetting. Upon receiving the touch input in the standby state, the touch region 3010 can be reset by moving the touch region 3010 to correspond to the movement of the corresponding touch input.

In addition to the above-mentioned examples, the pointing device-integrated text input device 3000 determines various conditions as a touch area reset request, and waits for an input for touch area reset when a touch area reset request is generated. The touch region 3010 in the digitizer mode can be moved by moving the touch region 3010 to correspond to the movement of the input.

Hereinafter, some methods in which the pointing device-integrated text input device 3000 performs the control operation related to the digitizer mode will be described.

FIG. 49 is a flowchart illustrating an example of a mode switching method of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 49, the method includes steps S3110 to S3110 of obtaining information about an input mode, determining an input mode (S3120), activating a switch 3200 and deactivating the electro- Step S3134 of obtaining the key identifier, step S3135 of obtaining the key value, step S3135 of obtaining the key ID, step S3134 of obtaining the key value, Step S3121 of deactivating the switch 3200 and activating the electro 3130, step S3122 of obtaining the touch input, step S3123 of changing the capacitance, step of obtaining the touch coordinate value (S3124), acquiring a mouse input (S3125), deactivating the switch 3200 in the digitizer mode and activating the electro 3130 (S3131), acquiring the touch input (S3132) In step S3133, the touch coordinate value is obtained Step may include the step (S3135) to obtain a (S3134), and the digitizer input.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 acquires information on the input mode (S3110), and determines the input mode according to the obtained information (S3120). Here, the input mode may include a keyboard mode, a mouse mode, and a digitizer mode, and switching between these modes in the pointing device-integrated text input device 3000 may be completely free or limited.

In the case of the keyboard mode, the pointing device-integrated text input device 3000 can output a key value as a keyboard input according to a user input in the form of a push input.

First, the pointing device-integrated text input apparatus 3000 may activate the switch 3200 and deactivate the electronic 3130 (S3131).

Here, the activation of the switch 3200 means that when the switch 3200 is touched or pressed by the button body 3120 according to the push input, the controller 3500 receives the key identifier from the switch 3200, And the keyboard input reflecting the key value can be transmitted to a device or unit using the pointing device-integrated text input device 3000 as an input interface.

Conversely, inactivation of the switch 3200 means that the pointing device-integrated text input device 3000 performs some or all of the process of finally transmitting the keyboard input in accordance with the push input of the user in the activated state of the switch 3200 , Which means that the keyboard input is not output to the push input.

Here, the activation of the electrode 3130 means that when a user performs a touch input, a drive signal is applied to the electrode 3130 to generate a capacitance in theelectrode 3130, The controller 3500 calculates the touch coordinate value and the touch information according to the scan signal and acquires a mouse input or a digitizer input based on the touch coordinate value and the touch information to generate a pointing device- May mean a state in which a mouse input or a digitizer input can be transmitted to an apparatus or a unit using the keyboard 3000 as an input interface.

Conversely, deactivation of the electronic device 3130 means that the pointing device-integrated text input device 3000 receives a part of the process of finally transmitting a mouse or a digitizer input in response to a user's touch input in the activated state of the above-described electronic device 3130 It may mean that a mouse or a digitizer input is not output to the touch input by not performing all of the operations.

The pointing device-integrated text input device 3000 acquires a push input through the key cap 3110 (S3132) and accordingly the button body 3120 is lowered (S3133), the switch 3200 acquires the key identifier ( S3134), the controller 3500 receives the key value, obtains the key value, and obtains the keyboard input including the key value (S3135).

The pointing device-integrated text input device 3000 may function as a keyboard by transmitting a keyboard input to a subject using the pointing device-integrated text input device 3000 as an input interface.

When the pointing device-integrated text input device 3000 is in a mouse mode, the pointing device-integrated text input device 3000 can output a mouse input according to a user input of a touch input type.

First, the pointing device-integrated text input device 3000 may deactivate the switch 3200 and activate the electronic 3130 (S3141). However, at this time, if necessary, it is also possible to deactivate only a part of the switch 3200, or to make all of the switches 3200 active.

When the touch input is touched through the keycap 3110 (S3142), the pointing device-integrated text input apparatus 3000 may cause a change in the electrostatic capacity of theelectrode 3130 generated by the drive signal (S3143). The controller 3500 receives the scan signal that reflects the change in capacitance, and acquires the touch coordinate value accordingly (S3144).

When the touch coordinate value is obtained, the controller 3500 may calculate the touch coordinate variation value through a difference operation between the touch coordinate value obtained in the previous scanning period and the current touch coordinate value, and generate a mouse input reflecting the touch coordinate variation value (S3145).

The pointing device-integrated text input device 3000 may function as a mouse by transmitting a mouse input to a subject using the pointing device-integrated text input device 3000 as an input interface.

When the pointing device integrated text input device 3000 is in the digitizer mode, the pointing device integrated text input device 3000 can output a designer input according to a user input of a touch input type.

First, the pointing device-integrated text input device 3000 may deactivate the switch 3200 and activate the electronic 3130 (S3151). However, at this time, if necessary, it is also possible to deactivate only a part of the switch 3200, or to make all of the switches 3200 active.

When the touch input is touched through the keycap 3110 (S3152), the pointing device-integrated text input apparatus 3000 may cause a change in the electrostatic capacity of theelectrode 3130 generated by the drive signal (S3153). The controller 3500 receives the scan signal reflecting the change in capacitance, and can acquire the touch coordinate value accordingly (S3154).

The controller 3500 generates a digitizer input indicating a specific point on the screen 10 from the touch coordinate value in consideration of the matching relationship between the screen 10 and the touch region 3010 in the digitizer mode (S3145).

The pointing device-integrated text input device 3000 may function as a digitizer by transmitting the digitizer input to a subject using the pointing device-integrated text input device 3000 as an input interface.

FIG. 50 is a flowchart of a touch input processing method in the mouse mode and the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 50, the method includes obtaining a touch input (S3210), calculating a touch coordinate value (S3220), determining a mode (S3230), determining a previous touch coordinate value and a current touch A relative coordinate value is calculated based on the coordinate value (S3240), a mouse input is output in accordance with the relative coordinate value (S3250), and in the case of the digitizer mode, absolute coordinate Calculating a coordinate value (S3260), and outputting a digitizer input in accordance with the absolute coordinate value (S3270).

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 acquires the touch input (S3210), and calculates the touch coordinate value according to the touch input (S3220).

When the touch coordinate value is calculated, the controller 3500 can determine whether the current mode is the mouse mode or the digitizer mode (S3230).

In the mouse mode, the controller 3500 calculates a relative coordinate value based on the touch coordinate value of the previous scanning period and the touch coordinate value of the current scanning period (S3240), and outputs the mouse input reflecting the relative coordinate value ( S3250).

On the other hand, in the case of the digitizer mode, the controller 3500 calculates an absolute coordinate value from the touch coordinate value in consideration of the touch area-screen area matching relationship (S3260), and outputs the digitizer input according to the absolute coordinate value (S3270) .

Here, the process in which the controller 3500 acquires the digitizer input from the touch coordinate value may be as follows.

For example, the matching relationship may be a matching table or a matching function between coordinate values on the screen 10 resolution by the coordinate values of the touch region 3010. [ In this case, the controller 3500 can use this matching table or matching function to change the touch coordinate value to the coordinate value on the screen 10, and obtain a digitizer input that reflects the coordinate value on the screen 10.

As another example, the matching relation may mean that the touch coordinate value of the first touch input corresponds to the coordinate value on the resolution of the pointer P on the screen 10 at the time of the first touch input when the digitizer mode is entered . In this case, the controller 3500 can obtain the difference between the touch coordinate value of the start touch input and the touch coordinate value of the current touch input as a digitizer input. This method is technically equivalent to setting the matching relationship between the screen 10 and the touch area 3010 according to the coordinate value of the first touch input and converting the touch coordinate value into the absolute coordinate value according to the matching relation However, the signal / information processing / computation process may be somewhat different.

FIG. 51 is a flowchart illustrating an example of a method of setting a touch area in the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

51, the method includes a step S3310 of entering a mouse mode, a step S3320 of determining a right hand / left hand mode, a step S3330 of setting a touch area based on whether the right hand mode or the left hand mode is selected, A step of receiving a digitizer mode request (S3340), a step of entering a digitizer mode (S3350), a step of setting a whole touchable area as a touch area (S3360), a step of matching a touch area and a screen area (S3370), acquiring the touch input and calculating the touch coordinate value (S3380), and acquiring the digitizer input based on the touch coordinate value in consideration of the matching relationship between the screen resolution and the touch region (S3319).

Hereinafter, each of the above-described steps will be described in more detail.

First, the pointing device-integrated text input device 3000 enters the mouse mode (S3310). At this time, the pointing device-integrated text input apparatus 3000 determines whether it is the right-hand mode / left-hand mode (S3320) and sets the touch area differently depending on whether the right-hand mode or the left-hand mode is selected (S3330). Whether the mode is the right-handed mode or the left-handed mode and the description of the corresponding touch area have been described above, so a detailed description thereof will be omitted here.

The pointing device-integrated text input apparatus 3000 receives the request to switch to the digitizer mode through the mode switching unit or the like in the mouse mode (S3340), and enters the digitizer mode (S3350).

When the digitizer mode is entered, the pointing device-integrated text input device 3000 sets the entire touchable area as the touch area (S3360), and matches the touch area and the screen area based on the resolution of the screen 10 S3370). Specifically, a matching table or a matching function in which four corners of the touch area 3010 coincide with the four corners of the screen 10 may be generated.

The pointing device-integrated text input device 3000 may acquire the touch input, calculate the touch coordinate value (S3380), and obtain the digitizer input based on the touch coordinate value in consideration of the matching relationship between the screen resolution and the touch area (S3319). At this time, the digitizer input may indicate a predetermined point on the screen 10. However, it is also possible that the pointing device-integrated text input device 3000 simply transmits the touch coordinate value and the device that receives the touch coordinate value converts the touch coordinate value to the screen coordinate value.

FIG. 52 is a flowchart of another example of a method of setting a touch area in the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 52, the method includes the steps of switching from a mouse mode to a digitizer mode (S3410), acquiring an initial touch input (S3420), calculating a coordinate value of the first touch input (S3430) A step S3440 of obtaining a touch area-screen matching relation based on the position of the pointer on the screen, and a step S3450 of setting a touch area based on the matching relation.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 switches from the mouse mode to the digitizer mode (S3410), acquires the first touch input after entering the mode (S3420), and calculates the touch coordinate value (S3430).

The pointing device-integrated text input device 3000 may obtain a touch area-screen matching relation based on the calculated coordinate value and the position of the pointer P on the screen 10 (S3440). That is, the controller 3500 can generate a matching table or a matching function that makes the touch points of the first touch and the pointers P on the screen 10 correspond to each other.

When the matching relation is formed, the pointing device-integrated text input device 3000 can set the touch area based on the matching relationship (S3450). The controller 3500 can set the touch area so that the touch coordinate value of the first touch of the touch area and the point of the pointer at the first touch correspond to each other.

Thereby, the touch coordinate values on the touch area are matched with the resolution values of the screen 10, so that the touch area can be used in the form of receiving the digitizer input.

It is also possible to control the movement of the pointer on the screen based on the difference between the coordinate value of the first touch input and the coordinate value of the touch input that is subsequently input, instead of implementing the matching table or the matching function that forms the matching relationship. In the mouse mode, the movement of the pointer is controlled by calculating the touch coordinate variation value by a difference operation between the touch coordinate value of the current scanning period and the touch coordinate value of the previous scanning period. In the digitizer mode, even if a matching relation is not formed, since the point of the pointer at the time of first touch input is matched with the touch coordinate value of the first touch input on the touch area, the movement of the pointer is changed to the touch coordinate value of the first touch input, It is also possible to perform control using the touch coordinate variation value calculated from the difference calculation of the touch coordinate values of the touch coordinates.

FIG. 53 is a flowchart of a touch area resetting method in the digitizer mode of the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 53, the method includes receiving (S3510) a touch area reset request in a digitizer mode, resetting a touch area in response to a reset request (S3520), acquiring a touch input (S3530) A step S3540 of calculating a value and a step S3550 of obtaining a digitizer input based on a touch coordinate value in consideration of a matching relation between the screen resolution and the touch area.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 may receive a touch area reset request in the digitizer mode (S3510). Since the embodiment of the concrete reset request has already been described above, a detailed description will be omitted here.

When the reset request is received, the pointing device-integrated text input device 3000 can reset the touch area (S3520). Specifically, the controller 3500 can reset the touch area by moving the touch area corresponding to the movement of the touch input inputted after the reset request.

Specifically, the pointing device-integrated text input device 3000 obtains a touch input (S3530), calculates a touch coordinate value of the obtained touch input (S3540), and then calculates a touch coordinate value And the digitizer input may be obtained based on the received data (S3550).

On the other hand, in the resetting of the touch area using the multi-touch input described above or the resetting of the touch area using the touch input to the touchable area outside the touch area, a command for resetting the touch area and a command for moving the touch area are merged Can be interpreted.

In the above description, it is mentioned that the pointing device-integrated text input device 3000 basically receives only the key input and does not recognize the touch input in the keyboard mode, and basically inputs only the touch input in the mouse mode and does not recognize the key input .

In fact, in the keyboard mode, when the pointing device-integrated text input device 3000 senses the touch input, the pointer P on the screen 10 can move due to the typing not matching the intention of the user, May be advantageous. Further, in order to sense the touch input, unnecessary power wastes may occur because the pointing device integrated text input device 3000 periodically processes the drive signal and the scan signal.

However, in the touch mode (the mouse mode, the digitizer mode, and the like), even if the text input device 3000 integrated with the pointing device recognizes the key input, there is no inconvenience to the position control of the pointer P.

Hereinafter, a method of utilizing the key input by the pointing device-integrated text input device 3000 in the touch mode will be described.

In a computing environment or the like, it may be necessary to adjust adjustable attributes during operation of the operating system or execution of the application. Hereinafter, these attributes are referred to as adjustment target attributes.

54 is a diagram showing some examples of the attributes to be adjusted.

Typical errands of the adjustment object attribute include a volume attribute 12a relating to the sound volume of audio shown in Fig. 54, a progressive bar attribute 12b relating to the progress of moving picture reproduction, a color space attribute 12c ), And there are various other attributes to be adjusted.

In the past, various methods have been devised to adjust the property values of such adjustment target attributes.

For example, the user can adjust the adjustment object attribute by inputting the character value or the key value assigned to the adjustment of the adjustment object attribute. Specifically, when the user presses the "+" key on the keyboard, the attribute value of the volume attribute increases. When the user presses the "-" key, the attribute value of the volume attribute decreases.

As another example, an indicator located in a graphic object reflecting an attribute value of an adjustment object attribute has been moved through dragging according to a mouse input.

However, in the case of adjusting the attribute value of the adjustment object attribute through key input, a large number of key inputs are frequently required repeatedly. In order to move the indicator positioned in the graphic object through dragging according to the mouse input , It is troublesome for the user to move the pointer P to the indicator position of the graphic object and then perform the drag input.

In this specification, the pointing device-integrated text input device 3000 can adjust an adjustment target attribute by utilizing a keyboard input while operating in a touch mode. Hereinafter, some embodiments will be described.

55 is a diagram showing a matching relationship between the attribute to be adjusted and the button 3100. Fig.

Referring to FIG. 55, the key input is basically inactive while the pointing device-integrated text input device 3000 is operating in the touch mode. However, some of the keys are set to be able to recognize the key input. In addition, an adjustment object attribute may be assigned to a key value of some buttons 3100 in which a key input is recognizable.

That is, the controller 3500 can assign an adjustment object attribute to a key value or key identifier corresponding to at least one specific button 3100 in the touch mode. Alternatively, when the key input of the specific button 3100 occurs in the touch mode, the controller 3500 can acquire and output the key input by a keyboard input indicating a shortcut key of the adjustment object attribute. For example, the 'A' button 3100a, the 'P' button 3100b, and the 'C' button 3100c correspond to the audio volume attribute, the progressive bar attribute of the media player, Can be.

The controller 3500 judges whether a predetermined adjustment object attribute is assigned to the key identifier of the switch 3200 of the corresponding key or a key value having a predetermined adjustment object attribute is assigned can do.

If an attribute to be adjusted is assigned to the corresponding button 3100, a touch input subsequently input is recognized, and a mouse or a digitizer input is acquired / transmitted according to the touch coordinate value, The attribute value of the target attribute can be adjusted according to the touch input.

To this end, the controller 3500 generates shortcut key information for calling up the adjustment target attribute or activating the adjustment according to the key value generated by the key input for the button 3100 to which the adjustment target attribute is assigned, .

For example, while the pointing device-integrated text input device 3000 operates in the touch mode, the user can perform key input for the button 3100 to which the adjustment object attribute is assigned. At this time, the controller 3500 can acquire the corresponding key identifier.

If the pointing device-integrated text input apparatus 3000 is operating in the keyboard mode, the controller 3500 converts the key value into a character value or a value (e.g., 'ESC' value, 'Caps Lock Quot; value &lt; / RTI &gt; or the like).

However, if the pointing device-integrated text input device 3000 is operating in the touch mode, the controller 3500 may first obtain the key identifier and determine whether the key identifier is assigned the adjustment object attribute. If not assigned, the key input is ignored.

However, if an adjustment object attribute is assigned to the key identifier, the subsequent touch input can be output as a mouse / digitizer input form used for adjusting the attribute value of the adjustment object attribute. Also, during this process, the controller 3500 may transmit / output a signal for instructing activation / invocation of information to be adjusted or an adjustment target attribute.

Here, when some of the adjustment object attributes are called or activated, the adjustment object attribute may be displayed on the screen as a graphical object including an adjustment range, an indicator indicating a plane and a current property value.

56 and 57 are diagrams illustrating an example of adjustment of an adjustment target attribute of the pointing device-integrated text input device 3000. [

An example with reference to Fig. 56 is as follows.

When the key input for the "A" key occurs in the non-touch mode, the pointing device-integrated text input device 3000 can output the key value for the character "A". When the key input for the &quot; A &quot; key is generated in the touch mode, the pointing device-integrated text input device 3000 obtains the key value indicating the audio volume attribute from the &quot; A &quot; key input, The audio volume attribute can be activated or output to the main body using the audio interface 3000 as an input interface.

Next, the controller 3500 can process the touch input after occurrence of the key input associated with the adjustment object attribute as the attribute adjustment value for adjusting the attribute value of the adjustment object attribute. The adjustment target attribute can be adjusted according to the attribute adjustment value.

Specifically, the touch input moving from the lower end to the upper end of the keyboard layout may increase the attribute value of the volume attribute. Also, the touch input moving from the upper end to the lower end of the keyboard layout may decrease the attribute value of the volume attribute.

If the touch input is used as an input for adjusting the value of the adjustment object attribute in place of the mouse input for moving the position of the pointer P, it is referred to as an attribute adjustment input.

The attribute adjustment input may be provided in the form of including the adjustment object attribute in a form similar to a mouse input or a digitizer input. Or the attribute adjustment input may be provided in a form in which a touch coordinate value is mapped to an attribute value.

That is, in FIG. 56, the pointing device-integrated text input device 3000 indicates a mouse input or digitizer input according to movement from the first touch position A1 to the second touch position A2, and an audio volume attribute as an adjustment target attribute Information can be transmitted to the electronic device. The electronic device outputs the graphic object according to the audio volume attribute according to the information indicating the audio volume attribute on the screen and changes the attribute value from the first attribute value a1 to the second attribute value a1 according to the subsequent mouse input or the digitizer input. (a2). At this time, the electronic device may be to move an indicator 12a 'indicating an attribute value.

An example with reference to Fig. 57 is as follows.

When the key input for the "P" key occurs in the non-touch mode, the pointing device-integrated text input device 3000 can output the key value for the character "P". When the key input for the "P" key occurs in the touch mode, the pointing device-integrated text input device 3000 obtains a key value indicating the playback attribute of the media player from the "P" key input, The main body using the text input device 3000 as an input interface can output a signal to be activated or called so that the corresponding playback attribute can be adjusted.

If the left-to-right touch input is input between the third touch position B1 and the fourth touch position B2, the playback attribute can be adjusted between the third attribute value b1 and the fourth attribute value b2 .

Here, the adjustment object attribute can generally have a one-dimensional attribute value. The adjustment object attribute having the one-dimensional attribute value may be expressed as a graphical object including an indicator indicating the current attribute value on the corresponding bar corresponding to the adjustment range represented by the minimum value and the maximum value. Also, the graphic object may be represented by a dial-shaped graphic object whose attribute value is adjusted in the clockwise / counterclockwise direction as the case may be.

However, the adjustment object attribute having all one-dimensional attribute values is not represented by a graphic object.

The adjustment of the attribute value of the adjustment object attribute having the above-mentioned one-dimensional attribute value and represented by the graphics object including the bar and indicator can be performed mainly by moving the pointer in the vertical direction or the horizontal direction. In this way, the direction in which the pointer moves in order to adjust the attribute value can be defined as the property adjustment direction. For example, the above-described volume property has a property adjustment direction in the vertical direction and the playback property has a property adjustment direction in the horizontal direction.

Accordingly, when the touch input of the pointing device-integrated text input device 3000 is used to adjust the attribute value of the adjustment object attribute, when the touch input is two-dimensional, the coordinate value perpendicular to the attribute adjustment direction of the adjustment object attribute Can be ignored. Specifically, the controller 3500 can correct the touch coordinate value in consideration of the attribute control direction and acquire / output the attribute control input based on the corrected touch coordinate value.

FIG. 58 is a diagram showing another example of adjustment of the adjustment target attribute of the pointing device-integrated text input device 3000. FIG.

For example, referring to FIG. 58, the volume attribute shown in FIG. 58 has an attribute adjustment direction in the vertical direction on the screen 10. FIG. At this time, when a request to adjust the volume attribute is received through the 'A' button 3100a on the pointing device-integrated text input device 3000, the controller 3500 may generate an attribute control input in response to the touch input . At this time, the controller 3500 determines that the volume attribute is assigned to the 'A' button, and determines that the attribute adjustment direction of the volume attribute is the up and down direction. When the touch input is generated, the controller 3500 can correct the touch coordinate value according to the attribute adjustment direction. 58, although the fifth touch A1 'and the sixth touch A2' are arranged in a diagonal direction, the attribute adjustment direction of the volume attribute is different from the first attribute value a1 and the second attribute value a2, The controller 3500 can process the attribute adjustment input for adjusting the attribute value using only the vertical coordinate values of the touch input in the diagonal direction and removing the horizontal direction.

FIG. 59 is a diagram illustrating another example of adjustment of an adjustment target attribute of the pointing device-integrated text input device 3000. FIG.

In the above description, the adjustment target attribute mainly has one-dimensional attribute values. However, in some cases, there are adjustment target attributes having more than two-dimensional attribute values such as color space or color coordinates.

59 shows a color plane 12c having a two-dimensional attribute value. When the 'C' key 3100c to which the color plane is assigned is pressed, the pointing device-integrated text input device 3000 can process the subsequent two-dimensional touch coordinate value as attribute control input for adjusting the two-dimensional property value have.

In the above description, when there is a keyboard input of the button associated with the adjustment target attribute in the touch mode, the touch mode is entered to control the attribute value of the adjustment object attribute in the general touch mode, It can be interpreted as adjusting the property value of the adjustment object attribute.

As described above, there are various ways of processing the touch input as an input for adjusting the attribute value of the adjustment object attribute. Hereinafter, some examples will be described.

The controller 3500 can enter the attribute adjustment mode when the key identifier assigned to the button 3100 indicating the attribute of the adjustment object in the touch mode is received.

Here, the method of entering the attribute adjustment mode may be as follows.

For example, when the key identifier of the button 3100 indicating the adjustment object attribute in the general touch mode is received, the user can enter the attribute adjustment mode. Also, when the key identifier of the button 3100 indicating the adjustment target attribute is received again in the attribute adjustment mode, the attribute adjustment mode can be canceled. At this time, it is possible to return to the normal touch mode again. The controller 3500 can process the attribute adjustment input for the touch input up to the release after entering the adjustment object attribute. Also, at this time, a key value indicating an attribute adjustment mode may be assigned to the 'ESC' key or the like in general.

As another example, when the key identifier of the button 3100 indicating the adjustment target attribute in the general touch mode is received, the user can enter the attribute adjustment mode. In this state, the controller 3000 can process the property adjustment input for one touch input. Once the touch input is finished, the attribute adjustment mode can be canceled and the normal touch mode can be restored.

As another example, when the key identifier of the button 3100 indicating the adjustment object attribute in the general touch mode is received, the attribute adjustment mode can be maintained while the corresponding button 3100 is pressed. When the push of the button 3100 is released, the property adjustment mode can be canceled. The controller 3500 can process the attribute adjustment input for the touch input up to the release after entering the adjustment object attribute. The attribute control mode can be canceled and the normal touch mode can be restored.

Here, the pointing device-integrated text input device 3000 can enter the attribute adjustment mode and the touch input in the attribute adjustment mode is processed as the attribute adjustment input. However, there is no separate mode called the attribute adjustment mode , It is also possible to process the touch input under specific conditions only as attribute adjustment input. The specific conditions here may be similar to the above example.

FIG. 60 is a diagram relating to a first example of processing of a touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device 3000. FIG.

Referring to FIG. 60, the touch input of the pointing device-integrated text input device 3000 in the attribute adjustment mode is processed similarly to the mouse input described above. However, at this time, instead of calculating the mouse input from the touch coordinate value, it is also possible to calculate the mouse input using the corrected touch coordinate value in consideration of the attribute adjustment direction. The attribute value of the adjustment target attribute can be increased or decreased in accordance with the attribute adjustment input processed similarly to the mouse input.

Specifically, in the case of the audio volume attribute 12a 'having the property adjustment direction of the up and down direction, adjustment of the position and the attribute value of the indicator 13 for displaying the volume attribute value due to the upward / downward touch input can be performed.

FIG. 61 is a diagram related to a second example of a touch input process for adjusting an adjustment object attribute of the pointing device-integrated text input device 3000. FIG.

Referring to FIG. 61, when entering the attribute adjustment mode, the pointing device-integrated text input device 3000 may match the adjustment range of the attribute values of the touch area and the adjustment object attribute for attribute adjustment. The touch input may then be processed in a manner similar to a digitizer input to obtain attribute control inputs.

Specifically, for the audio volume attribute 12a 'in which the attribute adjustment direction is the up and down direction, a touch for the attribute adjustment input such that the maximum volume value and the minimum volume value are matched to the uppermost part and the lowermost part of the touchable area 3010' You can set the touch area for the input. For this purpose, the controller 3500 can acquire the range of attribute values and set the touch area based on the obtained range. Then, the touch input for attribute adjustment can determine the uppermost coordinate value of the touch region and the touch coordinate value of the touch region with respect to the lowest value as the attribute value for the maximum value and the minimum value of the attribute value.

FIG. 62 is a diagram related to a third example of the touch input processing for adjusting the adjustment object attribute of the pointing device-integrated text input device 3000. FIG.

Referring to FIG. 62, when entering the attribute adjustment mode, the first touch input (hereinafter referred to as a 'first touch input' after the first entry into the specific mode is referred to as a 'start touch input' Quot; start touch coordinate value &quot;) may be matched with the current attribute value of the adjustment object attribute. That is, the controller 3500 may generate the attribute control input so that the start coordinate touch value and the current attribute value correspond to each other, and thereafter, adjust the attribute value as the change value with respect to the start coordinate touch value of the touch coordinate value.

63 is a diagram relating to a fourth example relating to touch input processing for adjusting an adjustment object attribute of the pointing device-integrated text input device 3000. [

Referring to FIG. 63, the pointing device-integrated text input apparatus 3000 displays a touch input successively from a touch input performed by a push input for a button 3100 to which an adjustment object attribute is assigned, It can be processed as a touch input for adjustment.

Specifically, when the user pushes the 'P' button 3100b indicating the playback attribute 12b of the media player, the pointing device-integrated text input device 3000 receives the push input from the 'P' button 3100b It is possible to acquire the touch input to be started. The controller 3500 may process the touch coordinate value of the touch input performed until the touch input is released as an attribute adjustment input.

Fig. 64 is a diagram related to a fifth example of processing of touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device 3000. Fig.

64, on the other hand, the pointing device-integrated text input apparatus 3000 may be configured to display a corresponding button successively from a touch input performed by a push input for a button 3100 to which an adjustment object attribute is assigned, The touch input on the touch panel 3100 can be processed as a touch input for attribute control.

Specifically, when the user pushes the 'P' button 3100b indicating the playback attribute 12b of the media player, the pointing device-integrated text input device 3000 receives the push input from the 'P' button 3100b It is possible to acquire the touch input to be started. The controller 3500 may then process the 'P' button 3100b as an attribute control input in response to a touch input sensed on the electrode 3130.

On the other hand, the sensing area provided by the single button may not be sufficiently wide at this time, in which case the attribute adjustment input may be processed based on the touch input drawing the clockwise rotation of the button or the touch input drawing the counterclockwise rotation . For example, the clockwise touch input may be an input for increasing the attribute value, and the counterclockwise touch input may be an input for decreasing the attribute value. More specifically, for example, the clockwise touch input is treated as an input to move the indicator on the progressive bar to the right and move the play point of the playback attribute 12b backward, and the counterclockwise touch input to turn the indicator on the progressive bar to the left And moves the play point of the playback attribute 12b forward.

65 is a diagram relating to a sixth example relating to processing of touch input for adjustment of an adjustment object attribute of the pointing device-integrated text input device 3000. Fig.

According to the sixth example, referring to FIG. 65, in the case of an attribute to be adjusted having a two-dimensional attribute value, a touch area for receiving a touch input for adjusting the touch attribute may also be set to a two-dimensional plane shape. That is, the touch area in the attribute adjustment mode matching the area of the graphic object that reflects the two-dimensional attribute value can be set. In Fig. 65, the color plane 12c and the entire touchable area 3010 'can be matched with each other.

Fig. 66 is a diagram relating to a seventh example relating to the touch input processing for adjusting the adjustment object attribute of the pointing device-integrated text input device 3000. Fig.

According to the seventh example, referring to FIG. 66, in the case of an attribute to be adjusted having a two-dimensional attribute value, a touch area for receiving a touch input for adjusting the touch attribute may also be set to a two-dimensional plane shape. That is, the touch area in the attribute adjustment mode matching the area of the graphic object that reflects the two-dimensional attribute value can be set. In Fig. 66, a touch area in which the touch coordinate value of each individual touch is matched with the position of the pointer P on the color plane 12c can be set.

Several examples have been described above for processing the touch input as attribute control input. However, it should be noted that the manner in which the touch input is processed as the attribute control input is not limited to the above example.

Hereinafter, some methods by which the pointing device-integrated text input device 3000 adjusts the attribute value of the adjustment object attribute will be described.

67 is a flowchart of an example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. [

67, the method includes a step S3610 of entering a touch input mode, a step S3620 of obtaining a push input indicating an adjustment object attribute, a step S3630 of activating an adjustment object attribute, (S3640) of acquiring the touch target and adjusting (S3650) the adjustment target attribute based on the touch input.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 enters the touch input mode (S3610). At this time, the touch input mode may correspond to the mouse mode or the digitizer mode described above. Here, the pointing device-integrated text input device 3000 can activate the electronic device 3130 to sense the touch input. However, the pointing device-integrated text input device 3000 does not completely disable the switch 3200 but activates the switch 3200 for the buttons 3100 to which at least an attribute to be adjusted is assigned.

The pointing device-integrated text input device 3000 may acquire a push input indicating an adjustment target attribute (S3620). When a push input is received in the button 3100 to which the adjustment target attribute is assigned to the key value or the key identifier among the activated buttons 3100, the controller 3500 acquires the corresponding key value or key identifier, The target attribute can be activated (S3630). Upon activation, may invoke the corresponding adjustment object attribute or may transmit a signal requesting display of the graphic object of the adjustment object attribute to the electronic device side.

When the pointing device-integrated text input apparatus 3000 activates the adjustment object attribute or the pointing device-integrated text input apparatus 3000 enters the attribute adjustment mode for the corresponding adjustment object attribute, the touch input is acquired (S3640) The adjustment target attribute can be adjusted based on the touch input (S3650). The controller 3500 of the pointing device-integrated text input device 3000 may generate an attribute control input based on the touch coordinate value and transmit it to the subject using the pointing device-integrated text input device 3000 as an input interface.

68 is a flowchart of another example of a method of adjusting an adjustment object attribute of the pointing device-integrated text input device 3000. [

68, the method includes a step S3710 of obtaining a key identifier according to a push input, a step S3720 of determining a mode, a step S3730 of obtaining a character value corresponding to a key identifier, A step S3740 of determining an assigned key value, a step S3750 of obtaining a touch input, and a step S3760 of adjusting an adjustment object attribute based on the touch input.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 may acquire the key identifier according to the push input (S3710). More specifically, the controller 3500 receives the key identifier from the switch 3200 receiving the push input.

Next, the pointing device-integrated text input device 3000 can determine the mode (S3720). Specifically, the controller 3500 can determine whether the current mode is the touch mode or the keyboard mode.

In the case of the keyboard mode, the pointing device-integrated text input apparatus 3000 can acquire a character value corresponding to the key identifier as a key value (S3730). This key value is transmitted to the electronic device side in the form of a keyboard input and can be used for text input.

In the case of the touch mode, the pointing device-integrated text input apparatus 3000 can acquire the adjustment target attribute assigned to the key identifier (S3740). The pointing device-integrated text input apparatus 3000 can adjust the attribute value of the adjustment object attribute based on the touch input (S3750) obtained subsequently (S3760). The adjustment of the attribute value may be performed by the pointing device-integrated text input device 3000 generating attribute control input using the touch coordinate value of the touch input and transmitting it to the electronic device.

69 is a flowchart of another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. [

69, the method includes a step S3810 of obtaining a push input indicating an adjustment object attribute, a step S3820 of obtaining a touch input, a step S3830 of calculating a touch coordinate value, A step S3840 of correcting the touch coordinate value based on the adjustment direction, and a step S3850 of adjusting the adjustment object attribute in accordance with the corrected touch coordinate value.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 acquires a push input indicating an attribute to be adjusted (S3810), acquires a touch input thereafter (S3820), and the controller 3500 can calculate the touch coordinate value (S3830 ).

Next, the pointing device-integrated text input device 3000 can correct the touch coordinate value based on the adjustment direction of the adjustment target attribute (S3840). In general, the touch input is represented by a two-dimensional touch coordinate value. In the case of an adjustment object attribute having a one-dimensional attribute value, the controller 3500 corrects the touch coordinate value to a one-dimensional coordinate value in accordance with the property adjustment direction of the adjustment object attribute. can do.

When the touch coordinate value is corrected, the pointing device-integrated text input device 3000 can adjust the adjustment target attribute in accordance with the corrected touch coordinate value (S3850). When the controller 3500 generates an attribute control input in accordance with the corrected touch coordinate value and transmits the attribute control input to the electronic device, the attribute of the adjustment object attribute is adjusted according to the attribute control input on the electronic device side .

70 is a flowchart of yet another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. [

Referring to FIG. 70, the method includes a step S3910 of obtaining a push input indicating an attribute to be adjusted, a step S3920 of calculating a touch coordinate value of the start touch input, A step S3930 of obtaining a matching relation of touch coordinates of an input, and a step S3940 of adjusting an attribute value of an adjustment object attribute in accordance with a touch input in consideration of a matching relation.

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 may acquire a push input indicating an attribute to be adjusted (S3910) and obtain a start touch input.

When the start touch input is obtained, the pointing device-integrated text input device 3000 can calculate the start touch coordinate value (S3920).

Next, the pointing device-integrated text input device 3000 can generate a matching relationship between the current attribute value of the adjustment target attribute and the touch coordinate value of the start touch input (S3930). The controller 3500 may acquire the current property value and generate a matching table or a matching function that matches the starting touch coordinate value with the starting touch coordinate value.

When the matching relation is established, the pointing device-integrated text input apparatus 3000 can adjust the attribute value of the adjustment object attribute in accordance with the touch input in consideration of the matching relation (S3940).

On the other hand, here, the matching relation does not necessarily have to be set. Instead of forming a matching relationship, the pointing device-integrated text input apparatus 3000 may generate an attribute control input based on a difference value between a touch coordinate value of a start touch input and a touch coordinate value thereafter. This is because the touch coordinate variation value is calculated according to the difference between the current touch coordinate value and the starting touch coordinate value instead of performing the difference calculation of the touch coordinate value for each cycle of the scan signal, The effect can be the same as matching a value to an attribute value.

71 is a flowchart of yet another example of a method of adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. [

Referring to FIG. 71, the method includes a step S4010 of obtaining a push input indicating an attribute to be adjusted, a step S4020 of acquiring a matching relation between the range of the attribute to be adjusted and the touch region, And adjusting the attribute value of the adjustment target attribute in accordance with the input (S4030).

Hereinafter, each of the above-described steps will be described in more detail.

When the pointing device-integrated text input device 3000 acquires the push input indicating the attribute to be adjusted (S4010), the touching area can be set.

At this time, the pointing device-integrated text input apparatus 3000 can obtain the matching relation between the range of the adjustment object attribute and the touch region (S4020). For example, in the case of an attribute to be adjusted having a one-dimensional attribute value, the controller 3500 generates a matching relationship such that the maximum / minimum values of the attribute values are matched to the upper / lower ends or the left / Can be set. For example, the controller 3500 may match the maximum / minimum value of one of the two attribute values to the upper / lower end of the touch region in the case of the attribute to be adjusted having the two-dimensional attribute value, The minimum value can be matched to the left / right end of the touch area. Of course, it should be noted here that the touch area does not have to be set as the entire touchable area.

The pointing device-integrated text input apparatus 3000 can adjust the attribute value of the adjustment object attribute in accordance with the touch input in consideration of the matching relation (S4030). Since this has already been described above, the detailed description will be omitted.

In this specification, the pointing device-integrated text input device 3000 can sense the hovering input in addition to the key input and the touch input. Here, the hovering input may be an input in which a user places a finger or a body part near the upper portion of the button 3100, unlike the direct button 3100 and the touch input. Hereinafter, the touch input and the hovering input are collectively referred to as a gesture input.

72 is an example of a hovering input of the pointing device-integrated text input device 3000 of FIG.

In this specification, the pointing device-integrated text input device 3000 can sense the touch input by changing the electrostatic capacity of the electronic device 3130 included in the button 3100 according to a user's touch input. Here, when the user's body part (e.g., a finger) is placed on the button 3100, the electrostatic capacity of the electronic part 3130 included in the button 3100 may be changed although the amount of change is smaller than that of the touch input. The controller 3500 can acquire it through a scan signal and process it as a hovering input.

Referring to FIG. 72, although it is smaller than the capacitance change caused by the touch input, it can be seen that a change in the capacitance also occurs significantly when the hovering input is performed.

In particular, depending on the magnitude of the change in capacitance, in addition to the location on the plane of the hovering input, the user's body part may be sensed to a distance in a direction perpendicular to the keyboard layout from the keyboard surface.

That is, the controller 3500 calculates the value of (x, y) in the same manner as in the touch input based on the scan signal reflecting the change in capacitance, It is possible to judge the hovering input as a hovering input. In addition, the controller 3500 may calculate the z value (hovering coordinate value perpendicular to the keyboard layout) based on the magnitude of the capacitance change when it is determined that the hovering input is input.

Specifically, the controller 3500 senses the touch input when the amount of change in capacitance is larger than the touch input threshold value, and detects the hovering input when the amount of change in capacitance is equal to or less than the value of the touch input, can do.

As shown in FIG. 72, when the finger and the electrode 3130 are touched, the pointing device-integrated text input device 3000 can detect it as a touch input because the amount of change in capacitance is greater than the touch threshold value. In the case of the second hand and the third hand of FIG. 72 in which the finger and the electrode 3130 are disposed with a certain distance, the pointing device-integrated text input device 3000 hover Can be detected as an input.

In addition, when a distance between the finger and the electronic device 3130 is too long to detect a change in capacitance less than the hovering threshold value, the pointing device-integrated text input device 3000 can process it as no input.

In this specification, the pointing device-integrated text input device 3000 can control a plurality of electronic devices 20.

FIG. 73 is an example of a multi-device environment using the pointing device-integrated text input device 3000 of FIG.

Referring to FIG. 73, the pointing device-integrated text input device 3000 can control the first electronic device 21, the second electronic device 22, and the third electronic device 23. Here, the first to third electronic devices control the display independently of each other, and thus are electronic devices that control the pointer P on the screen 10 independently. Here, the plurality of electronic devices 20 may be electronic devices separate from the pointing device-integrated text input device 3000, but any one of the plurality of electronic devices 20 may be a pointing device-integrated text input device 3000 May be an embedded electronic device. In the following description, the first electronic device 21 and the third electronic device 23 are configured separately from the pointing device-integrated text input device 3000 for convenience of explanation, and the second electronic device 22 is a pointing device- The integrated text input device 3000 will be described as being provided integrally. It should be noted, however, that the multi-device environment is not limited in this context.

Referring again to FIG. 73, the pointing device-integrated text input device 3000 may operate as an input interface to any one of the plurality of electronic devices 20. FIG. For example, the pointing device-integrated text input device 3000 may operate as an input interface with respect to an electronic device having a first communication connection with the pointing device-integrated text input device 3000 among the plurality of electronic devices 20. If the second electronic device 22 is a notebook in which the pointing device-integrated text input device 3000 is embedded, the pointing device-integrated text input device 3000 can operate as an input interface to the second electronic device 22 have.

In this state, the pointing device-integrated text input device 3000 acquires a mouse input, a digitizer input, or a keyboard input input in a touch mode or a keyboard mode, and transmits it to the second electronic device 22. The second electronic device can move the pointer P on the screen 10 provided by the display connected to the second electronic device 22 based on the data transmitted from the pointing device integrated text input device 3000, Can be performed. That is, the pointing device-integrated text input device 3000 functions as an input interface to the second electronic device.

At this time, the pointing device-integrated text input device 3000 can sense the hovering input.

FIG. 74 is a diagram illustrating an example of selection of a control target device using a hovering input in the multi-device environment of FIG. 70; FIG.

Referring to FIG. 74, the pointing device-integrated text input device 3000 can input a hovering input in a touch mode. However, when the hovering input is recognized in the touch mode, the touch input operation may be inconvenient. Therefore, the text input device 3000 with a built-in pointing device can additionally have a hovering mode as its operation mode, Mode, the hovering input can be recognized.

When the hovering mode is entered, the pointing device-integrated text input device 3000 receives the hovering input, thereby detecting whether or not hovering is input based on the change in capacitance generated in the electronic device 3130, (x, y) hovering plane coordinate values. Of course, it is also possible to obtain further hovering height coordinate values in the z-axis direction at this time.

When the hovering coordinate value is obtained, the pointing device-integrated text input device 3000 can calculate the position of the virtual 3D pointer P according to the hovering coordinates. The touch coordinate value of the touch input indicates the movement of the pointer P in the screen 10 provided by the display of the electronic device coupled with the pointing device-integrated text input device 3000, while the hovering coordinate of the hovering input Value can be used to select a plurality of electronic devices 20 connectable to the pointing device-integrated text input device 3000. [

74, first, the pointing device-integrated text input device 3000 is operating as the input interface of the second electronic device 22. [ At this time, the touch input between the seventh touch input L5 and the eighth touch input L6 is used as an input for controlling the pointer P of the second electronic device 22 so that the pointer of the second electronic device 22 From the seventh position D5 to the eighth position D6 on the screen of the corresponding device.

In this situation, a hovering input can be performed after the eighth touch input L6. The hovering input may be from the eighth hovering input L6 to the ninth hovering input L7. The pointing device-integrated text input apparatus 3000 senses this hovering input, and accordingly detects the position on the virtual space corresponding to the ninth position D7 from the position on the space corresponding to the eighth position D6 in the three- .

Here, the position on the space corresponding to the eighth position D6 is the position indicating the second electronic device 22, and the position on the space corresponding to the ninth position D7 is the position indicating the third electronic device 23 .

When the touch input occurs in a state where the 3D pointer is at the position pointing to the third electronic device 23, the pointing device-integrated text input device 3000 transmits the control device to the electronic device currently indicated by the 3D pointer, It can be changed to the electronic device 23.

Accordingly, the pointing device-integrated text input device 3000 operates as the input interface of the third electronic device 23. Accordingly, the touch input from the ninth touch input L7 to the tenth touch input L10 is used for operating the pointer of the third electronic device 23, From the ninth position D7 to the tenth position D8 on the screen of the display device 23 as shown in Fig.

On the other hand, the hovering region 3020 can be divided into a plurality of sub-regions. At this time, the controller 3500 recognizes the number of peripheral electronic devices that can be connected to the pointing device-integrated text input device 3000 by wired or wireless, and displays the number of the electronic devices in the hovering area 3020) can be divided. Also, each of the sub regions may correspond to each of the plurality of electronic apparatuses 20.

FIG. 75 is a diagram illustrating another example of selection of a device to be controlled using a hovering input in the multi-device environment of FIG. 70; FIG.

75, for example, in a multi-device environment having two devices, the hovering area of the pointing device-integrated text input device 3000 may include a first area 3010a 'and a second area 3010a' ). Here, the first area 3010a 'is an area indicating the first electronic device 21, and the second area 3010a' 'may be an area indicating the second electronic device 22. [

When the pointing device-integrated text input device 3000 enters the hovering mode (or control electronic device selection mode), the controller 3500 can detect the hovering input and calculate the hovering coordinate value. When the hovering input moves within the hovering region 3020, the controller 3500 can track it in real time. If the user's body touches the touch area and generates a touch input during the hovering input, the user can select the electronic device 20 and the control target device assigned to the hovering area 3020 corresponding to the touch area where the corresponding touch input is generated.

The pointing device-integrated text input device 3000 operates as an input interface of the electronic device selected as the control target device. That is, when the pointing device-integrated text input device 3000 recognizes a keyboard input or a touch input, it can transmit a key value, a character value, or mouse input or touch information to the control target device.

In addition, in the present specification, the pointing device-integrated text input device 3000 is connected to the augmented reality or virtual reality device and acquires a hovering input for controlling the pointer P 'on the 3D space displayed as augmented reality or virtual reality can do.

FIG. 76 is a diagram illustrating another example of selection of a device to be controlled using a hovering input in the multi-device environment of FIG. 70; FIG.

In this example, a hovering area is set in the pointing device-integrated text input device 3000, and the hovering area 3020 is matched with a 3D space of a virtual or augmented reality provided by an HMD or the like.

The pointing device-integrated text input device 3000 may calculate the hovering coordinate value according to the hovering input and transmit it to the electronic device that controls the HMD or the HMD. The electronic device can use this hovering coordinate value to control the position of the pointer P in 3D space.

In this state, the pointing device-integrated text input device 3000 is positioned at a position pointing to one of the plurality of electronic devices 20 connectable to the pointing device-integrated text input device 3000 Upon receiving a touch input or a pointer execution command for the touch area, the electronic device 20 corresponding to the position is selected as the control target device, and can operate as an input interface to the control target device.

On the other hand, a VR or AR providing device such as an HMD can provide a virtual graphic object on a virtual space or augmented space.

In Fig. 76, the AR object 24 can be displayed by the HMD. In this state, when the virtual pointer P 'is moved to the position where the AR / VR object is located through the hovering input of the pointing device-integrated text input device 3000 and the touch input is received, the pointing device- The object indicated by the virtual pointer P 'can be selected as the control target object.

The touch input or the keyboard input performed later may be used to move a cursor or a pointer included in the object to be controlled or to transmit a keyboard input to the object to be controlled.

77 is a flowchart of an example of a multi-device control method of the pointing device-integrated text input device 3000. [

Referring to FIG. 77, the method includes obtaining a hovering input (S4110), calculating hovering coordinates (S4120), controlling a position of a virtual pointer in a three-dimensional space according to hovering coordinates (S4130) A step S4160 of obtaining a touch input, a step S4160 of controlling the position of a pointer on the screen of the control target device in response to a touch input, a step S4140 of selecting a control target device based on the position of the virtual pointer at the end, . &Lt; / RTI &gt;

Hereinafter, each of the above-described steps will be described in more detail.

The pointing device-integrated text input device 3000 may acquire a hovering input (S4110). At this time, the controller 3500 can determine whether the user input is the touch input or the hovering input, according to the change amount of the electrostatic capacitance, when the electrostatic capacity of the electrode 3130 changes due to user input.

When the hovering input is obtained, the pointing device-integrated text input device 3000 may calculate the hovering coordinates (S4120). The (x, y) coordinate value among the hovering coordinate values can be calculated similarly to the calculation of the touch coordinate value. The z coordinate value among the hovering coordinate values can be calculated based on the magnitude of the change amount of the capacitance. However, the z coordinate value among the hovering coordinate values is not necessarily calculated.

The pointing device-integrated text input device 3000 can control the position of the virtual pointer in the three-dimensional space according to the hovering coordinates (S4130). Here, a plurality of devices may be arranged in the virtual space.

The pointing device-integrated text input apparatus 3000 can select the control target device based on the position of the virtual pointer at the end of hovering (S4130). Here, the termination of hovering may refer to a case where a touch input is generated, or a case where the finger is far enough away from the pointing device-integrated text input device 3000 that the capacitance change is less than or equal to the hovering threshold value. However, the selection of the control target device may be a UI that is determined by the touch input more in accordance with the user's intention.

When the hovering ends, the controller 3500 can select the device pointed by the virtual pointer at the end of hovering as the control target device. When the control target device is selected, the pointing device-integrated text input device 3000 can operate with the input interface of the corresponding control target device.

Here, if hovering is terminated with the virtual pointer pointing to the VR / AR object, the pointing device-integrated text input device 3000 may operate as an input interface for the corresponding object.

Then, the pointing device-integrated text input device 3000 acquires the touch input or the keyboard input (S4140), thereby controlling the position of the pointer on the screen of the control target device or performing text input on the screen (S4150) .

The methods according to the embodiments of the present invention described above can be used alone or in combination with each other. Since each step described in the method according to the embodiment of the present invention is not essential, it is also possible that each method includes all of the steps as well as a part thereof. In addition, since the order in which the steps are described is merely for convenience of explanation, the steps in the method described in the present invention are not necessarily performed in the order described.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments of the present invention described above can be implemented separately or in combination.

Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

3000: pointing integrated text input device
3100: Button
3110: Keycaps
3120: Button body
3130: Electrode
3200: Switch
3300: electrical connection member
3400: Circuit
3500: Controller

Claims (8)

1. An electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment,
A key cap for receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, An electro-optic device for receiving a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction in the longitudinal direction and the width direction; A plurality of buttons each arranged according to the keyboard layout;
A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body;
A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group to receive a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the gesture input, An electrical connection member for electrically connecting the electrode; And
Acquiring a key value assigned to a button corresponding to a switch for acquiring the key input; determining the gesture input as a touch input when the amount of change in the capacitance is greater than a touch threshold value; And outputs a first signal indicating movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value, The hovering coordinate value is calculated from the change of the capacitance according to the hovering input, and the hovering coordinate value is calculated based on the calculated hovering coordinate value, A second signal indicating the movement of the virtual pointer on the virtual space, the actual space, or the enhancement space Containing; power controller for
Electronics.
The method according to claim 1,
The controller sets one of the output devices as a control target when the touch input is obtained in a state where a virtual pointer corresponding to the second signal is located at a position corresponding to one of the output devices
Electronics.
The method according to claim 1,
Wherein the multi-device environment further comprises a virtual or augmented object,
The controller sets the object as a control target when the touch input is obtained in a state where a virtual pointer corresponding to the second signal is located at a position corresponding to the virtual or augmented object
Electronics.
The method according to claim 1,
The multi-device environment further includes an HMD for processing a virtual reality or augmented reality
The second signal indicates a position of a virtual pointer displayed by the HMD
Electronics.

A control method of an electronic device having a composite human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment,
The electronic device includes: a keycap receiving a push input in a vertical direction from a user; A button body coupled to a lower portion of the keycap and being raised and lowered by the push input; And a first block group interposed between the key cap and the button body, the first block group being formed by blocks electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, Each of which receives a touch input from a user using a second block group formed by blocks electrically connected in a longitudinal direction and a width direction in a second direction different from the first direction, A plurality of buttons arranged according to a keyboard layout;
A plurality of switches arranged in the lower portion of the plurality of buttons according to the keyboard layout and obtaining a key input according to the descent of the button body; And
A drive line for electrically connecting the first block group to the plurality of buttons arranged in the first direction to apply a drive signal for inducing electrostatic capacitance to the electroded, To form a scan line for electrically connecting the second block group and receiving a scan signal for sensing a change in capacitance induced by the drive signal to the electrostatic capacitance by the touch input, And an electrical connection member for electrically connecting the electrode,
Obtaining a key value assigned to a button corresponding to a switch that has obtained the key input and outputting a keyboard input reflecting the key value;
Determining that the gesture input is a touch input when the amount of change in capacitance is greater than a touch threshold value;
Calculating a touch coordinate value from a change in the capacitance according to the touch input;
Outputting a first signal indicating movement of a pointer on a screen of a control target which is one of the plurality of output devices based on the calculated touch coordinate value;
Determining the gesture input as a hovering input if the amount of change in capacitance is less than the touch threshold value and greater than a hovering threshold; And
Calculating a hovering coordinate value from a change in the capacitance according to the hovering input;
And outputting a second signal indicating movement of the virtual pointer on the virtual space, actual space, or augmentation space based on the calculated hovering coordinate value
A method of controlling an electronic device.
6. The method of claim 5,
Obtaining the touch input in a state where a virtual pointer according to the second signal is at a position corresponding to any one of the output devices; And
And setting one of the output devices as a control target
A method of controlling an electronic device.
6. The method of claim 5,
Wherein the multi-device environment further comprises a virtual or augmented object,
Acquiring the touch input in a state where a virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object; And
And setting the object as a control object
A method of controlling an electronic device.
6. The method of claim 5,
The multi-device environment further includes an HMD for processing a virtual reality or augmented reality
The second signal indicates a position of a virtual pointer displayed by the HMD
A method of controlling an electronic device.

Images