JP2011170747A - Information input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information input device that does not disturb the work of a worker. <P>SOLUTION: A horizontal moving direction and moving distance of each finger are specified based on an acceleration signal detected by an acceleration sensor that can be attached to a position of the middle phalanx or proximal phalanx of each finger (S11). Whether the finger has stopped moving is determined (S13). When the finger has stopped moving (S13: YES), a bending angle of the finger is specified based on the acceleration signal (S15). Information on a key that is likely to be selected by keystroke operation (candidate key information) is specified from the bending angle of the finger and the horizontal moving direction and moving distance of the finger (S21). When keystroke operation is determined (S23: YES), the specified candidate key information is specified as key information selected by the keystroke operation (S25). <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information input device. More specifically, the present invention relates to an information input device that can input key information without using a keyboard.

  In recent years, information input devices capable of inputting key information without using a keyboard have been developed. For example, in the information input device of Patent Document 1, the intensity of output light from an LED (Light Emitting Diode) attached to a fingertip is detected by a light receiving unit provided on the back of the hand. The state of the finger is specified based on the intensity of light that changes according to the bending state of the finger. The key that has been pressed is determined from the specified state of the finger.

JP 2001-242986 A

  However, the above-described device requires an on / off switch to be attached to the tip of the finger. For this reason, unless the user makes sure that the fingertip is in contact with the desk surface or the like, the keystroke operation is not detected in the switch. Further, even when the key-pressing operation is not performed, when the fingertip touches the desk surface or the like, the key-pressing operation is detected by the switch. As described above, the above-described apparatus has a problem in that there is a high possibility of erroneous recognition regarding the input of key information.

  The objective of this invention is providing the information input device which can improve the recognition rate in the case of inputting information.

  The information input device according to the first aspect of the present invention is attachable at least to the position of the user's finger and is based on the first detection means for detecting acceleration and the acceleration detected by the first detection means. An angle specifying means for specifying a bending angle of the finger, a first storage means for storing the bending angle and key information indicating a predetermined key in association with each finger, and the first detecting means. A determination means for determining whether or not the finger has performed a predetermined motion based on the acceleration; and when the determination means determines that the finger has performed a predetermined motion, the turning angle specified by the angle specification means A key specifying unit that specifies the key information corresponding to each degree with reference to the first storage unit; and an output unit that outputs the key information specified by the key specifying unit. That.

  In the information input device according to the first aspect, the means for specifying the bending angle of the finger and the means for detecting a predetermined movement of the finger are realized by a common detection means. As a result, the information input device can reliably detect the keystroke operation. Further, it is possible to prevent a finger movement other than the keystroke action from being erroneously recognized as the keystroke action. Therefore, the information input device can improve the recognition rate when inputting information.

  Further, in the first aspect, the first detection means is a detection means different from the first detection means, the second detection means for detecting acceleration, and the first detection based on the acceleration detected by the second detection means. Reference specifying means for specifying a reference direction that is a reference of the direction of acceleration detected by the means, and the angle specifying means is based on the reference direction specified by the reference specifying means, and the bending angle of the finger May be specified. As a result, the information input device can specify the selected key information based on the bending angle of the finger and whether or not a predetermined operation (such as a keystroke operation) is performed without depending on the orientation of the user's hand. The user can perform the key information input operation in various states such as a state where the hand is placed on the desk or a state where the hand is lowered. Accordingly, the user can perform an input operation even when the hand is lowered while standing.

  Further, in the first aspect, it comprises a movement specifying means for specifying the movement direction and movement amount of the finger in the lateral direction of the palm, and the first storage means includes the bending angle, the movement direction, the movement amount, And the key information is stored in association with each other, and the key specifying means corresponds to the bending angle specified by the angle specifying means, the moving direction specified by the movement specifying means, and the moving amount. The key information to be specified may be specified with reference to the first storage means. As a result, the information input device can specify the selected key information using not only the bending angle of the finger but also the movement amount of the finger, so that the information input device can identify more key information.

  In the first aspect, the movement specifying unit may specify the movement direction and the movement amount based on the acceleration detected by the first detection unit. As a result, in the information input device, the movement amount is specified based on the acceleration detected by the first detection means, so that a separate device for specifying the movement amount becomes unnecessary.

  In the first aspect, the apparatus further comprises third detection means for detecting angular velocity, wherein the movement specifying means specifies the movement direction and the movement amount based on the angular velocity detected by the third detection means. Also good. In the information input device, the movement amount is specified based on the angular velocity detected by the third detection means. Since the rotational movement of the hand can be accurately detected, the information input device can accurately identify the selected key information from the operation accompanied by the rotational movement of the hand by the user.

  In the first aspect, the third detection means may be attachable to the position of the thumb or the back of the hand of the user's finger. When the third detection means is attached to the position of the thumb or the back of the hand, the user can input more key information by combining the rotational movement of the thumb or the back of the hand with a predetermined movement by another finger. The user can perform various input operations by combining the rotational motion of the thumb or back of the hand with the motion of another finger.

  Further, in the first aspect, the first detection means may be attachable to the position of the middle clause or the root clause of the user's finger. The acceleration sensor is attached to the middle or base joint of the finger and is not attached to the last joint. Therefore, when the user performs an operation using the tip portion of the finger, the apparatus can be prevented from interfering with the operation.

  In the first aspect, the predetermined operation may be an operation in which the finger hits a key. As a result, the user can input key information without using the keyboard.

  In the first aspect, the first detection means may be attachable to each finger position of both hands of the user. As a result, the user can input key information using all fingers of both hands.

  Further, in the first aspect, the output means specifies candidate key information that is the key information corresponding to the bend angle specified by the angle specifying means and the key information specified by the key specifying means. Key information may be output. As a result, the user can confirm the candidate key information before performing the keystroke operation, so that the desired key information can be reliably input.

1 is a schematic diagram showing an information input system 1. FIG. It is the figure which showed the screen displayed on the display of PC4. It is a figure which shows the direction of the acceleration detected in the 1st sensor 5 and the 2nd sensor 6. FIG. It is a figure which shows the direction of the acceleration detected in the 1st sensor 5 and the 2nd sensor 6. FIG. It is a figure which shows the acceleration detected from the 1st sensor 5 at the time of pressing operation. It is a figure which shows the direction of the acceleration detected in the 1st sensor 5 and the 2nd sensor 6. FIG. It is a figure which shows the acceleration detected from the 1st sensor 5 at the time of left direction movement. It is a figure which shows the acceleration detected from the 1st sensor 5 at the time of rightward movement. It is the figure which showed a mode that a key was selected. It is a figure which shows the acceleration detected from the 1st sensor 5 at the time of a keystroke operation | movement. 3 is a block diagram showing an electrical configuration of the first input device 2. FIG. 3 is a block diagram showing an electrical configuration of a second input device 3. FIG. It is a schematic diagram which shows the 1st table 4811. FIG. It is a schematic diagram which shows the 2nd table 4821. FIG. 4 is a flowchart showing main processing executed by a CPU 31 of the first input device 2. 7 is a flowchart showing main processing executed by a CPU 41 of the second input device 3. It is a flowchart which shows a movement calculation process. It is the figure which showed a mode that the key was selected in the modification. It is a schematic diagram which shows the 3rd table 4841. FIG. It is a flowchart which shows the movement calculation process in a modification.

  Hereinafter, an information input system 1 and information input devices (first input device 2 and second input device 3) according to an embodiment of the present invention will be described with reference to the drawings. These drawings are used to explain technical features that can be adopted by the present invention. The configuration of the apparatus, the flowcharts of various processes, and the like that are described are not intended to be limited to only that, but are merely illustrative examples.

  An overview of the information input system 1 will be described with reference to FIG. The information input system 1 includes an information input device and a PC 4. The information input device includes a first input device 2 and a second input device 3. The first input device 2 has a glove shape and is attached to the user's hand. In FIG. 1, a first input device 2 for the right hand and a first input device 2 for the left hand are prepared. The user performs a keystroke operation on the keyboard. The sensor included in the first input device 2 detects an acceleration signal. The detected acceleration signal data is transmitted to the second input device 3. In the second input device 3, the data is analyzed, and information on the key type selected by the keystroke operation is specified (hereinafter, the key type information is referred to as “key information”). The identified key information is transmitted to the PC 4. The PC 4 displays the key information received from the second input device 3 on the display. The user can input key information without using a keyboard. Hereinafter, when the user of the information input device performs a keystroke operation without using the keyboard, it is simply referred to as “perform a keystroke operation”. The keystroke operation indicates an operation in which a finger presses a key.

  Details of the first input device 2 will be described. The first input device 2 includes a glove part 13 having a glove shape. An acceleration sensor (hereinafter referred to as “first sensor 5”) is attached to the glove part 13. The first sensor 5 detects an acceleration signal during a keystroke operation (hereinafter, the acceleration signal is also simply referred to as “signal”). Since the 1st sensor 5 is attached to each finger among the glove parts 13, the user can perform information input operation using each finger. In addition, the first sensor 5 can be attached at the position of the middle or base of the finger. Therefore, even when the user uses the tip portion of the finger while the first input device 2 is attached to the user, the device does not interfere with the operation. An acceleration sensor (hereinafter referred to as “second sensor 6”) is attached to the position of the back of the hand in the glove part 13. The second sensor 6 is provided to specify a reference direction of acceleration detected by the first sensor 5 (details will be described later).

  The first input device 2 includes a control unit 11 at the wrist portion of the glove unit 13. The sensors 5 and 6 and the control unit 11 are connected by a harness 7. Signals detected by the sensors 5 and 6 are transmitted to the control unit 11 via the harness 7. The control unit 11 includes an antenna 36 (see FIG. 11). The control unit 11 collects signals detected by the sensors 5 and 6 and wirelessly transmits the signals to the second input device 3. The control unit 11 includes a display unit 12. The display unit 12 is composed of LEDs. The display unit 12 can notify the user of the state of the first input device 2 and the like.

  Details of the second input device 3 will be described. The second input device 3 includes an antenna 45 and an antenna 47 (see FIG. 12). The second input device 3 receives the signal wirelessly transmitted from the first input device 2 via the antenna 45. The information input device 3 wirelessly transmits key information to the PC 4 via the antenna 47. The second input device 3 includes a display unit 21. The display unit 21 is composed of LEDs. The display unit 21 can notify the user of the state of the second input device 3 and the like. The second input device 3 includes an input unit 22. The user can input the operation mode of the second input device 3 via the input unit 22.

  An example of a screen displayed on the display of the PC 4 when the PC 4 receives key information transmitted from the second input device 3 will be described with reference to FIG. An image 26 and an image 27 are displayed on the display. The image 26 is an image illustrating a keyboard. The image 27 shows an area in which key information selected by the keystroke operation is displayed as text. Of the image 26, portions “A” (left hand little finger) “S” (left hand ring finger) “E” (left hand middle finger) “G” (left hand index finger) corresponding to a key that may be selected by the user's keystroke operation ) The color of “J” (right hand index finger) “I” (right hand middle finger) “O” (right hand ring finger) “0” (right hand little finger) “Space” (right hand and left hand thumb) is inverted. In the image 27, a history of key information selected by the keystroke operation is displayed. The user can recognize key information in a selectable state by a keystroke operation by visually recognizing the display of the PC 4. As a result, the user can confirm a key that may be selected before performing the key-pressing operation, so that a desired key can be reliably input. Further, the user can recognize the history “qazwsxedc...” Of the key information selected by the keystroke operation.

  In this invention, the image displayed on the display of PC4 is not limited to the aspect mentioned above. In the present invention, the received key information may be directly recognized as input information, for example, in an application (word processor software, spreadsheet software, etc.) being executed on the PC 4.

  For example, the information input device of the present invention may have a configuration including only the first input device 2 that is worn on one hand. The first sensor 5 may be attached to only one finger of the glove part 13. Communication between the sensors 5 and 6 and the control unit 11 is not limited to wired communication via the harness 7, and may be wireless communication. The communication between the first input device 2 and the second input device 3 and the communication between the second input device 3 and the PC 4 are not limited to wireless communication, but may be wired communication. The information input device may have a configuration in which the first input device 2 and the second input device 3 are integrated.

  A method for specifying the key information selected by the keystroke operation based on the detected signal will be described with reference to FIGS. In the present embodiment, the sensor 5 indicates that the user wearing the first input device 2 is 1) the bending angle of the finger, and 2) the movement direction and movement amount of the finger in the lateral direction (corresponding to the left-right direction of the palm). , 6 based on the signal detected at 6. Key information (hereinafter referred to as “candidate key information”) that may be selected by the user's keystroke operation is identified from the identified information 1) and 2). In addition, the presence or absence of a keystroke operation is specified based on signals detected by the sensors 5 and 6. Candidate key information when the keystroke operation is executed is specified as key information selected by the keystroke operation. The details will be described below.

  A method for specifying the bending angle of the finger will be described with reference to FIGS. In FIG. 3, the left-right direction on the paper surface is defined as “x-axis direction”. The direction from the front side to the back side of the page is defined as “y-axis direction”. The vertical direction of the page is defined as the “z-axis direction”. The wrist-to-finger direction corresponds to the x-axis direction in a state where the palm is horizontally disposed and the finger is extended. The left-right direction of the palm corresponds to the y-axis direction. The direction from the palm to the back of the hand corresponds to the z-axis.

  The sensors 5 and 6 can detect acceleration signals in three directions. As shown in FIG. 3, the sensors 5 and 6 can detect acceleration signals in the x, y, and z axis directions in a state where the palm is horizontally placed and the finger is extended. The three-direction acceleration signals detected by the first sensor 5 are hereinafter referred to as “Px”, “Py”, and “Pz”, respectively. The three-direction acceleration signals detected by the second sensor 6 are hereinafter referred to as “Px ′”, “Py ′”, and “Pz ′”, respectively. The sensors 5 and 6 are subjected to gravitational acceleration (hereinafter also referred to as “g”) in the z-axis direction while the hands are stationary. In the example shown in FIG. 3, Pz detected from the first sensor 5 and Pz ′ detected from the second sensor 6 match g.

  As shown in FIG. 4, it is assumed that the user bends the finger by an angle θ. In the process of bending the finger, the arrangement (orientation) of the first sensor 5 gradually changes. As the finger bending angle θ increases, Px increases. The acceleration acting on the first sensor 5 in the z-axis direction is substantially unchanged (= g) in the bending process. The acceleration g acting on the first sensor 5 in the z-axis direction coincides with the resultant force of Px and Pz detected by the first sensor 5. Therefore, Pz decreases as the finger bending angle θ increases.

  It is assumed that the bending of the finger is completed, and then the user has returned the finger (extended). In the process of extending the finger, Px decreases as the finger bending angle θ decreases. Pz increases as the finger bending angle θ decreases. When the finger is fully extended, Pz and g again match (see FIG. 3).

  FIG. 5 shows the change with time of Pz detected by the first sensor 5 when the finger is bent and then extended. When the finger is stationary with the finger stretched, Pz changes at a substantially constant value (61). The user starts bending the finger (62). In the process of bending the finger, Pz greatly decreases (63). The user ends the bending of the finger (64). The finger rests in a bent state. When the finger is stationary, the amount of change in Pz is small (65). The user starts finger extension (66). In the process of extending the finger, Pz greatly increases (67). The user ends the extension of the finger (68). The finger rests in the stretched state. When the finger is stationary, the amount of change in Pz is small (69).

  Note that FIG. 5 includes information on the acceleration when the keystroke operation is executed with the finger bent (70). The user selects a predetermined key by performing a pressing operation (bending a finger → pressing a key). When the keystroke operation is performed, the change with time of Pz shows a steep fluctuation in a short time. A method for detecting the keystroke operation will be described later.

In a state where the finger is bent, the bending angle θ of the finger and Pz detected by the first sensor 5 are
Pz / g = cos θ (1)
Satisfy the relationship. Therefore, the information input device can specify the bending angle θ of the finger by substituting Pz detected by the first sensor 5 into the equation (1).

  In the present embodiment, the arrangement (orientation) of the palm is specified based on the signal detected by the second sensor 6. The calculated finger bending angle θ is corrected based on the specified palm arrangement (orientation). The corrected θ (hereinafter referred to as “θ ′”) is specified as the actual bending angle of the finger. Specifically, θ is corrected as follows.

As shown in FIG. 6, it is assumed that the user changes the arrangement (orientation) of the palm. Px ′, Py ′, and Pz ′ detected from the second sensor 6 vary in accordance with the change in arrangement (orientation). In the information input device, the direction of Px ′ detected by the second sensor 6 (hereinafter referred to as “reference direction”; hereinafter referred to as “reference direction”) is tracked by tracking the changes in Px ′, Py ′, and Pz ′. Equivalent) is specified in which direction. The reference direction indicates the extending direction of the finger when the finger is extended. The bending angle θ obtained by the above equation (1) indicates an angle between the x-axis direction and the direction of action of Px. Therefore, when the palm arrangement (orientation) changes, the actual bending angle θ ′ of the finger is calculated by dividing the angle (corresponding to s) between the x-axis direction and the reference direction from the above θ. Is done.
θ ′ = θ−s (2)
By performing the correction described above, the information input device can specify the bending angle of the finger without depending on the arrangement (orientation) of the palm. Therefore, the user of the information input device can perform the key information input operation even in a state in which the arrangement (orientation) of the hand is variously changed such as a state where the hand is placed on the desk or a state where the hand is lowered. Accordingly, the user can perform an input operation even when the hand is lowered while standing.

  In the present invention, the bending angle of the finger may be specified by a method other than that described above. For example, the information input device may specify the bending angle of the finger by an angular velocity sensor that can detect the angular velocity.

  With reference to FIGS. 7 and 8, a method for specifying the movement direction and movement amount in the lateral direction of the finger (corresponding to the left-right direction of the palm) will be described. The lateral movement direction and movement amount of the finger are specified based on Py detected by the first sensor 5. In the information input device, by determining whether or not the detected Py shows a predetermined change with time, the movement direction of the finger in the left-right direction is specified. In the information input device, the amount of movement of the finger in the lateral direction is specified by performing an integral operation on a curve indicating a change in Py with time.

  FIG. 7 shows a change with time of Py when the first sensor 5 moves leftward. FIG. 8 shows a change with time of Py when the first sensor 5 moves rightward. The information input device determines that the finger has moved leftward when Py shows a change over time as shown in FIG. The information input device determines that the finger has moved to the right when the detected Py shows a change with time as shown in FIG. The determination as to whether or not Py detected by the first sensor 5 corresponds to the change with time shown in FIGS. 7 and 8 is performed by, for example, a well-known pattern matching.

  When it is determined that the finger has moved in either the left or right direction, the noise component is removed by passing Py through a low-pass filter. Thereafter, the integration process is executed twice on the curve indicating the change with time of Py from which the noise component has been removed. The result calculated by the integration process is specified as the movement amount of the finger.

  As described above, the information input device specifies the moving direction and the moving amount from the acceleration signal detected by the first sensor 5. A sensor for specifying the bending angle of the finger and a sensor for specifying the moving direction and the moving amount can be shared. Therefore, the information input device does not need to be provided with a separate sensor for specifying the movement amount.

  In the above description, the method for specifying the moving direction of the finger by pattern matching is exemplified, but the present invention is not limited to this method. For example, the moving direction of the finger may be specified from the detected change tendency of Py. For example, when Py shows a steep decrease tendency and then shows a steep increase tendency, it may be determined that the finger has moved leftward. When Py shows a steep increasing tendency and then shows a steep decreasing tendency, it may be determined that the finger has moved to the right.

  A method for specifying candidate key information based on the information 1) and 2) described above will be described with reference to FIG. 9 corresponds to the “x-axis direction” in FIGS. 3 to 5. The vertical direction of the paper corresponds to the “y-axis direction” in FIGS. The direction from the front side to the back side of the paper corresponds to the “z-axis direction” in FIGS. In FIG. 9, a key array 71 (QWERTY array) virtually shows key information selected by the user's keystroke operation. In the key array 71, the left-right direction on the paper surface is called "row", and the up-down direction on the paper surface is called "column". The key array 71 includes 5 rows (first row “half-width” “1” “2”..., Second row “Tab” “Q” “W”...), 14 rows (first row “half-width”. ”“ Tab ”“ Cap ”..., Second column“ 1 ”“ Q ”“ A ”. The user inputs desired key information by performing a keystroke operation at the position of each key information indicated in the key array 71.

  Each of the left and right fingers is assigned in advance to any column of the key array 71. The allocation information is stored in the first table (see FIG. 13, details will be described later). For example, the left little finger is assigned to the first column and the second column. The left hand ring finger is assigned to the third column. The left hand index finger is assigned to the fifth and sixth columns.

  Based on the bending angle of the finger specified above, rows that can be selected by the keystroke operation in the key array 71 are specified. When the bending angle of the finger is the smallest (the finger is stretched), the fingertip is located at the position farthest away from the user in the y-axis direction. A row is identified. As the finger bending angle θ increases, the fingertip is gradually positioned closer to the y-axis direction from the user, so that the second, third,. Is identified. When the finger bending angle θ is the largest, the fingertip is located at a location closest to the user in the y-axis direction, and therefore the fifth row is specified as a row that can be selected by the keystroke operation. Key information uniquely determined from the identified row and the column assigned to each finger is identified as candidate key information. The relationship between the bending angle of the finger and the rows that can be selected by the keystroke operation is stored in the second table (see FIG. 14, details will be described later).

  When a plurality of columns of the key array 71 are assigned to one finger (little finger, index finger), selection is made by a keystroke operation based on the lateral movement direction and movement amount of the finger specified above. Possible columns are selected. When the finger is moving in the left direction, the column arranged on the left side is selected as a selectable column by the keystroke operation. When the finger is moving in the right direction, the column arranged on the right side is selected as a selectable column by the keystroke operation. When three or more columns are assigned to one finger, a column that can be selected by the keystroke operation is selected based on the movement amount.

  For example, the left hand ring finger 72 is assigned key information (“2”, “W”, “S” (not shown), “X” (not shown), “Alt” (not shown)) in the key array 71. ing. Here, when the bending angle θ of the left hand ring finger 72 is the smallest, the first row is specified, and thus the key information “2” at the position of the first row and the third column is specified as candidate key information. On the other hand, when the bending angle θ of the left-handed ring finger is the largest, the fifth row is specified, so the key information “Alt” at the position of the fifth row and the third column is specified as candidate key information.

  For example, the left hand little finger 73 includes key information “half-width”, “Tab”, “Cap”, “Shft”, “Ctrl” in the first column of the key arrangement 71 and key information “1”, “Q”, “A” in the second column. “Z” and “(None)” are assigned. If the left hand little finger 73 is moving leftward (76), the first column is specified. When the bending angle of the left hand little finger 73 is the smallest, the first row is specified, so the key information “half-width” in the first row and first column is specified as candidate key information. On the other hand, when the left hand little finger 73 is moving in the right direction, the second column is specified. Then, when the bending angle of the left hand little finger 73 is the smallest, the first row is specified, so the key information “1” in the first row and the second column is specified as candidate key information.

  Further, for example, the eleventh column (“0” “P”...) To the fourteenth column (“BS” “Etr”...) Of the key arrangement is assigned to the right hand little finger 77. Here, when the bending angle of the right hand little finger 77 is the smallest, the first row is selected. The column direction is specified based on the amount of movement of the right hand little finger 77 in the right direction. As the amount of movement in the right-hand direction increases (79), “0”, “−”, “^”, and “BS” are specified as candidate key information.

  With reference to FIG. 10, a method for detecting a finger pressing action will be described. The keystroke operation is specified from Pz detected by the first sensor 5. In the information input device, when the pressing operation is performed, it is determined whether or not the keystroke operation is performed by determining whether or not Pz shows a predetermined change with time.

  FIG. 10 shows a change with time of Pz when the finger performs a keystroke operation. In FIG. 10, the temporal change (70, see FIG. 5) of Pz before and after the keystroke operation is performed in FIG. 5 is shown in an enlarged manner. As shown in FIG. 10, when a keystroke operation is performed, Pz shows a steep fluctuation tendency in a short time. When the detected Pz shows a change with time as shown in FIG. 10, the information input device determines that the keystroke operation has been executed. The determination as to whether or not Pz detected by the first sensor 5 corresponds to the change over time shown in FIG. 10 is performed by, for example, a well-known pattern matching.

  In the present embodiment, the candidate key information specified at the time when it is determined that the key pressing operation has been executed is specified as the key information actually selected by the user through the key pressing operation. The operation of the finger of the user at the time of the keystroke operation is slightly different for each user even when the same key information is selected. Therefore, when the key information selected by the user's keystroke operation is specified by the acceleration signal matching process at the time of the keystroke operation, there is a high possibility that incorrect key information is specified. On the other hand, in this embodiment, first, candidate key information is specified from the bending angle of the finger, the moving direction and the moving amount of the finger. And the candidate key information at the time of keystroke operation is specified as the key information selected by the user. The difference in the operation of each user is small in the bending angle of the finger, the movement of the finger, and the keying operation during the keying operation. Therefore, the information input device can accurately specify the key information selected by the user. Moreover, since the information input device can specify key information based on a plurality of parameters such as the bending angle of the finger, the moving direction, and the moving amount, it can identify more key information.

  In the above description, the method of determining whether or not the keystroke operation has been executed by pattern matching is exemplified, but the present invention is not limited to this method. For example, when the detected maximum value and minimum value of Pz are extracted and the difference is equal to or greater than a predetermined threshold, it may be determined that the keystroke operation has been performed.

  The electrical configuration of the information input device will be described with reference to FIGS. The electrical configuration of the first input device 2 will be described with reference to FIG. The first input device 2 includes a CPU 31. The CPU 31 manages the acquisition process of acceleration signals detected from the sensors 5 and 6 and the transmission process of acceleration signals. The first input device 2 includes a ROM 32 and a RAM 33. The ROM 32 stores at least a program, initial setting information, and parameters required when the CPU 31 is driven. The RAM 33 stores a timer, a counter, and the like. The CPU 31 is electrically connected to the ROM 32 and the RAM 33 via the bus 37. The CPU 31 can access the storage areas of the ROM 32 and the RAM 33.

  The first input device 2 includes the sensors 5 and 6 and the A / D converter 34 described above. The A / D converter 34 converts the analog signal (acceleration signal) output from the sensors 5 and 6 into a digital signal. The sensors 5 and 6 are electrically connected to the A / D converter 34. The A / D converter 34 is electrically connected to the CPU 31. The CPU 31 can detect the acceleration signal detected by the sensors 5 and 6.

  The first input device 2 includes an RF module 35 and an antenna 36. The RF module 35 performs modulation control. The antenna 36 performs wireless transmission / reception. The CPU 31 is electrically connected to the RF module 35. The RF module 35 is electrically connected to the antenna 36. The CPU 31 can perform wireless communication with the second input device 3 via the antenna 36.

  The first input device 2 includes a display unit 12. The display unit 12 can notify the user of the state of the first input device 2 and the like. The CPU 31 is electrically connected to the display unit 12. The CPU 31 can display desired information on the display unit 12.

  The electrical configuration of the second input device 3 will be described with reference to FIG. The second input device 3 includes a CPU 41. The CPU 41 controls the acceleration signal reception, analysis, and communication control. The second input device 3 includes a ROM 42 and a RAM 43. The ROM 42 stores initial setting information, parameter information, and the like. The RAM 43 stores a timer, a counter, and the like. The second input device 3 includes a flash memory 48. The flash memory 48 stores at least a table described later. The CPU 41 is electrically connected to the ROM 42, RAM 43, and flash memory 48 via the bus 49. The CPU 41 can access storage areas of the ROM 42, the RAM 43, and the flash memory 48.

  The second input device 3 includes an RF module 44 and an antenna 45. The RF module 44 performs modulation / demodulation control. The antenna 45 can perform wireless transmission / reception with the first input device 2. The CPU 41 is electrically connected to the RF module 44. The RF module 44 is electrically connected to the antenna 45. The CPU 41 can perform wireless communication with the first input device 2 via the antenna 45.

  The second input device 3 includes an RF module 46 and an antenna 47. The RF module 46 performs modulation / demodulation control. The antenna 47 can perform wireless transmission / reception with the PC 4. The CPU 41 is electrically connected to the RF module 46. The RF module 46 is electrically connected to the antenna 47. The CPU 41 can perform wireless communication with the PC 4 via the antenna 47.

  The second input device 3 includes a display unit 21. The display unit 21 can notify the user of the state of the second input device 3 and the like. The CPU 41 is connected to the display unit 21. The CPU 41 can display desired information on the display unit 21. The second input device 3 includes an input unit 22. The input unit 22 is an input device that can be input by the user. The CPU 41 is connected to the input unit 22. The CPU 41 can recognize the content input by the user.

  A storage area provided in the flash memory 48 will be described. The flash memory 48 includes at least a first table storage area 481, a second table storage area 482, a program storage area 483, and other information storage areas 484. The first table is stored in the first table storage area 481. The second table storage area 482 stores the second table. In the program storage area 483, various programs of the CPU 41 are stored.

  An example (first table 4811) of the first table stored in the first table storage area 481 will be described with reference to FIG. In the first table 4811, each column (first column to sixth column) of the key arrangement 71 (see FIG. 9) and “Sp” are assigned to each finger (little finger, ring finger, middle finger, index finger, thumb). Is remembered. A movement direction and a movement amount are associated with a finger (index finger, little finger) to which two or more columns are assigned. Key information is uniquely defined for rows and columns. The first table 4811 stores information about the left finger. The first table corresponding to the right finger is omitted.

  For example, the little finger includes the first column (in order from the first row, “half-width”, “Tab”, “Cap”, “Shift”, “Ctrl”) and the second column (in order from the first row, “1”, “Q”, “A”). "Z") key information is assigned. When the little finger is moving in the left direction by ○ cm, the first column is selected. If the little finger is moving ◎ cm to the right, the second column is selected. The index finger includes the fifth column (in order from the first row, “4”, “R”, “F”, “V”) and the sixth column (in order from the first row, “5”, “T”, “G”, “B”). ) Key information is assigned. If the index finger has moved Δcm to the left, the fifth column is selected. If the index finger has moved □ cm to the right, the sixth column is selected. The columns assigned to the fingers correspond to the columns of the key array 71 that can be selected by the keystroke operation of each finger (hereinafter referred to as “keystrokeable columns”).

  In the above description, when two or more columns are assigned to the finger, it is possible to prevent frequent change of the key-capable sequence by providing another threshold value for each column. For example, in a state where the little finger moves leftward by ｃｍcm and the first row is selected as a key-capable row, the second row is not selected as a key-capable row unless the little finger moves ◎ cm to the right.

  An example of the second table (second table 4821) stored in the second table storage area 482 will be described with reference to FIG. In the second table 4821, the bending angle of the finger in association with each row (first to fifth rows) of the key arrangement 71 (see FIG. 9) and each finger (little finger, ring finger, middle finger, index finger, thumb). Is stored. The second table 4821 stores information about the left finger. The second table corresponding to the right finger is omitted.

  In the second table 4821, the “little finger” and the “first row” are associated with the turning angle “0 to 10 °”. The “little finger” and the “second row” are associated with the turning angle “5 to 15 °”. The bending angle “10 to 20 °” is associated with “little finger” and “third row”.

  In this embodiment, the range corresponding to the bending angle is prevented from frequently changing by overlapping the range of the bending angle. For example, when the bending angle of the left hand little finger is 0 to 10 °, the first row is selected as the row of the key arrangement 71 that can be selected by the user by the keystroke operation of the left hand little finger (hereinafter selected by the keystroke operation). A possible line is called a “key-capable line”). Here, it is assumed that the bending angle of the left hand little finger changes from 0 to 10 ° to 11 ° or more. In this case, the keying possible line of the left little finger is changed from the first line to the second line. Thereafter, in the state where the bending angle of the left hand little finger is 5 ° to 15 °, the second row is continuously selected as the key-capable row of the left hand little finger. It is assumed that the bending angle of the left hand little finger changes from a state of 5 ° to 15 ° to 4 ° or less. In this case, the key-capable row of the left hand little finger is changed from the second row to the first row.

  In the present embodiment, the first table 4811 is first referred to, and the key-capable sequence assigned to each finger is specified. In the first table 4811, when a plurality of columns are associated with one finger, the key-capable column is specified based on the movement direction and movement amount of the finger in the lateral direction. Next, the second table 4821 is referred to, and the key-capable row is specified for each finger from the bending angle of the finger. Candidate key information is uniquely identified from the identified key-capable rows and key-capable columns.

  Next, in the information input device, it is determined whether the key pressing operation has been executed by the user. When it is determined that the keystroke operation has been performed, candidate key information at the time of determination is specified. The identified candidate key information is identified as the key information selected by the user by the keystroke operation.

  In addition, this invention is not limited to the method of specifying key information based on the various information memorize | stored in the 1st table and the 2nd table. For example, the key information may be specified as follows. Each key information is stored in advance in association with xy coordinate information (x, y). The y-axis coordinate is specified from the bending angle of the finger. The x-axis coordinate is specified from the moving direction and moving amount of the finger. Key information corresponding to the specified x, y coordinate information (x, y) is uniquely specified based on the stored information.

  With reference to FIG. 15, the main process performed in CPU31 of the 1st input device 2 is demonstrated. The main process is started and executed by the CPU 31 when the power of the first input device 2 is turned on.

  As shown in FIG. 15, in the main process, the acceleration signals detected by the sensors 5 and 6 are acquired via the A / D converter 34 (S1). The acquired acceleration signal is temporarily stored in the RAM 33. It is determined whether an acceleration signal is detected from all of the sensors 5 and 6 included in the first input device 2 (S3). When the sensors 5 and 6 from which the acceleration signal has not been acquired remain (S3: YES), the process returns to S1. The process of S1 is repeated until an acceleration signal is detected from all of the sensors 5 and 6.

  When an acceleration signal is detected from all of the sensors 5 and 6 (S3: NO), the acceleration signal stored in the RAM 33 is transmitted to the second input device 3 via the RF module 35 and the antenna 36. (S5). After transmission, it waits until a predetermined time elapses (S7). After a predetermined time has elapsed, the process returns to S1 and the process is repeated. Thus, the first input device 2 can transmit the acceleration signal detected from the sensors 5 and 6 to the second input device 3 at a predetermined time period.

  With reference to FIG.16 and FIG.17, the main process performed in CPU41 of the 2nd input device 3 is demonstrated. The main process is activated and executed by the CPU 41 when the power of the second input device 3 is turned on.

  As shown in FIG. 16, in the main process, the acceleration signal transmitted from the first input device 2 is received (S9). Based on the acceleration signal detected by the first sensor 5 among the received acceleration signals, a process of calculating the movement direction and movement amount of the finger (movement calculation process, see FIG. 17) is executed (S11).

  The movement calculation process will be described with reference to FIG. In the movement calculation process, it is determined whether one of the left and right little fingers or the index finger has moved in the horizontal direction (S31). Judgment as to whether or not the movement has occurred in the lateral direction is based on Py of the acceleration signal received in S9 (see FIG. 16), and predetermined pattern data stored in the other information storage area 484 of the flash memory 48 in advance. This is executed by pattern matching. The pattern data is, for example, data shown in FIGS. If it is determined by pattern matching that Py does not correspond to the pattern data (S31: NO), the process proceeds to S35 as it is.

  If it is determined that the received Py corresponds to the pattern data (S31: YES), the finger has moved in the horizontal direction. The movement direction and the movement amount are calculated based on the received Py (S33). The amount of movement is calculated by integrating the curve indicating the change over time of the received acceleration signal. Then, the process proceeds to S35.

  In the process of S35, the first table stored in the first table storage area 481 is referred to, and the column assigned to each finger is specified as a key-capable column (S35). If it is determined in step S31 that either the left or right little finger or index finger is moving in the horizontal direction, the finger is assigned to the finger based on the movement direction and amount specified in step S33. One of the plurality of columns is selected and specified as a key-capable column. Information on the specified key-capable sequence is temporarily stored in the RAM 43. The movement calculation process is terminated, and the process returns to the main process (see FIG. 16).

  As shown in FIG. 16, after the movement calculation process (S11) is completed, it is determined based on the received Pz whether the finger is stationary (S13). When the change amount of Pz is large, it is determined that the user's finger is moving (S13: NO). In this case, there is a possibility that the finger is in the bending process or the extension process by the pressing operation, or a work other than the pressing operation is being performed by the user. In this case, the process returns to S13. The process of S13 is repeated until the user's finger is stationary.

  On the other hand, when the amount of change in Pz is small, it is determined that the user's finger is stationary (S13: YES). In this case, the reference direction is specified based on the acceleration detected from the second sensor 6 in the received acceleration signal (S14). Of the received acceleration signals, Pz is substituted into the equation (1), and the bending angle θ is calculated. Based on the reference direction identified in S14, θ is corrected, and the bending angle θ ′ of the finger is calculated (S15). It is determined whether the bending angles of all the left and right fingers have been specified (S17). When a finger whose bending angle is not specified remains (S17: NO), the finger to be analyzed is switched (S19). Then, the process returns to S13. The processes of S13 to S17 are repeated until the bending angles of all fingers are calculated.

  When the bending angles of all the fingers have been calculated (S17: YES), the key-capable rows corresponding to the bending angles are specified for each finger based on the second table stored in the second table storage area 482. Candidate key information is determined for each finger from the specified key-capable row and the key-capable column specified in S35 (see FIG. 17) (S21).

  It is determined whether or not a keystroke operation has been performed with any finger of the user (S23). The determination as to whether or not the keystroke operation has been performed is based on Pz of the acceleration signal received in S9 (see FIG. 16) and predetermined pattern data stored in advance in the other information storage area 484 of the flash memory 48. This is executed by pattern matching. The pattern data is, for example, data shown in FIG. If it is determined by pattern matching that Pz does not correspond to the pattern data (S23: NO), the keystroke operation is not performed, and the process returns to S13. If it is determined that the received Pz corresponds to the pattern data (S23: YES), a keystroke operation has been performed. The candidate key information of the finger that has been subjected to the keystroke operation is determined as the key information selected by the user by the keystroke operation (S25). The determined key information and candidate key information are transmitted to the PC 4 via the RF module 46 and the antenna 47 (S27). Then, the process returns to S11.

  In the PC 4, the key information and candidate key information transmitted from the second input device 3 are received. The received key information and candidate key information are displayed on the display (see FIG. 2).

  As described above, in the information input device, identification of the bending angle of the finger and the keystroke action of the finger is performed based on the acceleration signal detected from the first sensor 5. Accordingly, the information input device can prevent a finger movement other than the keystroke action from being erroneously recognized as the keystroke action. Therefore, the information input device can improve the recognition rate when inputting information. In addition, the information input device can reduce the number of devices attached to the tip of the finger, and can reduce the size and weight of the upper input device. Therefore, it is possible to prevent the information input apparatus from interfering with the work when the user performs the information input work and other work.

  The information input device determines the reference direction from the acceleration detected by the second sensor 6 and corrects the bending angle of the finger. The information input device can specify the selected key information from the bending angle of the finger, the moving direction and moving speed of the finger, and whether or not the key-pressing operation is performed, without depending on the direction of the user's hand. The user can perform the key information input operation in various states such as a state where the hand is placed on the desk or a state where the hand is lowered.

  The first sensor 5 in FIG. 1 corresponds to the “first detection means” of the present invention, and the second sensor 6 corresponds to the “second detection means” of the present invention. The CPU 41 that performs the process of S14 in FIG. 16 corresponds to the “reference specifying unit” of the present invention, and the CPU 41 that performs the process of S15 corresponds to the “angle specifying unit” of the present invention. The flash memory 48 of FIG. 12 having the first table storage area 481 for storing the first table and the second table storage area 482 for storing the second table corresponds to the “first storage means” of the present invention. . The CPU 41 that performs the process of S23 in FIG. 16 corresponds to the “determination unit” of the present invention, the CPU 41 that performs the process of S25 corresponds to the “key identification unit” of the present invention, and the CPU 41 that performs the process of S27 corresponds to the present invention. It corresponds to “output means”. The CPU 41 that performs the process of S33 in FIG. 17 corresponds to the “movement specifying unit” of the present invention.

  In addition, this invention is not limited to the said embodiment, A various change is possible. In the above-described embodiment, when a plurality of columns are associated with one finger, one of the plurality of columns is identified as a key-capable column based on the movement direction and amount of movement of the finger in the left-right direction. It was. The present invention is not limited to this method. In the case where a plurality of columns are assigned to one finger, one of the plurality of columns may be specified as a key-pressable column based on the rotation angle of the hand. When the user moves his / her finger laterally in order to perform a keystroke action, the hand is accompanied by rotational movement. Therefore, by detecting the rotation angle of the hand, the lateral movement direction and movement amount of the finger can be specified. Based on the specified moving direction and moving amount, it is possible to specify a key-capable sequence. Hereinafter, modifications of the present invention will be described.

  A modification of the present invention will be described with reference to FIGS. As shown in FIG. 18, in the modification, the first input device 2 further includes a gyro sensor 103. The gyro sensor 103 is attached to the back of the hand. The gyro sensor 103 can detect the angular velocity.

  The gyro sensor 103 recognizes the predetermined direction 105 toward the wrist by specifying the angular velocity. The gyro sensor 103 attached to the first input device 2 for the left hand can specify which of the angle ranges 81 to 83 the direction 105 is facing. The gyro sensor 103 attached to the first input device 2 for the left hand can specify which of the angle ranges 91 to 95 the direction 105 is facing. Based on the direction 105 specified by the gyro sensor 103, the second input device 3 specifies the movement direction and movement amount of the finger in the lateral direction, and specifies a key-capable row. The gyro sensor 103 corresponds to “third detection means” of the present invention.

  With reference to FIG. 19, an example of the third table (third table 4841) stored in the other information storage area 484 will be described. In the third table 4841, an angle range and a column of the key array 71 (see FIG. 9) are stored in association with each other.

  If the direction detected by the gyro sensor 103 attached to the first input device 2 for the left hand is within the range of the angle range 81, the left hand has moved greatly to the left. Therefore, the fifth column arranged on the left side is specified as the key-capable column for the left index finger. The first column arranged on the left side is specified as the key-capable column for the left hand little finger. When the reference direction detected by the gyro sensor 103 is within the range of the angle range 82, the left hand has moved slightly to the left. Accordingly, the sixth column arranged on the right side is specified as the key-capable column of the left index finger. The first column arranged on the left side is specified as the key-capable column for the left hand little finger. When the reference direction detected by the gyro sensor 103 is within the range of the angle range 83, the left hand has moved greatly to the right. Accordingly, the sixth column arranged on the right side is specified as the key-capable column for the left index finger. The second column arranged on the right side is specified as the key-capable column for the left little finger.

  In the modification, the main process executed by the CPU 31 of the first input device 2 will be described. In the main process, the angular velocity detected by the gyro sensor 103 is transmitted to the second input device 3 by the process of S5 (S5). Other processes are the same as those in the above-described embodiment.

  With reference to FIG. 20, the movement calculation process in a modification is demonstrated. The movement calculation process is called from a main process (see FIG. 16) executed in the CPU 41. In the main process in the modified example, the angular velocity transmitted from the first input device 2 is received in the process of S9. Other processes are the same as those in the above-described embodiment.

  As shown in FIG. 20, when the movement calculation process is called from the main process, the rotation angle of the left hand is calculated based on the received angular velocity, and the direction 105 (see FIG. 18) is specified (S41). The rotation angle of the right hand is calculated based on the received angular velocity, and the direction 105 is specified (S43). A key strikeable sequence for each finger is specified (S45). The keystroke possible rows of the left and right little fingers and the left and right index fingers are specified by referring to the third table. The identified key-capable sequence is temporarily stored in the RAM 43. The movement calculation process is terminated, and the process returns to the main process (see FIG. 16). In the main process, candidate key information is identified based on the key-capable columns and key-capable rows identified in the movement calculation process (S21, see FIG. 16). When it is determined that the keystroke operation has been performed (S23: YES, see FIG. 16), the key information selected by the keystroke operation is specified (S25, see FIG. 16).

  As described above, in the modification, the lateral movement direction and movement amount of the hand are specified based on the angular velocity detected by the gyro sensor 103. The information input device can specify the key information selected by the keystroke operation from the operation involving the rotational movement of the hand by the user. Since the gyro sensor 103 can accurately detect the rotation angle of the hand, the information input device can accurately specify the key information selected by the keystroke operation.

  In addition, this invention is not limited to the above-mentioned embodiment and modification, A various change is possible. In the above-described modification, the gyro sensor 103 is attached to the back of the hand. For example, the gyro sensor 103 may be attached to the position of the thumb. The user can perform various input operations by combining the motion of the thumb and the motion of another finger.

  For example, the input operation is performed as follows. The user adjusts the bending angle of the index finger to the little finger and selects the row direction from the key arrangement. The information input device can specify the key-capable row by calculating the bending angle of the finger. The user selects the column direction in the key arrangement by moving the thumb to the left and right. The gyro sensor 103 can identify a key-capable row by detecting an angular velocity that varies with the movement of the thumb.

  In the present embodiment, the key information is specified by determining the bending angle of the finger, the moving direction and moving amount of the finger in the lateral direction, and the keystroke operation of the finger. In the present invention, for example, the key information may be specified from the bending angle of the finger and the keystroke operation of the finger. This eliminates the need to specify the finger movement direction and movement amount, thereby reducing the processing load on the CPU 41 and further reducing the time required to specify key information.

  In the present embodiment, the key information is specified in the CPU 41 of the second input device 3 based on the acceleration signals detected from the sensors 5 and 6. The present invention is not limited to this method. A CPU corresponding to each of the first sensors 5 may be provided. These CPUs may specify the key information selected by the keystroke operation of each finger based on the signal from the corresponding first sensor 5. As a result, the time until the key information is recognized can be further shortened.

1 Information Input System 2 First Input Device 3 Second Input Device 5 First Sensor 6 Second Sensor 31, 41 CPU
103 Gyro sensor

Claims (10)

First detection means that is attachable at least to the position of the user's finger and detects acceleration;
An angle specifying means for specifying a bending angle of a finger based on the acceleration detected by the first detecting means;
First storage means for storing the bending angle and key information indicating a predetermined key in association with each finger;
Determination means for determining whether or not a finger has performed a predetermined motion based on the acceleration detected by the first detection means;
The key specifying means for specifying the key information corresponding to the bending angle specified by the angle specifying means with reference to the first storage means when the determining means determines that a finger has performed a predetermined action. When,
An information input device comprising: output means for outputting the key information specified by the key specifying means. Second detection means for detecting acceleration, different from the first detection means;
Based on the acceleration detected by the second detection means, comprising a reference specifying means for specifying a reference direction which is a reference of the direction of the acceleration detected by the first detection means,
The angle specifying means includes
The information input device according to claim 1, wherein a bending angle of a finger is specified based on the reference direction specified by the reference specifying means. A movement specifying means for specifying the direction and amount of movement of the finger in the lateral direction of the palm;
The first storage means stores the bending angle, the moving direction, the moving amount, and the key information in association with each other.
The key specifying means includes
Specifying the key information corresponding to the bending angle specified by the angle specifying means, the moving direction and the moving amount specified by the movement specifying means with reference to the first storage means; The information input device according to claim 1 or 2, characterized by the above. The movement specifying means includes
The information input device according to claim 3, wherein the moving direction and the moving amount are specified based on the acceleration detected by the first detecting unit. A third detecting means for detecting the angular velocity;
The movement specifying means includes
The information input device according to claim 3, wherein the moving direction and the moving amount are specified based on the angular velocity detected by the third detecting unit. The third detection means includes
The information input device according to claim 5, wherein the information input device can be attached to a thumb position or a back of a user's finger. The first detection means includes
The information input device according to any one of claims 1 to 6, wherein the information input device can be attached to a position of a middle clause or a base clause of a user's finger.   The information input device according to claim 1, wherein the predetermined operation is an operation in which the finger hits a key. The first detection means includes
The information input device according to any one of claims 1 to 8, wherein the information input device can be attached to a position of each finger of both hands of the user. The output means includes
The candidate key information which is the key information corresponding to the bending angle specified by the angle specifying means and the specific key information which is the key information specified by the key specifying means are output. Item 10. The information input device according to any one of Items 1 to 9.

Images