JPWO2011077525A1 - Electronic device, operation detection method, and operation detection program - Google Patents

Abstract

A touch input unit (4), a pattern recognition unit (6), a registration unit (pattern registration unit 8), and a pattern determination unit (10) are provided. The pattern recognition unit recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. The pattern registration unit registers the recognized pattern. When the recognized pattern matches the registered pattern in the registration unit or matches the approximate range of the registered pattern, the pattern determination unit generates an output representing it.

Description

The present invention relates to operation detection of an electronic device equipped with a touch panel, such as a mobile terminal device, and relates to, for example, an electronic device, an operation detection method, and an operation detection program that specify an operation pattern with a plurality of physical elements obtained from touch input.

  In a mobile terminal device equipped with a touch panel, various inputs such as input of characters and figures, selection input, and the like can be performed by a touch operation of a finger or a touch pen on the touch panel.

In this type of portable terminal device, there is known a control for switching the key input mode of the touch panel to an erroneous operation prevention mode and invalidating the call-ending operation by key input (Patent Document 1).

JP 2005-269567 A

  In a mobile terminal device equipped with a touch panel, during a call, it is possible to recognize that the ear touches the touch panel and to lock the call, thereby prohibiting the cancellation of the call. This locked state can be released by pressing an unlock button on the mobile terminal device, and the operation of the end button is invalidated during a call. That is, disabling the end button operation is for preventing an inadvertent end. For this reason, in order to execute the end call, it is necessary to operate the end call button after unlocking, which is inconvenient.

  In addition, if an unlock button used for unlocking is installed, its operation and control are required. Therefore, when a simple touch operation instead of the unlock button is assigned to the touch panel together with the lock function, there is an inconvenience that the lock is released by an inadvertent touch.

Accordingly, an object of the electronic device, the operation detection method, and the operation detection program of the present disclosure is to improve touch input discrimination by using at least two types of physical information as determination elements and to improve the convenience of touch operation. .

  In order to achieve the above object, an electronic device of the present disclosure includes a touch input unit, a pattern recognition unit, and a pattern determination unit. The touch input unit is means for inputting by touch or stroke with a finger, a touch pen, or the like. The pattern recognition unit recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. The pattern determination unit matches the registered pattern when the pattern recognized by the pattern recognition unit matches the registered pattern registered in advance in the registration unit or the approximate range of the registered pattern. Alternatively, an output indicating that the approximate range of the registered pattern is met is generated.

  In order to achieve the above object, an operation detection method of the present disclosure is an operation detection method executed by an electronic device equipped with a touch input unit, and includes a pattern recognition step and a pattern determination step. The pattern recognition step recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. In the pattern determination step, if the recognized pattern matches a registered pattern registered in advance in the registration unit or matches an approximate range of the registered pattern, the pattern determining step matches the registered pattern or the registered pattern Produces an output indicating that the approximate range is met.

In order to achieve the above object, an operation detection program of the present disclosure is an operation detection program executed by an electronic device equipped with a touch input unit, and includes a pattern recognition function and a pattern determination function. The pattern recognition function recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. The pattern determination function matches the registered pattern when the recognized pattern matches the registered pattern registered in advance in the registration unit or the approximate range of the registered pattern, or the registered pattern Produces an output indicating that the approximate range is met.

  According to the electronic device, the operation detection method, or the operation detection program of the present disclosure, the following effects can be obtained.

  (1) Since the touch input pattern is specified by using at least two types of physical information obtained from the touch input as determination elements, the touch input can be identified more easily and the convenience of the touch operation can be improved.

  (2) Since the pattern is recognized and generated using at least two types of physical information obtained from the touch input as determination factors, the influence of the touch input due to the unconscious operation of the person can be eliminated or reduced.

(3) Since a pattern generated by using at least two types of physical information as a determination factor is used, processing accuracy and security such as unlocking, end-of-call processing, application activation, and login to a website are improved.

Other objects, features, and advantages of the present invention will become clearer with reference to the accompanying drawings and each embodiment.

It is a figure which shows an example of the electronic device which concerns on 1st Embodiment. It is a flowchart which shows the process sequence of the pattern registration and pattern determination of touch input. It is a figure which shows an example of the function part of the portable terminal device which concerns on 2nd Embodiment. It is a figure which shows an example of the hardware constitutions of the portable terminal device which concerns on 2nd Embodiment. It is a figure which shows the portable terminal device seen from the touchscreen part side. It is a figure which shows a portable terminal device provided with a pressure sensor part. It is a figure which shows the structural example of a touchscreen part. It is a figure which shows the touch input with respect to a touchscreen part. It is a figure which shows the touch detection of a touchscreen part. It is a flowchart which shows the process sequence of the position detection of touch input. It is a flowchart which shows the process sequence of acceleration calculation of touch input. It is a flowchart which shows the process sequence of the pressure calculation of touch input. It is a flowchart which shows the process sequence of angular velocity calculation. It is a flowchart which shows the process sequence of lock setting. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of an end call setting. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of an end talk. It is a flowchart which shows the process sequence of an end talk. It is a flowchart which shows the process sequence of the lock setting which concerns on 3rd Embodiment. It is a figure which shows input operation of touch input. It is a figure which shows a touch input. It is a figure which shows other input operation of a touch input. It is a figure which shows another touch input. It is a figure which shows the acceleration change of a touch input. It is a figure which shows the angle range of a touch input. It is a figure which shows the pressure change of a touch input. It is a figure which shows other input operation of a touch input. It is a figure which shows another touch input. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of the end story which concerns on 4th Embodiment. It is a figure which shows the example of a display of the inquiry display at the time of an end talk, and a selection button. It is a figure which shows the example of a display of an end talk. It is a flowchart which shows the process sequence of the starting setting of the application which concerns on 5th Embodiment. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of starting of an application. It is a flowchart which shows the specific process sequence of starting of an application. It is a flowchart which shows the process sequence of the login setting of the website which concerns on 6th Embodiment. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of login of a website. It is a flowchart which shows the specific process sequence of login of a website. It is a flowchart which shows the process sequence of the lock setting which concerns on 7th Embodiment. It is a figure which shows the comparative example of a portable terminal device. It is a flowchart which shows the process sequence of the end story which is a comparative example. It is a figure which shows an example of the personal computer which concerns on other embodiment. It is a figure which shows an example of the mobile telephone which concerns on other embodiment. It is a figure which shows an example of the remote controller which concerns on other embodiment.

[First Embodiment]

  The first embodiment recognizes a touch input pattern using at least two types of physical information obtained from touch input as a determination element, and determines whether or not the input pattern matches a registered pattern or a neighborhood range of the registered pattern. Judgment. Here, the touch input includes a touch on the touch input unit or an input by a stroke thereof. The physical information that is a determination element is any one of the number of touch points, position, velocity, acceleration, angle, pressure, and angular velocity. The pattern includes, for example, a point, a line, or a figure specified by a touch input or a stroke thereof as described above, and the line may be continuous or discontinuous, or may be a curve. Good. By using the above-described physical information obtained from such touch input as a determination element, it is possible to eliminate touch input due to an unintentional operation (stroke) of the user and to reduce or prevent malfunctions due to unconscious operation.

  The first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an electronic apparatus according to the first embodiment. The configuration of FIG. 1 is an example, and the present invention is not limited to such a configuration.

  The electronic device 2 is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. As illustrated in FIG. 1, the electronic device 2 includes a touch input unit 4, a pattern recognition unit 6, and a pattern registration unit as functional units. 8 and a pattern determination unit 10.

  The touch input unit 4 receives a touch with a finger or a touch pen (for example, a stylus pen) as a touch input unit, and converts the input of the point or the stroke into electronic information. The touch point is a touch position by a finger or a touch pen, and is a recognizable point set in the touch input unit 4 or its line (may be a set of points). The stroke is, for example, a touch operation with a predetermined pressure or more, and is a movement (trajectory) of successive touch points.

  The pattern recognition unit 6 is a functional unit that recognizes a touch input pattern using the above-described physical information obtained from the touch input to the touch input unit 4 as a determination element. Here, the physical information of the determination element is as described above. In this physical information, the number of points described above is, for example, the number of touch points that are equal to or higher than a predetermined pressure constituting a stroke. The position is, for example, the position of the touch point on coordinates, or the locus position of the touch point. The angle is, for example, the angle of the locus on the coordinates. The speed is, for example, the moving speed of the touch point on the coordinates. The acceleration is, for example, the acceleration in moving the touch point on the coordinates. The angular velocity is, for example, the angular velocity in the locus of the touch point on the coordinates. The pressure is, for example, a pressing force equal to or greater than a predetermined value (threshold value).

  The pattern registration unit 8 is a functional unit that registers the pattern recognized by the pattern recognition unit 6. Since the registered pattern uses at least two types or two or more types of the physical information described above as determination factors, for example, there are various combinations such as the number of points and position, the point position and angle, and the point position and speed. The registered pattern is a pattern specified from the touch input, and may be the touch input itself, or a pattern within the approximate range of the specified pattern by giving a width to the pattern specified from the touch input. Also good.

  The pattern determination unit 10 is a functional unit that determines whether or not an input pattern matches a registered pattern. That is, the pattern determination unit 10 determines whether or not the pattern recognized by the pattern recognition unit 6 matches the registered pattern in the pattern registration unit 8. In this case, as a determination target, it may be determined whether the input pattern matches the registered pattern and the approximate range. Therefore, it is determined whether the input pattern matches the registered pattern, or whether it matches the approximate range, and if it matches, an output representing it is generated.

  According to such a configuration, the pattern recognition unit 6 recognizes the pattern by the above-described determination element by the touch input of the touch input unit 4, and the pattern recognition unit 6 stores the pattern recognized by the pattern recognition unit 6. be registered.

  Therefore, an input pattern is recognized from the touch input of the touch input unit 4, it is determined whether the input pattern matches the registered pattern in the pattern registration unit 8 or its approximate range, and a determination output indicating the determination result is obtained. It is done.

  Therefore, reference is made to FIG. 2 for registration and determination of this pattern. FIG. 2 is a flowchart showing a pattern processing procedure.

  This pattern processing procedure is an example of the operation detection method or the operation detection program of the present disclosure. As shown in FIG. 2, touch input (step S1), pattern recognition (step S2), pattern registration presence / absence determination ( Step S3), pattern registration (Step S4), pattern determination (Step S5), and generation of determination output (Step S6) are included.

  Therefore, in this processing procedure, the touch input unit 4 detects a touch input (step S1), and the pattern recognition unit 6 recognizes the pattern using the above-described physical information obtained from the touch input as a determination element (step S2).

  After this pattern recognition, it is determined whether there is a pattern registration in the pattern registration unit 8 (step S3). If there is no pattern registration (NO in step S3), the recognized pattern is registered in the pattern registration unit 8 (step S4), and this process ends. In this case, the pattern to be registered may be a pattern obtained from touch input, and a pattern in an approximate range that approximates the pattern may be registered.

  If there is pattern registration (YES in step S3), it is determined whether the input pattern recognized from the touch input matches the registered pattern (step S5). In this case, it may be determined whether or not the input pattern matches including the approximate range of the registered pattern. The pattern determination unit 10 generates and outputs a determination output indicating a determination result of whether the input pattern matches the registered pattern or its approximate range or not (step S6).

  According to the above configuration, a touch input pattern is generated using at least two types of physical information obtained from touch input as a determination element, and the registered pattern and the input pattern are compared. As a result, the identifiability of touch input is improved and the convenience of touch operation can be improved.

  A pattern is recognized and generated using the above-described physical information obtained from touch input as a determination element. Thereby, the influence of the touch input by a user's unconscious operation can be reduced.

  In addition, a pattern in which the above-described physical information is generated as a determination element is used. Therefore, it can be used for unlocking, end-of-call processing, application activation, login to a WWW (World Wide Web) site, etc., and the processing accuracy and security can be improved.

[Second Embodiment]

  The second embodiment is a portable terminal device equipped with a touch panel unit. This portable terminal device recognizes a touch input pattern using the above-described physical information obtained from touch input as a determination element, and determines whether or not the input pattern matches a registered pattern or a neighborhood range of the registered pattern It is the structure which has.

  The second embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a functional unit of the mobile terminal device. The configuration shown in FIG. 3 is an example, and the present invention is not limited to such a configuration. In FIG. 3, the same parts as those in FIG.

  The mobile terminal device 20 is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. As shown in FIG. 3, the mobile terminal device 20 includes a pattern determination unit 10, a pattern recognition unit 16, a touch detection unit 22, a position detection unit 24, an acceleration calculation unit 26, and a pressure calculation unit 28. , An angular velocity calculation unit 30, a pattern registration control unit 32, a communication control unit 34, a voice input / output control unit 36, a display control unit 38, and a lock control unit 40, which are processed by a computer (calculation, It is a functional unit realized by determination and various controls.

  The pattern determination unit 10 is as described above. The pattern recognition unit 16 recognizes a touch input pattern using the above-described physical information obtained from the touch input detected by the touch detection unit 22 as a determination element. In this embodiment, physical information determination elements are as follows.

(1) The number of points touched on the touch panel unit 56 (FIG. 4) (the number of points is 1 in the examples of FIGS. 8, 9, 25 and 26, and the number of points in the examples of FIGS. 23, 24 and 28 is 2)
(2) Point position (coordinate position X, Y)
(3) Speed, acceleration and angle to move the point
(4) Pressure for pressing the touch panel 56 (FIG. 4) with a finger or a touch pen

  The touch detection unit 22 detects, for example, a touch or stroke with a finger or a touch pen as a touch input to the touch panel unit 56 (FIG. 4), and obtains touch information as physical information.

  The position detection unit 24 detects the touch position, stroke position, angle, and the like of a finger or a touch pen with respect to the touch panel unit 56 (FIG. 4), and obtains physical information (position information).

  The acceleration calculation unit 26 calculates an acceleration as physical information from position information of a touch input of a finger or a touch pen with respect to the touch panel unit 56 (FIG. 4).

  The pressure calculation unit 28 calculates the pressure at the touch position of the finger or the touch pen on the touch panel unit 56 (FIG. 4). That is, the pressure at the touch position received by the touch panel unit 56 is calculated, and the pressure is obtained as physical information.

  The angular velocity calculation unit 30 calculates the angular velocity of the mobile terminal device 20 and outputs angular velocity information that is physical information.

  The pattern registration control unit 32 controls registration of patterns recognized by the pattern recognition unit 16 described above. In this case, the pattern to be registered may be a pattern within the approximate range of the pattern recognized from the touch input. The pattern recognition unit 16 described above generates a touch input pattern using at least two types of physical information obtained from the touch detection unit 22, the position detection unit 24, the acceleration calculation unit 26, the pressure calculation unit 28, or the angular velocity calculation unit 30. recognize. The recognized pattern is registered or used for comparison with the registered pattern.

  The communication control unit 34 controls wireless communication and voice communication. If the input pattern matches the registered pattern, the communication control unit 34 performs call control and call termination control according to the determination output.

  The voice input / output control unit 36 controls output of voice signals and voice input.

  The display control unit 38 controls display of characters and images on the display unit 48 (FIG. 4).

  The lock control unit 40 constitutes a functional unit that controls the unlocking of the function of the mobile terminal device 20 and if the touch input is appropriate.

  Next, the hardware of this portable terminal device will be described with reference to FIGS. 4 is a diagram illustrating a hardware configuration example of the mobile terminal device, FIG. 5 is a diagram illustrating the mobile terminal device viewed from the touch panel unit side, and FIG. 6 is a diagram illustrating the mobile terminal device including the pressure sensor unit. . The configurations shown in FIGS. 4, 5, and 6 are examples, and the present invention is not limited to such configurations. 4, FIG. 5 and FIG. 6, the same parts as those in FIG.

  The mobile terminal device 20 includes hardware that implements the above-described functional unit (FIG. 3). As shown in FIG. 4, the processor 42, the sensor unit 44, the input unit 46, and the display unit 48 are provided. A voice input / output unit 50, a communication unit 52, and a storage unit 54.

  The processor 42 executes an OS (Operating System) and an application program stored in the storage unit 54, and performs input control such as capturing of detection information from the sensor unit 44, detection of various information, calculation, display control, communication control, and the like. To do. The above-described functional unit (FIG. 3) is realized by the processor 42. The processor 42 constitutes an application activation unit that activates an application by pattern determination. In addition, an application activation unit that activates an application in the program storage unit 72 is configured.

  The sensor unit 44 includes a touch panel unit 56, a pressure sensor unit 58, an acceleration sensor unit 60, a position sensor unit 62, and an angular velocity sensor unit 64. The touch panel unit 56 is installed on the front surface of the display unit 48 and detects a touch input by a finger or a touch pen. The pressure sensor unit 58 detects pressure applied to the touch panel unit 56 by a finger or a touch pen. The acceleration sensor unit 60 outputs acceleration information detected from a touch input of a finger or a touch pen. The position sensor unit 62 outputs position information (coordinate information) detected from touch input of a finger or a touch pen. The angular velocity sensor unit 64 detects the angular velocity of the mobile terminal device 20 and outputs the angular velocity information.

  The input unit 46 inputs sensor information of the sensor unit 44 to the processor 42 under the control of the processor 42.

  The display unit 48 is installed behind the touch panel unit 56 and displays input buttons assigned to the touch panel unit 56 and output information under the control of the processor 42.

  The voice input / output unit 50 includes a microphone 66 as voice input means and a receiver 68 as voice output means. The voice input / output unit 50 takes in voice from the microphone 66 and reproduces voice from the receiver 68 under the control of the processor 42.

  The communication unit 52 includes an antenna 70, and executes communication with the radio base station under the control of the processor 42. The communication unit 52, together with the processor 42, constitutes an end call function unit for terminating a call and a login function unit for logging in to a website based on pattern determination.

  The storage unit 54 includes a program storage unit 72, a data storage unit 74, and a RAM (Random-Access Memory) 76. The program storage unit 72 stores the OS and application programs described above, and examples of the application program include an operation detection program, a lock program, and an unlock program. The data storage unit 74 includes a pattern registration unit, and a pattern to be compared with the input pattern is registered in the pattern registration unit. The RAM 76 constitutes a work area for various processes such as registration and determination of patterns recognized from input strokes.

  As shown in FIG. 5, the portable terminal device 20 is provided with a touch panel unit 56 together with a display unit 48 on the front surface of a housing 78. A microphone 66 and a receiver 68 are installed in the housing 78 with the display unit 48 interposed therebetween.

  As shown in FIG. 6, a pressure sensor unit 58 is installed on the back side of the touch panel unit 56. When the abdomen of the finger 80 is touched on the upper surface of the touch panel unit 56 and pressure P is applied via the touch panel unit 56, the pressure P is detected by the pressure sensor unit 58. This detection output is output as an electrical signal representing pressure information, and the level represents the pressure level.

  Next, the touch panel unit and touch input will be described with reference to FIGS. FIG. 7 is a diagram showing the touch panel unit, FIG. 8 is a diagram showing the touch panel unit and point movement, and FIG. 9 is a diagram showing detection points where the point movement is detected.

  As shown in FIG. 7, a plurality of rows and a plurality of columns of addresses are set on the panel surface 82 of the touch panel unit 56. In this embodiment, detection points 84 of 12 rows and 10 columns are set. That is, the detection points 84 in 12 rows and 10 columns constitute an example of the position sensor 62. Alphabets a, b... L represent rows (X coordinates), and numerals 1, 2,... 10 represent columns (Y coordinates).

  Therefore, as shown in FIG. 8, a spiral stroke 86 is drawn on the panel surface 82 of the touch panel unit 56 as an example of touch input using a finger or a touch pen, thereby generating a point locus 88. . In this case, the stroke 86 is an example of an input operation that the user does not perform unconsciously.

  The stroke 86 starts from the upper right portion of the touch panel portion 56, moves in a curved shape from the start point 90 toward the center portion, forms a revolving portion 92 at the center portion, and forms a cross portion 94. The curve moves from the portion 94 to the lower left and forms an end point 96 at the lower left. The point trajectory 88 starts at the point 9b, reaches the point 8b-7b-7c-6c-5c-5d-4d-3e, and points 4e-4f-4g-5g-6g with the point 3e as the inflection point. -7g-7f, point 7f as an inflection point, point 7e-6e-5e-5f-4f, point trajectory 88 crosses at this point 4f, and from point 4f to 4g-3g-3h-2i- 2j-2k-2l, and the point 2l is the end point 96. That is, the point locus 88 is written on a diagonal line starting from the upper right corner portion side of the panel surface 82 and directed to the lower left corner portion side, and forms a cross portion 94 together with the circulating portion 92 in the intermediate portion.

  And the point locus | trajectory 88 corresponding to the stroke 86 is detected by the several detection point row | line | column which the panel surface 82 continued, as shown in FIG. That is, the point locus 88 is detected points 9b-8b-7b-7c-6c-5c-5d-4d-3e-4e-3f-4f-5g-6g-7g-7f-7e-6e-5e-5f-4f. -4g-3g-3h-2h-2i-2j-2k-2l. In this point locus 88, the detection point 4f is detected twice with a time difference Δt, and the cross portion 94 exists on the point locus 88 from the start point 90 to the end point 96 with this detection. I understand.

  A point locus 88 corresponding to the stroke 86 forms a pattern 98. That is, the pattern 98 is recognized as the stroke 86 of the touch input as an aggregate of the point locus 88. A plurality of detection points 6a, 7a, 8a, 9a, 10a, 4b, 5b, 6b, 10b, 3c, 4c, 8c, 9c, 10c, 2d, 3d, 6d, 7d, 8d, which surround the pattern 98, 2e, 8e, 2f, 6f, 8f, 1g, 2g, 8g, 1h, 4h, 5h, 6h, 7h, 8h, 1i, 3i, 4i, 1j, 3j, 1k, 3k, 1l, 3l An approximate range pattern 100 is formed. In this case, the pattern 98 is represented by diagonal lines, and the pattern 100 is represented by an encircling line consisting of a thick solid line.

  With such a configuration, it is possible to recognize the pattern 98 using the touch position and the touch point which are physical information of the determination element of the touch input for the stroke 86 which is not operated unconsciously. In addition, the pattern 100 that is the vicinity range is recognized by the range of the above-described detection points 6a to 3l around the pattern 98 and the detection points (including the detection point 6f in this case) located inside the circulating portion 92. Can do. These patterns 98 or 100 may be registered.

  Next, with reference to touch input position detection, acceleration calculation, pressure calculation, and angular velocity calculation, reference is made to FIGS. FIG. 10 is a flowchart showing the position detection processing procedure, FIG. 11 is a flowchart showing the acceleration calculation processing procedure, FIG. 12 is a flowchart showing the pressure calculation processing procedure, and FIG. 13 shows the angular velocity calculation processing procedure. It is a flowchart.

  The touch input position detection processing procedure is a process of detecting a touch position or locus on the touch panel unit 56 and outputting position information representing the position or locus.

  In this processing procedure, as shown in FIG. 10, the touch panel unit 56 is touched with a finger or a touch pen (step S111). Position information on the X axis and the Y axis, which are coordinate axes representing the touch position on the touch panel unit 56, is detected (step S112), and position information that is a determination element for touch input is output (step S113).

  Next, the processing procedure for calculating the acceleration of touch input is processing for calculating acceleration from position information representing the position and locus of touch on the touch panel unit 56.

  In this processing procedure, as shown in FIG. 11, the contact of the finger or the touch pen on the touch panel unit 56 and the position thereof are monitored (step S121). If a finger or a touch pen is touching the touch panel unit 56 (YES in step S121), X-axis and Y-axis position information indicating the touch position of the touch panel unit 56 is detected (step S122). Whether the position information has changed is monitored (step S123). If the position information has changed (YES in step S123), X-axis and Y-axis position information indicating the touch position of the touch panel unit 56 is detected (step S124). An acceleration is calculated from the position information (step S125), and an acceleration that is a determination element for touch input is output (step S126).

  If the X-axis and Y-axis position information representing the touch position on the touch panel unit 56 has not changed (NO in step S123), the acceleration is not calculated, and this process ends.

  Next, the processing procedure for calculating the pressure of the touch input is a process of detecting the position and locus of the touch on the touch panel unit 56 and outputting the pressure representing the position and locus.

  In this processing procedure, as shown in FIG. 12, the touch of the finger or the touch pen on the touch panel unit 56 and the position thereof are monitored (step S131). The pressure of the part in contact with the touch panel unit 56 is calculated (step S132), and the pressure that is the touch input determination element is output (step S133). In this embodiment, it is determined whether or not the calculated pressure is output in step S133, and if it is not output, the process returns to step S131, but may be output without making such a determination.

  Next, the processing procedure for calculating the angular velocity of touch input is processing for monitoring the movement of the mobile terminal device and calculating the angular velocity.

  As shown in FIG. 13, this processing procedure monitors whether the portable terminal device 20 is stationary (step S141). If the portable terminal device 20 is not stationary (NO in step S141), the mobile terminal device 20 is moved from the movement to the portable terminal device. The angular velocity of the terminal device 20 is calculated (step S142). If the mobile terminal device 20 is stationary (YES in step S141), the angular velocity Vθ of the mobile terminal device 20 is zero (Vθ = 0) (step S143).

  Then, the angular velocity Vθ or Vθ = 0 is output as physical information that is a determination element (step S144).

  According to such a configuration, a touch position, acceleration, pressure, and angular velocity can be obtained as physical information that is a determination element of touch input, and a touch input pattern can be recognized from the physical information.

  Next, FIG. 14 is referred about the lock setting of a portable terminal device. FIG. 14 is a flowchart illustrating a lock setting process.

  This lock setting processing procedure recognizes the touch input pattern using the above-described physical information obtained from the touch input to the touch panel unit 56 for the lock setting, and sets the registered pattern as the release information.

  Therefore, in this processing procedure, as shown in FIG. 14, it is determined whether or not the lock is set (step S201), and if it is not the lock setting (NO in step S201), this process is terminated.

  If it is a lock setting (YES of step S201), pattern registration mode will be started and pattern registration will be performed (step S202). It is determined whether or not the pattern has been registered (step S203). If the pattern is not registered (NO in step S203), this process ends. If the pattern is registered (YES in step S203), lock setting is executed (step S204). Since this lock setting is related to pattern registration by touch input, it is necessary for the registration pattern and the input pattern to coincide with each other in order to cancel the lock setting.

  Next, the pattern registration process will be described with reference to FIG. FIG. 15 is a flowchart showing a processing procedure during registration.

  This pattern registration processing procedure is a process of registering a touch input pattern for the touch panel unit 56 when setting a function lock or the like. The registered pattern is used for user authentication processing for unlocking.

  In this processing procedure, as shown in FIG. 15, position information on the X axis and the Y axis representing the point where the finger on the touch panel unit 56 is placed is detected (step S211). It is determined to which range the position of the point corresponds (step S212). The pressure from the finger or the touch pen is calculated (step S213). The movement of the point is monitored (step S214). If there is a movement of the point (YES in step S214), the acceleration of the point movement is calculated or the movement speed of the point is calculated from the movement of the position of the point (step S215).

  In this case, a pattern is generated based on the position information, pressure, and acceleration of the touch input (step S216), the pattern is registered in the pattern registration unit (step S217), and the process returns to step S202 of the main routine (FIG. 14). Then, lock setting is executed.

  Next, FIG. 16 is referred to regarding the unlocking process. FIG. 16 is a flowchart showing the unlocking procedure.

  This unlocking processing procedure is unlocking processing when a registration pattern exists as unlocking information.

  In this processing procedure, as shown in FIG. 16, it is determined whether or not the lock is released (step S221). If the lock is not released (NO in step S221), this process is terminated. If the lock is released (YES in step S221), the above-described touch input is performed (step S222). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

  It is determined whether the input pattern obtained by touch input matches the registered pattern (step S223). If the input pattern matches the registered pattern (YES in step S223), the lock is released (step S224). If the input pattern does not match the registered pattern (NO in step S223), the lock cannot be released. (Step S225). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

  Accordingly, FIG. 17 will be referred to regarding the unlocking process. FIG. 17 is a flowchart illustrating an example of a specific processing procedure for unlocking.

  In this processing procedure, in the case of unlocking, as shown in FIG. 17, the position (X, Y) of the point where the finger or touch pen is placed on the touch panel unit 56 is calculated (step S231). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range (1a to 10l) the position of the point corresponds (step S232). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S233). For example, when the point 9b is registered, it is determined whether the points 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not correspond to the coordinate range of the position of the point (NO in step S233), the lock cannot be released (step S234).

  In this determination, if the coordinate range of the position of the point falls (YES in step S233), as a second determination whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step (step S233). S235). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] x 0.8 to XX [N] x 1.2. Is determined (step S236). In this pressure determination, if the pressure does not fall within the predetermined pressure range (NG in step S236), the lock cannot be released (step S237).

If such pressure determination is within a predetermined pressure range (OK in step S236), the movement of the point is monitored (step S238). If there is a movement of the point (YES in step S238), an acceleration is calculated from the movement of the position distance of the point, and this acceleration is compared with the registered pattern for determination (step S239). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S240). If this acceleration is outside the predetermined range (NG in step S240), the lock cannot be released (step S241).

  If the acceleration is within a predetermined range (OK in step S240), the lock is released (step S242), and the process is terminated.

  By using a pattern that recognizes the above-described physical information obtained from touch input as a determination element in this way, if the lock setting and unlocking are performed, unlocking by an unconscious operation of the user can be prevented. Moreover, security can be improved.

  Next, with reference to FIG. FIG. 18 is a flowchart showing the processing procedure for setting the end call.

  The processing procedure for setting the end speech recognizes the touch input pattern using the above-described physical information obtained from the touch input to the touch panel unit 56 for the end speech processing, and sets the registered pattern as the end speech information.

  Therefore, in this processing procedure, as shown in FIG. 18, it is determined whether or not the end of call is set (step S301). If the end of call is not set (NO in step S301), this process ends.

  If it is the end-of-call setting (YES in step S301), the pattern registration mode is activated and pattern registration is performed (step S302). It is determined whether or not the pattern is registered (step S303). If the pattern is not registered (NO in step S303), this process is terminated. If the pattern is registered (YES in step S303), the end of call setting process is executed (step S304). Since this end-call setting process is related to pattern registration by touch input, it is necessary for the end-call setting process to match the registered pattern and the input pattern.

  Next, FIG. 19 will be referred to regarding pattern registration processing for end-of-call setting. FIG. 19 is a flowchart showing a pattern registration processing procedure.

  This pattern registration processing procedure is a process of registering a touch input pattern for the touch panel unit 56 when setting a function lock or the like. The registered pattern is used for user authentication processing for unlocking.

  In this processing procedure, as shown in FIG. 19, X-axis and Y-axis position information representing a point where a finger is placed on the touch panel unit 56 is detected (step S311). It is determined to which range the position of the point corresponds (step S312). The pressure from the finger or the touch pen is calculated (step S313). The movement of the point is monitored (step S314). If there is a movement of the point (YES in step S314), the acceleration of the movement of the point is calculated or the movement speed of the point is calculated from the movement of the position of the point (step S315).

  In this case, a pattern is generated based on the position information, pressure, and acceleration of the touch input (step S316), the pattern is registered in the pattern registration unit (step S317), and the process returns to step S302 of the main routine (FIG. 18). Then, the end call setting is executed.

  Next, with reference to FIG. FIG. 20 is a flowchart showing the processing procedure of the end talk.

  This end-call processing procedure is the end-call processing when a registered pattern exists as end-talk information.

  In this processing procedure, as shown in FIG. 20, it is determined whether a call is in progress (step S321). If the call is not in progress (NO in step S321), this process ends. If the call is in progress (YES in step S321), touch input is performed for the end of the call (step S322). Recognize patterns from touch input. That is, the touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

  It is determined whether the input pattern obtained by touch input matches the registered pattern (step S323). If the input pattern matches the registered pattern (YES in step S323), the end of call lock is released (step S324), and the end of call process is executed (step S325). If the input pattern does not match the registered pattern (NO in step S323), the end-of-call lock cannot be released (step S326). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

  Therefore, FIG. 21 is referred to for the process of the end talk. FIG. 21 is a flowchart illustrating an example of a specific processing procedure for unlocking.

  In this processing procedure, in the case of the end speech processing, as shown in FIG. 21, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S331). As a first determination between the input pattern and the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S332). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S333). For example, when the point 9b is registered, it is determined whether the points 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not correspond to the coordinate range of the position of the point (NO in step S333), the call cannot be ended (step S334).

  In this determination, if it falls within the coordinate range of the position of the point (YES in step S333), as a second determination between the input pattern and the registered pattern, the pressure is compared with the registered pattern for determination (step S335). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] x 0.8 to XX [N] x 1.2. Determine whether. In this pressure determination, if it does not fall within the predetermined pressure range (NG in step S336), the call cannot be ended (step S337).

If such a pressure determination is within a predetermined pressure range (OK in step S336), the movement of the point is monitored (step S338). If there is a movement of the point (YES in step S338), the movement of the position of the point from the distance is started. The acceleration is calculated, and the acceleration is compared with the registered pattern for determination (step S339). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S340). If this acceleration is outside the predetermined range (NG in step S340), the end of speech is impossible (step S341).

  If the acceleration is within the predetermined range (OK in step S240), the end-of-call lock is released, the end-of-call process is executed (step S342), and this process ends.

  In this way, by using a pattern that recognizes at least two types of physical information obtained from touch input as a determination element, the end-of-call processing or the end of the end-of-call is disabled, and therefore the end-of-call due to an unconscious operation by the user can be prevented.

[Third Embodiment]

  The third embodiment has a function of recognizing a touch input pattern using five types of physical information obtained from touch input as a determination element and determining whether the input pattern matches the registered pattern or the vicinity thereof. Have

  The third embodiment will be described with reference to FIG. FIG. 22 is a flowchart illustrating a lock setting process. The configuration shown in FIG. 22 is an example, and the present invention is not limited to such a configuration.

  Similar to the second embodiment, this processing procedure is a lock setting for the mobile terminal device, and is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

  In this processing procedure, five types of determination elements are used as the above-described physical information obtained from the touch input: the number of points of the touch input, the position of the point, the acceleration of the point, the moving angle, and the pressure. That is, in this processing procedure, as shown in FIG. 22, determination of lock setting (step S401), touch input (steps S402, S403, S404, S405, S406), pattern registration (step S407), and lock setting (step S408). )It is included.

  Therefore, in this processing procedure, it is determined whether or not the lock setting is performed (step S401). If the lock setting is not performed (NO in step S401), the process is terminated. If the lock is set (YES in step S401), the process proceeds to touch input. As the first touch input, the number of points where the finger is first placed on the touch panel unit 56 (FIGS. 4 and 5) is detected, and the number of points is obtained as a determination element of the touch input (step S402).

  Next, the position of the point on the touch panel unit 56 (FIG. 4) is detected as the second touch input, and the position information (X, Y) is obtained as a determination element of the touch input (step S403).

  Next, as the third touch input, an acceleration at which the point moves is detected, and the acceleration is obtained as a determination element of the touch input (step S404).

  Next, an angle at which the point moves is detected as the fourth touch input, and the angle is obtained as a determination element for the touch input (step S405).

  Next, as a fifth touch input, a change in pressure for pressing the touch panel unit 56 (FIG. 6) with a finger is detected, and a pressure change is obtained as a determination element for the touch input (step S406).

  In this way, a pattern is generated using the five types of physical information of the number of points, position, acceleration, angle, and pressure change as determination elements, and this pattern is set in the data storage unit 74 (FIG. 4). (Step S407).

  After this pattern registration, lock setting is executed (step S408). The lock setting executed together with pattern registration cannot be unlocked unless there is an input pattern that matches the registered pattern.

  The touch input used for the lock setting will be described with reference to FIGS. FIG. 23 is a diagram illustrating an input operation, and FIG. 24 is a diagram illustrating a touch input.

  For example, as shown in FIG. 23, the mobile terminal device 20 is configured such that the index finger 102 is brought into contact with the upper left side of the touch panel unit 56 and the tip of the thumb 104 is brought into contact with the lower right side, as shown in FIG. While maintaining the contact state, the index finger 102 is turned to the arrow a and the thumb 104 is turned to the arrow b. According to such touch input, two separated points and a determination element based on the movement can be obtained.

As shown in FIG. 24, 0 to 60 detection points are set in the X-axis direction and 0 to 90 detection points are set in the Y-axis direction on the touch panel unit 56 of the mobile terminal device 20. Point A, point A ′, and arrow a indicate the pressing point of the index finger 102 and its movement locus, and point B, point B ′, and arrow b indicate the pressing point of the thumb 104 and its movement locus. In this case, as position information of A → A ′, A → A ′ = {X _A (= 10), Y _A (= 25)} → {X _A ′ (= 50), Y _A ′ (= 25)} Is obtained. As position information of B → B ′, B → B ′ = {X _B (= 50), Y _B (= 65)} → {X _B ′ (= 10), Y _B ′ (= 65)} is obtained. .

  Other touch inputs used for lock setting will be described with reference to FIGS. 25 and 26. FIG. FIG. 25 is a diagram illustrating another touch input, and FIG. 26 is a diagram illustrating another input operation.

  For example, as shown in FIG. 25, in the portable terminal device 20, as shown in FIG. 25, the tip of the index finger 102 is brought into contact with the upper right side of the touch panel unit 56, and the index finger 102 is placed in Japan while maintaining the contact state. Move to draw the kana character "no" of the word. According to such touch input, a determination element of touch input by a stroke 86 (FIG. 8) of one stroke can be obtained.

In this touch input, as shown in FIG. 26, 0 to 60 detection points are set in the X-axis direction and 0 to 90 detection points are set in the Y-axis direction on the touch panel unit 56, and position information is obtained from these detection points. Is obtained. In this case, if the start point is C point and the end point is D point, C → D = {X _C (= 50), Y _C (= 25)} → {X _D (= 10) ), Y _D (= 65)}.

  Refer to FIGS. 27, 28, and 29 for the determination element of the touch input. FIG. 27 is a diagram showing a change in acceleration of a touch input, FIG. 28 is a diagram showing an angle range of the touch input, and FIG. 29 is a diagram showing a pressure change in the touch input.

  For example, as shown in FIG. 27, an acceleration that changes with time is detected between the touch input start point 106 and the end point 108. This acceleration is one piece of physical information and can be used as a touch input determination element.

  For example, as shown in FIG. 28, the touch input angle θ can be obtained as a touch input determination element. In this case, using the intersection point of the X axis and the Y axis set in the touch panel unit 56 as a reference point, the angle θ formed by the aforementioned points A and A ′ of the touch input is obtained. In this case, the angle θ formed by point A and point A ′ is 35 °.

  Further, between the touch input start point 106 and the end point 108, for example, a pressure that changes with time is detected as shown in FIG. This pressure change is one piece of physical information and can be used as a determination element for touch input.

  Other touch inputs will be described with reference to FIGS. 30 and 31. FIG. FIG. 30 is a diagram illustrating another input operation, and FIG. 31 is a diagram illustrating another touch input.

  Although the point movement (FIGS. 23 and 24) and the stroke (FIGS. 25 and 26) are exemplified as the touch input, the present invention is not limited to this. The touch input may be a character input. As shown in FIG. 30, for example, the alphabet finger “ON” may be drawn by bringing the index finger 102 into contact with the touch panel unit 56, and this character “ON” is used as a touch input determination element as shown in FIG. 31. Position information on the X axis and the Y axis of the touch panel unit 56 is obtained.

  With the above configuration, it is possible to acquire a plurality of physical information such as the number of points, position, acceleration, moving angle, pressure change, and the like from touch input by a single operation such as one stroke. As a result, a combination of five types of physical information is obtained, and a touch input pattern can be generated by logical combination of these combinations, for example. If a plurality of physical information is acquired, two or more kinds of physical information can be selected and a pattern can be generated.

  Next, with respect to unlocking, FIG. 32 is a flowchart showing a processing procedure of unlocking.

  This processing procedure is a unlocking process corresponding to the above-described lock setting (FIG. 22). In this processing procedure, as described above, the lock setting is as described above. As the physical information described above obtained by touch input, the five types of determination elements of touch input point number, point position, point acceleration, moving angle, and pressure are used. Is used. Therefore, in this processing procedure, as shown in FIG. 32, determination of unlocking (step S411), touch input (steps S412, S413, S414, S415, S416), pattern determination (step S417), and unlocking are impossible. (Steps S418 and S419) are included.

  Therefore, in this processing procedure, it is determined whether or not the lock is released (step S411). If the lock is not released (NO in step S411), the process ends. In the case of unlocking (YES in step S411), the process proceeds to touch input. As the first touch input, the number of points where the finger is first placed on the touch panel unit 56 (FIGS. 4 and 5) is detected, and the number of points is obtained as a determination element of the touch input (step S412).

  Next, the position of the point on the touch panel unit 56 (FIG. 4) is detected as the second touch input, and the position information (X, Y) is obtained as a determination element of the touch input (step S413).

  Next, as the third touch input, an acceleration at which the point moves is detected, and the acceleration is obtained as a determination element of the touch input (step S414).

  Next, an angle at which the point moves is detected as the fourth touch input, and the angle is obtained as a determination element for the touch input (step S415).

  Next, as a fifth touch input, a change in pressure for pressing the touch panel unit 56 (FIG. 6) with a finger is detected, and a pressure change is obtained as a determination element for the touch input (step S416).

In this way, a pattern is generated using the five types of physical information of the number of points, position, acceleration, angle, and pressure change as judgment elements, and this input pattern matches the registered pattern in the data storage unit 74 (FIG. 4). It is determined whether or not to perform (step S417).

  After this pattern determination, if the input pattern matches the registered pattern (YES in step S417), unlocking is executed (step S418). If the input pattern does not match the registered pattern (NO in step S417), the lock cannot be released (step S419).

  In the above configuration, the number of touch input points, position, acceleration, moving angle, and pressure change are detected as physical information, and the touch input pattern is recognized and registered by the logical product of these. Each is characteristic physical information, and a pattern is generated by a plurality of these logical products. For this reason, the determination accuracy between the registered pattern and the input pattern can be improved, touch input due to the unconsciousness of the user can be eliminated, and malfunction can be prevented.

[Fourth Embodiment]

  The fourth embodiment is configured to prevent the user from unintentionally ending the call during a call by ending the end-of-call lock on the display screen after releasing the end-of-call lock. is there.

  The fourth embodiment will be described with reference to FIGS. 33, 34, and 35. FIG. FIG. 33 is a flowchart showing the processing procedure of the end call, FIG. 34 is a view showing a display example of the inquiry display and selection button at the end of the call, and FIG. 35 is a view showing a display example of the end call.

  The processing procedure of the end speech processing is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

  This processing procedure includes a call lock by starting a call (step S501), a call lock release (steps S502, S503, S504, S505), and a call termination process (steps S506, S507).

  Therefore, in this processing procedure, as shown in FIG. 33, the call is locked by the start of the call (step S501). This lock setting may be performed, for example, in the lock setting (FIGS. 14 and 15) of the second embodiment.

  During a call, the unlocking monitoring state is maintained (NO in step S502 and step S502). If the lock is released (YES in step S502), the user performs a touch input (step S503). This touch input is input by an operation that is not performed by the user unconsciously. As described above, the input pattern is recognized from this touch input, and it is determined whether the input pattern matches the registered pattern (step S504). . If the input pattern does not match the registered pattern (NO in step S504), the lock is maintained, so that touch input is required again (step S503).

  If the input pattern matches the registered pattern (YES in step S504), the lock is released (step S505). When the lock is released, an end-of-speech operation is requested (step S506), and the end of the talk is made by this operation (step S507), and this process is terminated.

  As shown in FIG. 34, the call termination operation (step S506) causes the display unit 48 to display a call termination operation inquiry message 110 and selection buttons 112 and 114 by display control. For example, the message 110 displays “Do you want to end the call?”. The selection button 112 is a button for instructing an end story “YES”, and the selection button 114 is a button for instructing an end story rejection “NO”.

  Therefore, if the user touches the selection button 112, the end-of-call process is performed by the touch input. If the selection button 114 is touched, the call termination is rejected by the touch input, and the call is maintained.

  When the end speech processing is executed, as shown in FIG. 35, a message 116 for notifying the end of speech is displayed on the display unit 48 by display control. This message 116 displays, for example, “Call ended”. As a result, the user can know that the end of the conversation has ended.

  According to such a configuration, since there is an inquiry about the end-of-call process after the lock release, the user can know the lock release, and the user can end the call by recognizing the lock release. It is possible to prevent unscheduled endings due to user's unconscious operation or careless operation.

[Fifth Embodiment]

  In the fifth embodiment, the touch input pattern determination is used to start an application program (application) in the program storage unit 72 (FIG. 4).

  With reference to FIGS. 36, 37, 38 and 39, the fifth embodiment will be described. FIG. 36 is a flowchart showing the processing procedure of application activation setting, FIG. 37 is a flowchart showing the processing procedure of pattern registration, FIG. 38 is a flowchart showing the processing procedure of application activation, and FIG. It is a flowchart which shows a specific process sequence. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

  This application activation setting processing procedure is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. In this processing procedure, a touch input pattern is recognized by using the above-described physical information obtained from touch input to the touch panel unit 56 for application activation setting, and the registered pattern is set as application activation information.

  Therefore, in this processing procedure, as shown in FIG. 36, it is determined whether the application activation setting is set (step S601), and if it is not the application activation setting (NO in step S601), this process is terminated.

  If it is an application activation setting (YES in step S601), the pattern registration mode is activated and pattern registration is performed (step S602). It is determined whether pattern registration has been performed (step S603). If pattern registration is not performed (NO in step S603), this process ends. If the pattern is registered (YES in step S603), the application activation setting is executed (step S604). Since this application activation setting is associated with pattern registration by touch input, it is necessary that the registration pattern and the input pattern match for the application activation.

  The pattern registration process used to activate the application is a process of registering a touch input pattern for the touch panel unit 56 when setting the application activation. The registered pattern is used for user authentication processing for starting an application.

  Therefore, in this processing procedure, as shown in FIG. 37, position information on the X axis and the Y axis representing the point where the finger is placed on the touch panel unit 56 is detected (step S611). It is determined to which range the position of the point corresponds (step S612). The pressure from the finger or the touch pen is calculated (step S613). The movement of the point is monitored (step S614). If there is a movement of the point (YES in step S614), the acceleration of the movement of the point or the movement speed of the point is calculated from the movement of the position of the point (step S615).

  In this case, a pattern is generated based on the position information, pressure, and acceleration of the touch input (step S616), the pattern is registered in the pattern registration unit (step S617), and the process returns to step S602 of the main routine (FIG. 36). Then, the application activation setting is executed.

  After the application activation setting is executed as described above, the application activation processing procedure requires that the input pattern matches the registered pattern by pattern recognition by touch input for application activation.

  Therefore, in this application activation processing procedure, as shown in FIG. 38, it is determined whether or not the application is activated (step S621). If the application is not activated (NO in step S621), this process is terminated. If the application is activated (YES in step S621), the touch input described above is performed (step S622). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

  It is determined whether the input pattern obtained by the touch input matches the registered pattern (step S623). If the input pattern matches the registered pattern (YES in step S623), the application is activated (step S624). If the input pattern does not match the registered pattern (NO in step S623), the application cannot be activated. (Step S625). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

  Therefore, in the specific processing procedure of the application activation, as shown in FIG. 39, it is monitored whether the application is activated (step S631). If the application is activated, touch input is performed. In this case, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S632). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S633). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, back, left and right (step S634). For example, when the point 9b is registered, it is determined whether the points 8a to 10a, 8b to 10b, and 8c to 10c are applicable. If this determination does not correspond to the coordinate range of the position of the point (NO in step S634), the application cannot be activated (step S635).

  In this determination, if it falls within the coordinate range of the position of the point (YES in step S634), as a second determination of whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step) S636). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] x 0.8 to XX [N] x 1.2. Determine whether. If the pressure does not fall within the predetermined pressure range (NG in step S637), the application cannot be activated (step S638).

If such pressure determination is within a predetermined pressure range (OK in step S637), the movement of the point is monitored (step S639), and if there is a movement of the point (YES in step S639), the movement of the position of the point from An acceleration is calculated, and the acceleration is compared with a registered pattern for determination (step S640). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S641). If this acceleration is outside the predetermined range (NG in step S641), the application cannot be activated (step S642).

  If the acceleration is within a predetermined range (OK in step S641), application activation is executed (step S643).

  As described above, since the application activation is permitted by using a pattern that recognizes at least two types of physical information obtained from the touch input as determination elements, it is possible to prevent the application activation when the input pattern does not match the registered pattern. In addition, the application can be protected from free activation, and security can be increased.

[Sixth Embodiment]

  In the sixth embodiment, a touch input pattern determination is used for logging in to a website using a network communication function.

  With reference to FIGS. 40, 41, 42 and 43, the sixth embodiment will be described. FIG. 40 is a flowchart showing the processing procedure for login setting to the website, FIG. 41 is a flowchart showing the processing procedure for pattern registration, FIG. 42 is a flowchart showing the processing procedure for logging in to the website, and FIG. It is a flowchart which shows the specific process sequence of login to a website.

  The processing procedure for setting login to this website is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. In this processing procedure, the touch input pattern is recognized using the above-described physical information obtained from the touch input to the touch panel unit 56 for the login setting, and the registered pattern is set as the login information.

  Therefore, in this processing procedure, as shown in FIG. 40, it is determined whether or not the login setting is set (step S701). If the login setting is not set (NO in step S701), the processing ends.

  If it is login setting (YES in step S701), the pattern registration mode is activated and pattern registration is performed (step S702). It is determined whether or not the pattern has been registered (step S703). If the pattern is not registered (NO in step S703), this process ends. If the pattern is registered (YES in step S703), login setting is executed (step S704). Since this login setting is related to pattern registration by touch input, it is necessary for the login pattern to match the input pattern for login to the website.

  The pattern registration process used for login is a process of registering a touch input pattern for the touch panel unit 56 at the time of login setting. The registered pattern is used for user authentication processing for login.

  Therefore, in this processing procedure, as shown in FIG. 41, position information on the X axis and the Y axis representing the point where the finger is placed on the touch panel unit 56 is detected (step S711). It is determined to which part of the coordinate range the position of the point corresponds (step S712). The pressure from the finger or the touch pen is calculated (step S713). The movement of the point is monitored (step S714). If there is a point movement (YES in step S714), the acceleration of the point movement is calculated or the movement speed of the point is calculated from the position distance movement of the point (step S715).

  In this case, a pattern is generated by the position information, pressure, and acceleration of the touch input (step S716), the pattern is registered in the pattern registration unit (step S717), and the process returns to step S702 of the main routine (FIG. 40). Then, login settings are executed.

  After the login setting is executed in this way, in the login processing procedure, for login, it is necessary that the input pattern matches the registered pattern by pattern recognition by touch input.

  Therefore, in this login processing procedure, as shown in FIG. 42, it is determined whether or not the user is logged in (step S721). If not logged in (NO in step S721), the processing is terminated. If it is login (YES in step S721), the touch input described above is performed (step S722). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

  It is determined whether the input pattern obtained by the touch input matches the registered pattern (step S723). If the input pattern matches the registration pattern (YES in step S723), login is executed (step S724). If the input pattern does not match the registration pattern (NO in step S723), login is disabled (step S723). S725). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

  Therefore, in the specific processing procedure of this login, as shown in FIG. 43, it is monitored whether or not it is a login (step S731), and if it is a login, touch input is performed. In this case, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S732). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S733). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S734). For example, when the point 9b is registered, it is determined whether the points 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not fall within the coordinate range of the point position (NO in step S734), login to the site is disabled (step S735).

  In this determination, if it falls within the coordinate range of the position of the point (YES in step S734), as a second determination of whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step (step S734). S736). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] x 0.8 to XX [N] x 1.2. Determine whether. If the pressure does not fall within the predetermined pressure range (NG in step S737), login is disabled (step S738).

If such a pressure determination is within a predetermined pressure range (OK in step S737), the movement of the point is monitored (step S739), and if there is a movement of the point (YES in step S739), the movement of the position of the point from An acceleration is calculated, and this acceleration is compared with a registered pattern for determination (step S740). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S741). If this acceleration is outside the predetermined range (NG in step S741), login is disabled (step S742).

  If the acceleration is within a predetermined range (OK in step S741), login is executed (step S743).

  As described above, by using a pattern in which at least two types of physical information obtained from touch input are recognized as determination elements, login is permitted. Therefore, login when the input pattern does not match the registered pattern can be prevented. Moreover, free login can be prevented and security can be improved.

[Seventh Embodiment]

  The seventh embodiment is processing for selecting whether an existing registration pattern is shared or a new pattern is registered.

  This embodiment will be described with reference to FIG. FIG. 44 is a flowchart illustrating a lock setting process.

  In this embodiment, as the lock setting, a process of selecting whether to register a registered pattern or register a new pattern is used together. However, such pattern registration is not limited to the lock setting.

  Therefore, in this processing procedure, as shown in FIG. 44, it is determined whether or not the lock is set (step S801). If the lock is not set, this processing ends.

  If it is the lock setting, it is determined whether the registered pattern already registered is used for unlocking (step S802). If an existing registration pattern is used for unlocking (YES in step S802), lock setting is executed (step S803), and this process is terminated.

  When an existing registered pattern is not used (NO in step S802), it is determined whether a new pattern is set (step S804). If no new pattern is set (NO in step S804), this process ends.

  When a new pattern is set (YES in step S804), pattern registration is executed (step S805). Since the pattern registration is as described in the above embodiment, its description is omitted.

[Comparative example]

  The comparative example is a portable terminal device that includes a malfunction prevention lock on the touch panel unit, and is configured to operate the call end button when the call ends.

  For this comparative example, reference is made to FIG. 45 and FIG. FIG. 45 is a diagram illustrating a comparative example of the mobile terminal device, and FIG. 46 is a flowchart illustrating a processing procedure of the end call.

  As shown in FIG. 45, the portable terminal device 220 has a touch panel portion 256 installed together with a display portion 248 on the front surface portion of a housing 278. A microphone 266 and a lock key 118 and a receiver 268 are installed on the housing 278 with the display unit 248 interposed therebetween, and an end button 120 is installed on the touch panel unit 256. The end button 120 is enabled after the touch panel lock is released by pressing the lock key 118, and the end operation can be performed.

  Therefore, in the process for ending the call of the mobile terminal device 220, as shown in FIG. 46, a call is determined (step S901), and if the call is not in progress (NO in step S901), this process ends.

  If the call is in progress (YES in step S901), the malfunction prevention operation of the touch panel unit 256 is started. That is, when the user places the portable terminal device 220 on the ear, the touch panel unit 256 detects it and sets the touch panel lock (step S902). This touch panel lock is a process of blocking touch input to the touch panel unit 256 in order to prevent an end of talk due to careless touch input. In this case, the operation of the end call button 120 is invalid.

  To end the talk, the lock key 118 is pressed (step S903), and the lock is released (step S904). With this unlocking, the touch input on the touch panel unit 256 and the operation of the call end button 120 become effective.

  Therefore, when the end button 120 is selected (step S905) and the button is pressed, the end of the call is reached (step S906).

  In such a configuration, if the lock key 118 is inadvertently operated during a call, the touch panel unit 256 becomes effective, which may cause an unexpected end of the user. Moreover, even if the touch panel lock is automated, it can be easily released, so there is a disadvantage that malfunctions cannot be avoided by multiple operations. Such a problem is solved in the above embodiment or other embodiments described later, and a highly convenient portable terminal device is realized. In addition, according to the above-described embodiment, it is not necessary to install a lock release button, and mechanical switches and controls can be omitted, contributing to the compactness and simplification of the mobile terminal device.

[Other Embodiments]

  (1) In the above embodiment, the touch input pattern is recognized using at least two types of physical information obtained from the touch input as determination elements. Examples of the physical information include the number of touch input points, position, speed, acceleration, angle, pressure, and angular velocity, but are not limited thereto. Therefore, the physical information may include any one of these or any of these.

  (2) For pattern recognition, the logical product of two or more types of physical information may be used as a determination factor. As an example, the logical product of the touch position and acceleration (second embodiment: FIG. 11), the logical product of the number of touch points, its position, acceleration, angle and pressure (third embodiment: FIG. 22). Although the fourth embodiment: FIG. 32) is exemplified, the present invention is not limited to this. The logical product of physical information may be a combination of different types of physical information, and the physical information may be at least two types, and three or more types may be combined to generate a pattern by logical product.

  (3) Although the acceleration sensor unit 60 is provided in the above embodiment, the present invention is not limited to this. A configuration may be used in which the velocity is obtained from the movement of the touch position per unit time, and the acceleration is calculated by differentiating the velocity.

  (4) In the above embodiment, the angular velocity sensor unit 64 detects the angular velocity of the mobile terminal device 20, but is not limited to this. A sensor that detects the movement of the mobile terminal device 20 may be provided, and the angular velocity may be calculated from the sensor output. Moreover, it replaces with the angular velocity of the portable terminal device 20, and calculates the angular velocity of the touch position with respect to the touch panel part 56, and it is good also as physical information.

  (5) In the above embodiment, the mobile terminal device 20 is illustrated as an example of the electronic device, but the electronic device of the present disclosure is not limited to this. Any electronic device capable of touch input may be used. For example, it may be a personal computer (PC) 320 (FIG. 47), a foldable mobile phone 420 (FIG. 48), a remote controller 520 (FIG. 49), or a game as long as it is an electronic device capable of touch input. It may be a device or an automobile engine starting device.

  (6) As shown in FIG. 47, the PC 320 is configured such that a keyboard side housing 322 and a display side housing 324 can be folded by a hinge 326, and the display side housing 324 includes a display unit. 48 and the touch panel unit 56 are set. The touch panel unit 56 is configured according to the above-described embodiment, and can perform pattern recognition and pattern registration by the above-described processing from touch input. For this reason, also in this PC320, the same function as the said embodiment is implement | achieved and the effect can be acquired.

  (7) The mobile phone 420 is an example of the electronic device or the mobile terminal device 20 described above. As shown in FIG. 48, the operation side casing 422 and the display side casing 424 are hinge portions 426. The touch panel unit 56 is set in the display-side housing unit 424 together with the display unit 48. The touch panel unit 56 is configured according to the above-described embodiment, and can perform pattern recognition and pattern registration by the above-described processing from touch input. For this reason, this mobile phone 420 can realize the same functions as those in the above-described embodiment and obtain the effects. In this case, the keypad 428 is included in the input unit 46 (FIG. 4) described above.

  (8) The remote controller 520 is means for remotely operating various electronic devices 522 such as a television receiver using radio waves or sound waves, as shown in FIG. Such a remote controller 520 can be equipped with the functions described for the electronic device or the mobile terminal device of the present disclosure, and the same functions and effects can be obtained.

  (9) If the function of the present disclosure is mounted on an automobile engine activation device, the engine can be activated by an input pattern that matches a pattern registered only by the user, and security can be improved.

  (10) In the above embodiment, the pressure [N] at the point is exemplified (FIGS. 17, 21, 39, and 43), but the present invention is not limited to this. As the pressure at the point, a pressure [Pa] obtained by dividing the force acting on the point by the area may be used.

As described above, the embodiment of the electronic device, the operation detection method, or the operation detection program of the present disclosure has been described, but the present invention is not limited to the above description. It goes without saying that various modifications and changes can be made by those skilled in the art based on the gist of the invention described in the claims or disclosed in the specification. It goes without saying that such modifications and changes are included in the scope of the present invention.

The electronic device, operation detection method, or operation detection program of the present disclosure recognizes a pattern using at least two types of physical information obtained from touch input as determination elements, and performs pattern registration and input pattern determination. Therefore, the convenience of the device including the touch input unit is enhanced and useful.

2 Electronic equipment 4 Touch input unit 6 Pattern recognition unit 8 Pattern registration unit 10 Pattern determination unit 40 Lock control unit 42 Processor (application activation unit)
44 sensor unit 52 communication unit (end call function unit, login function unit)
54 storage unit 56 touch panel unit 58 pressure sensor unit 60 acceleration sensor unit 62 position sensor unit 64 angular velocity sensor unit 72 program storage unit 74 data storage unit

Claims (6)

A touch input unit;
A pattern recognition unit that recognizes a pattern using at least two types of physical information obtained from touch input as a determination element;
If the pattern recognized by the pattern recognition unit matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or approximates the registered pattern A pattern determination unit that generates an output indicating that it matches the range;
An electronic device comprising:   The electronic device according to claim 1, wherein the physical information includes any one or any of touch input point number, position, speed, acceleration, angle, pressure, angular velocity.   The electronic device according to claim 1, wherein the pattern recognition unit uses a logical product of two or more types of the physical information as a determination element, and recognizes the pattern based on the determination element.   Furthermore, a lock function unit that releases the lock by the determination output of the pattern determination unit, an application activation unit that activates an application by the determination output of the pattern determination unit, and an end call function unit that ends the call by the determination output of the pattern determination unit The electronic device according to claim 1, further comprising any one of a login function unit that logs in to a website according to a determination output of the pattern determination unit. An operation detection method executed by an electronic device equipped with a touch input unit,
Recognizing a pattern using at least two types of physical information obtained from touch input as determination elements;
When the recognized pattern matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or matches the approximate range of the registered pattern Generating an output representative of
An operation detection method for an electronic device, comprising: An operation detection program executed by an electronic device equipped with a touch input unit,
A function of recognizing a pattern using at least two types of physical information obtained from touch input as a determination element;
When the recognized pattern matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or matches the approximate range of the registered pattern A function that generates an output representing
An electronic device operation detection program comprising:

Images