TW201324275A - System for inputting gesture anywhere to execute corresponding control and method thereof - Google Patents

Abstract

A system for inputting gesture anywhere to execute corresponding control and a method thereof are provided. By providing a full screen transparent input layer, obtaining a gesture track input by a gesture on any location of the transparent input layer, and determining a target instruction set based on the gesture track, the system and the method can input gesture on any location on touch device, and achieve the effect of setting gesture corresponds instruction set customized.

Description

System and method for inputting target gestures at arbitrary positions to perform corresponding control

A system and method for performing corresponding control according to a target gesture, in particular, a system and method for providing a target gesture to perform corresponding control at an arbitrary position.

Traditionally, the communication interface between people and computers or machines is mainly based on keyboards and mice. With the advancement of technology, electronic devices are more and more controlled, resulting in a more friendly human-machine interface. In order to allow users to operate the electronic device more intuitively, the way to operate with the touch screen is increasingly The more common. In recent years, due to the booming development of high-tech industries and the rise of information and consumer products, users have become more and more demanding for simple operation interfaces, making touch-based interfaces a product design trend.

For example, many technology companies have published electronic devices that use touch screen controls. However, in the current touch-type electronic device, if the touch-sensitive electronic device is to be operated by gesture, the user can only input a gesture at a fixed position, and cannot input at a suitable position by himself. In other words, the user does not change the input position of the touch-sensitive electronic device. In addition to reducing the degree of freedom for the user to operate the touch-sensitive electronic device, if the position of the input gesture overlaps with the content to be viewed. , it is easy to affect the browsing of the content when the gesture is input, causing trouble for the user.

In summary, it has been known in the prior art that the gesture input position of the touch-sensitive electronic device has been limited for a long time, and therefore it is necessary to propose an improved technical means to solve the problem.

In view of the problem that the gesture input position of the touch control electronic device cannot be changed in the prior art, the present invention discloses a system and a method for inputting a target gesture at any position to perform corresponding control, wherein the disclosure of the present invention is provided by a system for inputting a target gesture at any position to perform corresponding control, comprising at least: an input layer providing module for providing a transparent input layer of a full screen; and a trajectory capturing module for capturing a target input at any position of the transparent input layer a gesture trajectory; an instruction set setting module configured to set a corresponding target instruction set according to the gesture trajectory, wherein the target instruction set corresponds to the target function and includes one or more target instructions; the instruction set determining module is configured to: The corresponding target instruction set is determined according to the gesture track; the instruction set execution module is configured to provide an execution target instruction set, thereby completing the target function.

The method for inputting a target gesture to perform corresponding control at an arbitrary position, the method comprising the steps of: providing a target instruction set corresponding to a target gesture, the target instruction set corresponding to the target function, and including one or more targets The instruction provides a transparent input layer of the full screen; captures the gesture track of the target gesture input at any position of the transparent input layer; determines the corresponding target instruction set according to the gesture track; and provides an execution target instruction set to complete the target function.

The system and method disclosed in the present invention are as above, and the difference between the prior art and the prior art is that the present invention captures the gesture track of the target gesture input at any position of the transparent input layer after providing the transparent input layer of the full screen, and according to the capture The gesture trajectory is judged to correspond to the target instruction set, so as to solve the problems existing in the prior art, and the technical effect of the customized gesture can be achieved.

The features and embodiments of the present invention will be described in detail below with reference to the drawings and embodiments, which are sufficient to enable those skilled in the art to fully understand the technical means to which the present invention solves the technical problems, and The achievable effects of the present invention.

The invention provides a user inputting a customized target gesture, and defines a target instruction set corresponding to the target gesture, and when the user inputs the target gesture, executes a corresponding target instruction set, thereby completing the target function.

The target instruction set of the present invention includes one or more target instructions, and each target instruction can reach a corresponding result after execution, for example, the target instruction can be deleting a file, opening a specific software, inputting a specific character, and executing software. The specific functions and the like, the present invention is not limited thereto. In addition, after the target instruction set is executed, the corresponding target function can be completed.

The target function provided by the present invention may be a predetermined function provided by the operating platform of the present invention, such as storing a software-edited file and closing the software, or closing all software, etc., or even inputting corresponding Characters, the invention is not limited thereto. The target function can also be a user-defined function, such as storing a software-edited file and opening or reloading the file with another software, or copying a specific file to multiple directories, and the present invention does not Limited to the above.

Hereinafter, the system operation of the present invention will be described with reference to a system architecture diagram of the present invention which provides a target gesture for inputting a target gesture at any position to perform corresponding control. As shown in FIG. 1, the system 100 of the present invention includes an input layer providing module 110, a track capturing module 120, an instruction set setting module 130, an instruction set determining module 150, and an instruction set executing module 170.

The input layer providing module 110 is responsible for providing a full-screen transparent input layer on the touch screen 420 external to the system 100. The transparent input layer provided by the input layer providing module 110 is undetectable to the user, and the user can input a target gesture at any position of the touch screen 420.

The target gesture input on the touch screen 420 is arbitrarily determined by the user. For example, the user draws a line on the touch screen 420, draws a triangle, or draws a line or shape without rules. The lines or graphics may be the target gestures proposed by the present invention.

The trajectory capture module 120 is responsible for capturing a gesture trajectory of the input target gesture after a target gesture is input on the transparent input layer, for example, a horizontal line, a triangle, a circle, a star, or an irregular shape.

The trajectory capture module 120 can perform feature determination on the captured gesture trajectory after capturing the gesture trajectory of the target gesture, and the trajectory capture module 120 determines the features, such as the direction of the gesture trajectory, the turning point, the turning angle, and the length. Etc., but the invention is not limited thereto.

It is worth mentioning that if the target gesture is input in the setting interface of the set target gesture and the corresponding target instruction set, the feature determined by the trajectory capture module 120 is referred to as a "set feature" in the present invention, and If the target gesture is not input in the setting interface of the setting target gesture and the corresponding target instruction set, for example, in a general input interface, the feature determined by the trajectory capturing module 120 is referred to as "trajectory feature" in the present invention. .

The instruction set setting module 130 is responsible for providing a target instruction corresponding to the target gesture and/or selecting a target instruction corresponding to the target gesture, and the input target instruction and the selected target instruction are the target instruction set corresponding to the target gesture.

The instruction set setting module 130 is also responsible for using the set feature determined by the trajectory capture module 120 from the captured gesture trajectory as an index of the corresponding target instruction set, and storing it in the storage medium 460, so that the trajectory capture module 120 The set feature is determined to be an index feature of the corresponding target instruction set, thereby completing the setting of the captured gesture track and the corresponding target instruction set by the track capture module 120.

The instruction set determination module 150 is responsible for determining the corresponding target instruction set from the captured gesture trajectory according to the trajectory capture module 120. In general, the instruction set determining module 150 can compare the trajectory features determined by the captured trajectory by the trajectory capture module 120 and the index features corresponding to the target instruction set, such as the turning point, the breaking point, and the intersection of the trajectory. The positional relationship between the positional relationship or the positional relationship of the coordinate points through which the trajectory passes, and the order of the coordinate points, etc., when the instruction set judgment module 150 matches the trajectory feature and the index feature, the index can be judged and corresponding. The feature matching target instruction set corresponds to the captured trajectory of the trajectory capture module 120.

The instruction set execution module 170 is responsible for providing the target instruction set determined by the execution instruction set determination module 150, thereby completing the target function corresponding to the determined target instruction set.

In general, the instruction set execution module 170 can directly execute the target instruction set to perform the target function. However, the present invention is not limited thereto. For example, the instruction set execution module 170 can also call an application interface (API) of a software external to the system 100 to execute a target instruction set through a software application interface. The software that provides the application interface called by the instruction set execution module 170 is installed in the work platform executed by the system 100.

In addition, the system 100 of the present invention may further include an input mode determining module 190. The input mode determining module 190 is responsible for determining whether the system 100 enters an input mode, so that the input layer providing module 110 determines the system in the input mode determining module 190. 100 enters the input mode to provide a transparent input layer to the user to input the target gesture.

Next, an operational system and method of the present invention will be described with reference to an embodiment. Referring to FIG. 2A, a flowchart of a method for inputting a target gesture at any position to perform corresponding control is provided. In this embodiment, the present invention is implemented on a portable device, and the portable device includes a touch screen 420 and a storage medium 460.

When the user uses the present invention, the instruction set setting module 130 may first provide a target instruction set corresponding to the target gesture by the user (step 210), thereby storing the target gesture and the corresponding target instruction set to the storage of the portable device. In the medium 460, after the user completes the corresponding setting of the target gesture and the target instruction set, the target instruction set can be executed using the set target gesture. In this embodiment, it is assumed that the user's settings include a left arrow, a pentagram, an X, and the like, wherein the left arrow controls the browser to perform "back to the previous page" and "reorganize the page" twice. The instruction, the pentagram is an instruction to control the browser to execute the "add bookmark", and X is an instruction to control the execution of the operating platform of the present invention to delete the file.

In practice, if the invention executed on the portable device includes the input mode determination module 190, after the start of the present invention, whether the instruction set setting module 130 provides the user setting target gesture and the corresponding target instruction set (Step 210), the input mode determination module 190 determines whether the portable device enters the input mode (step 230). When the user browses the webpage by using the browser, since the user may not only simply browse the webpage, but may perform the predetermined function provided by the browser, the input mode judging module 190 may judge that the portable device enters the input mode, so The input layer providing module 110 will provide a full-screen transparent input layer on the touch screen 420 (step 250).

If the present invention executed on the portable device does not include the input mode determining module 190, after the start of the present invention, the input layer providing module 110 will set the target gesture regardless of whether the command set setting module 130 provides the user. The corresponding target instruction set (step 210) will continue to provide a full-screen transparent input layer on the touch screen 420 (step 250).

After the input layer providing module 110 provides a full-screen transparent input layer (step 250), if the user wishes to add the webpage "www.inv.com" being browsed to the bookmark, the user can directly touch the touch screen. Enter the pentagram target gesture at any position, such as the center, top left, bottom left, top right, and bottom right of the 420.

When the user inputs a target gesture on the touch screen 420, the trajectory capture module 120 can capture the gesture trajectory of the target gesture input by the user (step 260). Since in this embodiment, the target gesture input by the user is a pentagram, the trajectory capture module 120 can capture the gesture trajectory of the pentagram.

Since the user ends the input after inputting the pentagram target gesture, after the trajectory capture module 120 captures the pentagram gesture trajectory, the gesture trajectory will not be captured any more, so after a period of time For example, after zero and five seconds, the trajectory capture module 120 can confirm that the user has completed the input, and start to determine the trajectory feature according to the captured gesture trajectory, that is, the trajectory feature of the pentagram, for example, five equal lengths. Line segments, the direction is left lower, upper right, left, lower right, upper left, and so on.

After the trajectory capture module 120 captures the gesture trajectory of the target gesture input by the user (step 260), the instruction set determination module 150 can determine the corresponding target instruction set according to the gesture trajectory captured by the trajectory capture module 120. (Step 270), and the corresponding target instruction set is read. In this embodiment, it is assumed that the instruction set determining module 150 uses the trajectory feature determined by the captured trajectory captured by the trajectory capture module 120 as shown in the flow of "2C" (step 271). The trajectory feature determined by the trajectory capture module 120 compares the index feature of the target instruction set stored in the storage medium 460 of the portable device (step 273). Since the storage medium 460 does store the gesture according to the pentagram The feature determined by the trajectory is used as the target instruction set of the index feature, that is, the instruction of “adding a bookmark”. Therefore, the instruction set judging module 150 can determine that there is an index feature conforming to the trajectory feature of the pentagram after the comparison. Therefore, the instruction set determining module 150 can determine that the target instruction set whose index feature is a pentagonal trajectory feature corresponds to the gesture trajectory captured by the trajectory capture module 120 (step 277).

After the instruction set determination module 150 reads the target instruction set corresponding to the gesture trajectory captured by the trajectory capture module 120, the instruction set execution module 170 may provide an execution target instruction set to complete the target function (step 290). In this embodiment, the instruction set execution module 170 can directly execute the "add bookmark" instruction, for example, open the file of the browser used by the user to record the bookmark, and the webpage of the webpage that the user is browsing is "www. Inv.com" writes to the file and then closes the file, thus completing the bookmarking instructions. In fact, the instruction set execution module 170 can also call the function of opening the bookmark list through the application interface provided by the browser used by the user, and the webpage of the webpage that the user is browsing is "www.inv.com". Add to the bookmark list, so that after the user presses the confirmation in the bookmark list, the "Add Bookmark" command can be completed.

In the above embodiment, it is assumed that the instruction set setting module 130 provides a setting interface 300 as shown in FIG. 3, wherein the setting interface 300 includes a target trajectory display area 310, a predetermined instruction selection field 320, and a custom instruction. The input field 330, the setting button 341, the cancel button 342, and the set command field 350 are input.

When the command set setting module 130 provides the user to set the target gesture and the corresponding target instruction set, the input layer providing module 110 provides a full screen in the touch screen 420 as shown in the flow of "2B". The transparent input layer (step 211), wherein if the invention executed on the portable device includes the input mode determining module 190, the input mode determining module 190 determines when the command set setting module 130 provides the setting interface 300. The portable device enters the input module. Therefore, the input layer providing module 110 also provides a full-screen transparent input layer in the touch screen 420 (step 211).

Then, the user can input a target gesture on the touch screen 420, such as a left arrow, a five-pointed star, an X, etc., and the trajectory capture module 120 can capture the gesture trajectory of the target gesture input by the user (step 213), and A set feature of the captured gesture track is determined (step 215). Wherein, since the process of capturing the gesture trajectory of the target gesture and determining the setting feature of the gesture trajectory is similar to the above-mentioned step 260, no further description is made.

After the trajectory capture module 120 captures the gesture trajectory of the target gesture input by the user (step 213), the provided gesture set setting module 130 can display the captured gesture trajectory in the target trajectory display area 310 of the setting interface 300. .

When the instruction set setting module 130 provides the setting interface 300, the instruction set setting module 130 also provides the user to select the target instruction in the predetermined instruction selection field 320, and/or enter the target in the custom instruction input field 330. And instructing the user to press the set button 341 to display the target command selected by the user and/or the input target command in the set command field 350. The instruction set setting module 130 also provides the user to select a target command in the set command field 350 and press the cancel button 342 to delete the set target command.

After the track capture module 120 determines the set feature of the captured gesture track (step 215) and the command set setting module 130 provides the set target command set, the command set setting module 130 can determine the track capture module 120. The setting feature is used as an index feature of the setting target instruction set provided by the instruction set setting module 130, and the index feature and the target instruction set are stored (step 219). Thus, the instruction set setting module 130 provides the user with the target gesture and the corresponding target. The setting of the instruction set.

In summary, it can be seen that the difference between the present invention and the prior art is that after having a transparent input layer that provides a full picture, the gesture track of the target gesture input at any position of the transparent input layer is captured, and according to the captured gesture track The technical means for judging the corresponding target instruction set can solve the problem that the gesture input position of the touch electronic device in the prior art cannot be changed by the technical means, thereby achieving the technical effect of the customized gesture.

Furthermore, the method for inputting a target gesture to perform corresponding control at any position can be implemented in hardware, software or a combination of hardware and software, or can be implemented in a centralized manner or in different components in a computer system. Distributed implementation of a number of interconnected computer systems.

While the embodiments of the present invention have been described above, the above description is not intended to limit the scope of the invention. Any modification of the form and details of the practice of the present invention, which is a matter of ordinary skill in the art to which the present invention pertains, is a patent protection of the present invention. range. The scope of the invention is to be determined by the scope of the appended claims.

100. . . system

110. . . Input layer providing module

120. . . Track capture module

130. . . Instruction set setting module

150. . . Instruction set judgment module

170. . . Instruction set execution module

190. . . Input mode judgment module

300. . . Setting interface

310. . . Target track display area

320. . . Scheduled instruction selection field

330. . . Custom command input field

341. . . Setting button

342. . . Cancel button

350. . . Command field has been set

420. . . Touch screen

460. . . Storage medium

Step 210 provides a target instruction set corresponding to the target gesture, where the target instruction set corresponds to the target function and includes one or more target instructions.

Step 211 provides a transparent input layer for the full screen.

Step 213: capturing a gesture track of the target gesture input in the transparent input layer

Step 215: determining a setting feature of the gesture track

Step 219: storing the set feature as an index feature corresponding to the target instruction set

Step 230: Determine whether to enter the input mode

Step 250 provides a transparent input layer for the full screen

Step 260 captures the gesture track of the target gesture input at any position of the transparent input layer

Step 270: determining a corresponding target instruction set according to the gesture track

Step 271: determining the trajectory feature by the gesture track

Step 273 compares the trajectory features and the index features corresponding to the target instruction set

Step 277: When the trajectory feature conforms to the index feature, determining the target trajectory corresponding to the target instruction set

Step 290 provides execution of a target instruction set to complete the target function

FIG. 1 is a system architecture diagram of the present invention for inputting a target gesture at any position to perform corresponding control.

FIG. 2A is a flow chart of a method for inputting a target gesture at any position to perform corresponding control according to the present invention.

FIG. 2B is a flow chart of a detailed method for setting a target gesture and a corresponding target instruction set according to the present invention.

FIG. 2C is a flowchart of a detailed method for determining a target instruction set corresponding to a target gesture according to the present invention.

FIG. 3 is a schematic diagram of a setting interface according to an embodiment of the present invention.

Step 210 provides a target instruction set corresponding to the target gesture, where the target instruction set corresponds to the target function and includes one or more target instructions.

Step 230: Determine whether to enter the input mode

Step 250 provides a transparent input layer for the full screen

Step 260 captures the gesture track of the target gesture input at any position of the transparent input layer

Step 270: determining a corresponding target instruction set according to the gesture track

Step 290 provides execution of a target instruction set to complete the target function

Claims (10)

A method for inputting a target gesture at any position to perform corresponding control, the method comprising at least the steps of: providing a target instruction set corresponding to a target gesture, the target instruction set corresponding to a target function, and including one or more a target instruction; providing a transparent input layer of the full screen; capturing a gesture track of the target gesture input at any position of the transparent input layer; determining the corresponding target instruction set according to the gesture track; and providing the target The instruction set is used to accomplish this target function. The method for inputting a target gesture to perform corresponding control at any position as described in claim 1, wherein the step of determining the target instruction set according to the gesture trajectory is to determine a trajectory feature by the gesture trajectory, and Comparing the trajectory feature and an index feature corresponding to the target instruction set, when the trajectory feature conforms to the index feature, determining that the target instruction set corresponds to the gesture trajectory. The method for inputting a target gesture to perform corresponding control at any position as described in claim 1, wherein the step of providing a target instruction set corresponding to a target gesture further comprises capturing in the transparent input layer. Entering one of the gesture gestures of the target gesture, determining one of the gesture trajectory setting features, and storing the set feature as an index feature corresponding to the target instruction set. The method for inputting a target gesture to perform corresponding control at any position as described in claim 1 of the patent application, wherein the method further comprises determining whether to enter the input mode before the step of providing the transparent input layer of the full screen, and The step of providing the transparent input layer is determined after entering the input mode. A system for inputting a target gesture at any position to perform corresponding control, the system comprising at least: an input layer providing module for providing a transparent input layer of a full picture; and a track capturing module for capturing the transparent a gesture track of one of the target gestures input at any position of the input layer; an instruction set setting module configured to set a corresponding target instruction set according to the gesture track, wherein the target instruction set corresponds to a target function, and Include one or more target instructions; an instruction set determining module for determining the corresponding target instruction set according to the gesture trajectory; and an instruction set execution module for providing execution of the target instruction set, thereby completing the target Features. The system for inputting a target gesture to perform corresponding control at any position as described in claim 5, wherein the trajectory capture module captures the gesture trajectory of the target gesture input in the transparent input layer, Determining one of the gesture trajectory setting features, the instruction set setting module stores the set feature as an index feature corresponding to the target instruction set, thereby setting the gesture trajectory to correspond to the recruiting instruction set. The system for inputting a target gesture to perform corresponding control at any position as described in claim 5, wherein the command set determining module is more than the trajectory feature determined by the trajectory of the trajectory capture module An indexing feature corresponding to the target instruction set, when the trajectory feature conforms to the indexing feature, determining that the target instruction set corresponds to the gesture trajectory. The system for inputting a target gesture to perform corresponding control at any position as described in claim 5, wherein the system further includes an input mode determining module for determining whether the system enters an input mode, and the input layer provides a mode. The group further provides the transparent input layer after the input mode judging module judges that the system enters the input mode. A system for inputting a target gesture to perform corresponding control at any position as described in claim 5, wherein the target function is a predetermined function provided by the operating platform on which the system operates, or a user-defined function. The system for inputting a target gesture to perform corresponding control at any position as described in claim 5, wherein the instruction set execution module executes the target instruction set or executes the target instruction through an application interface of an external software. set.