KR101412431B1 - User Interface Method for User Command Input by Combination of Multi Touch and Tapping and Electronic Device using the same - Google Patents

Abstract

A user interface method of inputting a user command by combining multi-touch and tapping, and an electronic apparatus using the same United States Patent Application 20060145899 Kind Code: A1 When a first point is touched and a second point is tapped, 1 command. When the first point is tapped while the second point is touched, the second command is executed. The user can conveniently and accurately perform uncomfortable and inaccurate operations or other operations.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user interface method for inputting a user command by combining multi-touch and tapping, and an electronic apparatus using the method.

The present invention relates to a user interface, and more particularly, to a user interface method to which a touch-based user input is applied and an electronic apparatus using the method.

Most mobile devices employ a touch-based user input method to provide an intuitive user interface. The touch patterns of the past are mainly the way that the user directly touches desired icons or desired points.

However, the inconvenience of directly touching the desired object / location and the inaccuracies of the operation may cause inconvenience to the user, especially when the screen is operated while touching a small mobile device with a finger instead of a pen.

For example, when entering text through a small input window on a smartphone, moving the cursor with a finger touch is very inconvenient and inaccurate. Therefore, a search for a solution to this problem is required.

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and it is an object of the present invention to provide a multi- And inputting a user command, and an electronic apparatus using the same.

According to another aspect of the present invention, there is provided a user interface method including: performing a first command when a second point is tapped while a first point is touched; And performing a second command when the first point is tapped while the second point is touched.

And, the first instruction is an instruction related to a first direction, and the second instruction may be an instruction related to a second direction.

According to another aspect of the present invention, there is provided a user interface method including: performing a third command when the first point is touched and the second point is double-tapped; And performing a fourth command when the first point is multi-tapped while the second point is touched.

The first instruction and the third instruction are instructions related to a first direction, and the second instruction and the fourth instruction are instructions related to a second direction, The response by the fourth command is larger than the response by the first command, and the response by the fourth command may be greater than the response by the second command.

The first instruction and the third instruction are instructions for moving the cursor in the first direction, and the second instruction and the fourth instruction are instructions for moving the cursor in the second direction , The movement amount of the cursor by the third instruction is larger than the movement amount of the cursor by the first instruction and the movement amount of the cursor by the fourth instruction is larger than the movement amount of the cursor by the second instruction .

According to another aspect of the present invention, there is provided a user interface method including: performing a fifth command when a first peripheral point of the second point is tapped while the first point is touched; And performing a sixth command when the second peripheral point of the second point is tapped while the first point is touched.

The first command is a command related to a first direction, the second command is a command related to a second direction, the fifth command is a command related to a third direction, the sixth command is a command related to a third direction, May be an associated command.

The first peripheral point may be located at an upper portion of the second point, and the second peripheral point may be located at a lower portion of the second point.

The first instruction execution step may be performed when the second point is tapped in a state where the first point and the second point are multi-touched and the touch on the first point is maintained, The second command execution step may be performed when the first point is tapped in a state in which the first point and the second point are multi-touched and the touch on the second point is held.

According to another aspect of the present invention, there is provided an electronic device including: a user input unit for receiving touch and tapping from a user; And a second instruction is executed when the second point of the user input unit is tapped while the first point of the user input unit is touched. When the first point is tapped while the second point is touched, And a processor to perform the processing.

As described above, according to the embodiments of the present invention, it is possible to provide a user interface that can combine multi-touch and tapping to allow a user to conveniently and accurately perform uncomfortable and inaccurate operations or other operations .

Further, in the embodiments of the present invention, the position of the tapping point and the type of tapping are intuitively associated with the user command, thereby improving the intuitiveness and allowing the user to easily memorize the operation pattern.

Further, in the embodiments of the present invention, the user operation is represented by a digital type input method in which the operation and non-operation are clearly distinguished (broken) from each other in an analog form rather than continuously. .

Particularly, in the embodiments of the present invention, it is possible to more conveniently and precisely move the cursor or move the screen, which is inconvenient to input in the past.

1 to 9 are diagrams provided in a conceptual description of a user interface method according to an embodiment of the present invention,
10 to 13 are flowcharts illustrating a process of a user interface method according to an exemplary embodiment of the present invention,
FIG. 14 is a view for explaining a user interface method in a media player according to another embodiment of the present invention; FIG.
FIG. 15 is a diagram for explaining a user interface method in a telephone directory according to another embodiment of the present invention; FIG.
16 is a diagram for explaining a user interface method in a background screen according to another embodiment of the present invention,
17 is a diagram for explaining a user interface method in a map according to another embodiment of the present invention,
18 is a block diagram of a smartphone capable of applying user interface methods in accordance with embodiments of the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 to 9 are views provided in a conceptual description of a user interface method according to an embodiment of the present invention. The user interface method according to the present embodiment is a method of moving the cursor position by switching one touch to 'Single Tapping' or 'Double Tapping' after 'Multi Touch' .

Here, 'multi-touch' is the operation of the user who touches two points together on the touch screen with two fingers, 'single tapping' is the operation of the user tapping one point on the touch screen with one finger, 'Double tapping' refers to a user's operation of tapping one point twice in succession on the touch screen with one finger.

1 is a view illustrating a state where a multi-touch is performed on a touch screen of a smartphone, which is a kind of electronic device. The point at which "TC (TouCh)" is indicated in FIG. 1 indicates a point where the user touches with a finger. As shown in FIG. 1, it can be confirmed that the two points marked with "TC" are multi-taught by the user.

1, a text document is displayed on the touch screen of the smartphone, and a cursor C is positioned between " Ko "and" rean "

FIG. 2 is a diagram showing a result of single tapping of a right side point while a user holds a touch to a left side point in the multi-touch state shown in FIG. Quot; ST (Single Tapping) "at the right side of FIG. 2 corresponds to a notation indicating that a single tapping has been performed by the user.

As shown in FIG. 2, when the right side point is single-tapped in a state where the touch to the left side point is held, the cursor moves to the right by one space. The cursor C positioned between "Ko" and "rean" in FIG. 1 is moved to the right by one space, and it can be seen that it is located between "Kor" and "ean" in FIG.

FIG. 3 is a view showing a result of single tapping of the left point while the user holds the touch to the right side in the multi-touch state shown in FIG.

As shown in FIG. 3, when the left point is single-tapped in a state where the touch to the right point is maintained, the cursor moves to the left by one space. It can be seen that the cursor C positioned between "Ko" and "rean" in FIG. 1 moves to the left by one space, and is located between "K" and "orean" in FIG.

FIG. 4 is a diagram showing a result of double-tapping a right-hand point while a user holds a touch to a left-hand point in the multi-touch state shown in FIG. The "DT (Double Tapping)" at the right side of Fig. 4 corresponds to a notation indicating that the user has double-tapped.

As shown in FIG. 4, when the right point is double-tapped in a state where the touch to the left point is maintained, the cursor moves from the same line to the right end. It can be seen that the cursor C positioned between "Ko" and "rean" in FIG. 1 moves from the same line to the right end and is located on the right side of "folk" in FIG.

FIG. 5 is a diagram showing a result of double-tapping a left point while a user holds a touch to a right point in the multi-touch state shown in FIG.

As shown in FIG. 5, when the left point is double-tapped in a state where the touch to the right point is maintained, the cursor moves from the same line to the left end. It can be seen that the cursor C positioned between "Ko" and "rean" in FIG. 1 moves from the same line to the left end and is located on the left side of "creativity" in FIG.

FIG. 6 is a diagram showing a result of single tapping the upper portion of the right touch point while the user holds the touch to the left point in the multi-touch state shown in FIG. Comparing FIG. 6 with FIG. 1, it can be seen that the right single-tapping point shown in FIG. 6 is higher than the right-hand touch point shown in FIG.

As shown in FIG. 6, when the upper portion of the right touch point is singly tapped in a state where the touch to the left point is maintained, the cursor moves upward by one line. It can be seen that the cursor C located between "Ko" and "rean" in FIG. 1 moves upward by one line and is located between "diver" and "city" in FIG.

FIG. 7 is a diagram showing a result of single tapping the lower portion of the right touch point while the user holds the touch to the left point in the multi-touch state shown in FIG. Comparing FIG. 7 with FIG. 1, it can be seen that the right single tapping point shown in FIG. 7 is lower than the right touch point shown in FIG.

As shown in FIG. 7, when the lower portion of the right touch point is singly tapped in a state where the touch to the left point is maintained, the cursor moves downward by one line. The cursor C positioned between "Ko" and "rean" in FIG. 1 moves downward by one line, and it can be confirmed that it is located on the right side of "been" in FIG.

8 is a diagram showing a result of double-tapping the upper portion of the right touch point while the user holds the touch to the left point in the multi-touch state shown in FIG.

As shown in FIG. 8, when the upper part of the right touch point is double-tapped in a state in which the touch to the left point is maintained, the cursor moves up one page. It can be seen that the cursor C positioned between "Ko" and "rean" in FIG. 1 moves up one page and is located on the left side of "folk" in FIG.

FIG. 9 is a diagram showing a result of double-tapping the lower portion of the right touch point while the user holds the touch to the left point in the multi-touch state shown in FIG.

As shown in FIG. 9, when the lower portion of the right touch point is double-tapped in a state where the touch to the left point is maintained, the cursor moves down one page. In FIG. 1, the cursor C, which was located between "Ko" and "rean", moves down one page, and "Festival." It can be confirmed that it is located on the right side.

Up to now, a user interface method for switching the position of the cursor by switching one of the touch points to tapping after multi-touch has been described in detail with a preferred embodiment.

In the user interface method according to the present embodiment, it is assumed that the cursor is moved differently according to the position (left, right, top, and bottom) of the tapped point. Specifically, the tapping for the left point is a command related to the left direction (movement of one space to the left and movement to the left end), and the command for the right point is related to the right direction (movement to the right, , An instruction related to an upward direction (upward movement by one line, a movement upward by one page), and an instruction related to a downward movement (movement by one line downward, one page downward) Respectively, thereby improving the intuitiveness of the user.

In addition, in the user interface method according to the present embodiment, it is assumed that the cursor is moved differently according to the kind of tapping (single tapping and double tapping). Specifically, the double tapping with a large number of times of tapping is implemented such that the amount of movement of the cursor is made to be larger than that of the single tapping with a small tapping frequency ("left / right end? Left / right one column" Thereby further enhancing the intuitiveness of the user. In other words, the reaction size is proportional to the number of tapping times, thereby enhancing the intuitiveness of the user.

Hereinafter, a process of performing a user interface method for switching one of the touch points to tapping after multi-touch and moving the cursor variously will be described in detail with reference to FIGS. 10 to 13. FIG. 10 to 13 are flowcharts illustrating a process of a user interface method according to an exemplary embodiment of the present invention.

As shown in FIG. 10, when a multi-touch is input from a user (S200-Y) while waiting for a user input (S100), the smartphone determines a cursor movement mode by determining a user input pattern, (S300).

Step S300 will be described in detail below with reference to FIG. 11 is a detailed flowchart of step S300 in FIG. As shown in FIG. 11, when a multi-touch is input from the user (S200-Y), the smartphone first confirms the positions of the multi-touch points (S305).

If it is determined that the multi-touch points are horizontal (S310-Y), the smartphone waits for the first tapping input from the user (S315). If the 'multi-touch points are horizontal' in step S310, the line segment connecting the multi-touch points is parallel to the upper / lower sides of the smartphone touch screen. In other words, if the 'multi-touch points are horizontal' in step S310, the y-coordinates of the centers of the multi-touch points are the same.

On the other hand, if the user taps the touch screen (S320-Y), the smartphone checks the tapping point generated in S320 (S325). Then, the smartphone turns on the timer (S330) and waits for the secondary tapping input from the user (S335).

If the timer has been turned off (S355), the smartphone determines whether the single tapping occurred in step S320 is satisfied or not in step S325 The single tapping pattern is analyzed based on the check result at step S360 to determine a cursor movement mode, and the cursor is moved in a determined manner (S360). A detailed description of step S360 will be described later in detail with reference to FIG.

On the other hand, if tapping occurs during the second tapping input wait (S340-Y), the smartphone checks the tapping point generated in step S340 (S375) and turns off the timer (S377). Then, the smartphone determines the cursor movement mode by analyzing the double tapping pattern based on the check result obtained in steps S325 and S375 for the double tapping generated in steps S320 and S340, and moves the cursor in the determined manner (S380). A detailed description of step S380 will be described later in detail with reference to FIG.

12 is a detailed flowchart of step S360 of FIG. 12, a cursor moving method according to a single tapping pattern is specifically shown.

As shown in FIG. 12, when the touch of the left side point is held (S361-Y) and the right side point is single-tapped (S362-Y), the smartphone moves the cursor to the right by one space (S363). This has been described above with reference to FIG.

On the other hand, if the touch of the left point is held (S361-Y), and the upper portion of the right touch point is tapped (S364-Y), the smartphone moves the cursor up one line (S365). This has been described above with reference to FIG.

If the lower touch point is tapped (S366-Y), the smartphone moves the cursor down one line (S367) while the touch to the left point is maintained (S361-Y). This has been described above with reference to FIG.

On the other hand, if the touch of the right side point is held (S368-Y) and the left point is single-tapped (S369-Y), the smartphone moves the cursor one space to the left (S370). This has been described above with reference to FIG.

On the other hand, if the upper touch of the left touch point is tapped (S371-Y) while the touch on the right side is maintained (S368-Y), the smartphone moves the cursor up one line (S372). If the lower touch point is tapped (S373-Y), the smartphone moves the cursor down one line (S374) while the touch for the right point is maintained (S368-Y).

13 is a detailed flowchart of step S380 of FIG. 13 shows a method of moving a cursor according to a double tapping pattern.

As shown in FIG. 13, when the right side point is double-tapped (S382-Y), the smartphone moves the cursor to the right end of the line (S383) while the touch for the left side point is held (S381-Y). This has been described above with reference to FIG.

On the other hand, if the upper touch point is double-tapped (S384-Y) while the touch on the left side point is held (S381-Y), the smartphone moves the cursor up one page (S385). This has been described above with reference to FIG.

When the lower touch point is double-tapped (S386-Y), the smartphone moves the cursor down one page (S387) while the touch to the left point is maintained (S381-Y). This has been described above with reference to FIG.

On the other hand, if the left point is double-tapped (S389-Y), the smartphone moves the cursor to the left end of the line (S390) while touching the right point is maintained (S388-Y). This has been described above with reference to FIG.

On the other hand, if the upper touch of the left touch point is tapped (S391-Y) while the touch to the right side point is held (S388-Y), the smartphone moves the cursor up one page (S392). If the bottom of the left touch point is double-tapped (S393-Y), the smartphone moves the cursor down one page (S394).

The user interface method of the technique described so far is applicable to other interactions other than cursor movement, and the following examples illustrate other applications.

FIG. 14 is a diagram illustrating a situation where a media player is displayed on a touch screen of a smartphone. The user interface method of the above-described method for the operation of the media player shown in Fig. 14 is applicable. E.g,

1) 'Multi-touch right point single tapping' means' Play after 10 seconds', '

2) 'Multi-touch left point single tapping' means 'Play before 10 seconds'

3) 'Double tapping right point after multi touch' means 'Play media in the next sequence'

4) 'Multi tap and left point double tapping' means' Play media of previous order ','

5) 'Multitouch after right / upper point single tapping'

6) 'Multitouch, right / bottom point single tapping' means 'one step down volume'

7) 'Multi-touch after right / upper point double tapping'

8) 'Multi-touch after right / lower point double tapping'

9) 'Multi-Touch Left / Upper Point Single Tapping' means 'one channel up'

10) 'Multi-touch left / lower point single tapping' means 'one channel down'

11) 'Multi-touch, left / upper point double tapping' is the 'fastest channel'

12) 'Multi tap and left / lower point double tapping' means 'the channel of the latest sequence number'

As shown in FIG.

FIG. 15 is a diagram illustrating a state in which a phone book is displayed on a touch screen of a smartphone. The user interface method of the above-described method is applicable to the operation of the telephone directory shown in Fig. E.g,

1) 'Multitouch, right point single tapping' means 'display phone number next item (eg, email)',

2) 'Multitouch and left point single tapping' means 'Display phone number previous item (eg address)',

3) 'Multitouch after right / upper point single tapping'

4) 'Multitouch, right / lower point single tapping'

5) 'Multitouch, right / upper point double tapping' means'

6) After 'Multi touch', 'Double tapping right / lower point'

As shown in FIG.

16 is a view showing a background screen (a desktop screen, a home screen) displayed on a touch screen of a smartphone. When the background screen is composed of a plurality of background screens, the above-described user interface method is applicable to the operation of the background screen to be displayed on the touch screen. E.g,

1) 'Multi-touch after right tap single tapping' means' Display background (next to the right)

2) 'Multitouch and left point single tapping' means' Display background (assigned to the left) of the current wallpaper ','

3) 'Multi tap, right double tapping' means' last (rightmost) background display ','

4) 'Multi tap and left point double tapping' means 'first (top left) background display'

As shown in FIG.

17 is a view showing a state where a map is displayed on a touch screen of a smartphone. The user interface method of the above-described method can be applied to the operation of the map shown in Fig. E.g,

1) 'Multi-touch after right tap single tapping' means 'Display right area adjacent to the current displayed map'

2) 'Multi Tap', 'Left Tap Point Single Tapping' means 'Display the left area adjacent to the current displayed map'

3) 'Multi tap and right double tapping' means' Display the right area a certain distance from the current displayed map ','

4) 'Double-tap after left multi-touch' means 'Display left area a certain distance from current displayed map'

5) 'Multi tap, right upper corner point single tapping'

6) 'Multi tap, right lower point single tapping'

7) 'Multi tap, right upper point double tapping', 'map three step expansion', '

8) 'Multi tap and right tap down'

As shown in FIG.

18 is a block diagram of a smartphone to which the user interface methods described above can be applied. 18, a smartphone 400 to which embodiments of the present invention are applicable includes a touch screen 410, a communication unit 420, a processor 430, a storage unit 440, and a function block 450 Respectively.

The touch screen 410 functions as a display on which the user interface presented in the above-described embodiments is displayed, and as a user input means for receiving user operations such as touch, multi-touch, single tapping, do.

The storage unit 440 is a storage medium storing programs and data necessary for the operation of the smartphone 400 and the function block 450 is a camera and a DMB Digital Multimedia Broadcasting) reception, and the like.

The processor 430 provides the user interfaces presented in the above embodiments to the user through the touch screen 410 and executes the commands entered by the user through the user interfaces.

Up to now, preferred embodiments have been described in detail for a user interface method for matching a combination of multi-touch and tapping (single tapping, double tapping) to various user commands and providing corresponding various interactions.

The user interfaces referred to in the above embodiments and the types and interactions of the user commands applied to them are all examples for convenience of explanation. The technical idea of the present invention is also applicable to a user interface other than the user interface mentioned.

For example, the technical idea of the present invention is also applied to enlargement / reduction of images and documents other than maps, applications other than the media player, other lists other than the telephone book, other screens other than the background screen, and maps.

Further, since double tapping is mentioned as an example of multi-tapping, the technical idea of the present invention can be applied to the case of adding another type of multi-tapping (for example, triple tapping) have.

In the above embodiments, it is assumed that the upper or lower portion of one of the multi-touch points is tapped, but this is also merely an example for convenience of explanation. The technical idea of the present invention is applicable even when tapping the left or right point of one of the multi-touch points, as well as tapping other surrounding points.

In addition, the embodiments of the present invention are applicable not only to a touch screen but also to a touch pad, and can be applied to electronic devices other than mobile devices as well as mobile devices other than smart phones.

It goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium having a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present invention may be embodied in computer-readable code form recorded on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. In addition, the computer readable code or program stored in the computer readable recording medium may be transmitted through a network connected between the computers.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

C: Cursor
TC: Touch (TouCh)
ST: Single Tapping
DT: Double Tapping

Claims (10)

An electronic device, comprising: receiving a multi-touch of a first point and a second point;
The electronic device performing a first command when the second point touched in the touched state is tapped;
The electronic device performing a second command when the first point touched when the second point is touched is tapped;
Performing a fifth command when the first peripheral point of the second point that was touched while the first point is touched is performed by the electronic device; And
And performing the sixth command when the second peripheral point of the second point that was touched while the first point is touched is touched,
Wherein the first instruction is a command related to a first direction,
Wherein the second instruction is a command related to a second direction,
The fifth instruction is an instruction related to the third direction,
And the sixth instruction is a command related to the fourth direction.
delete The method according to claim 1,
When the first point is touched, when the second point is multi-tapped, the electronic device performs a third command; And
Further comprising: when the first point is multi-tapped in a state that the second point is touched, performing the fourth command by the electronic device.
The method of claim 3,
Wherein the first instruction and the third instruction are instructions related to a first direction,
Wherein the second instruction and the fourth instruction are instructions related to the second direction,
Wherein the response by the third command is larger than the response by the first command,
Wherein the response by the fourth command is larger than the response by the second command.
5. The method of claim 4,
Wherein the first instruction and the third instruction are instructions for moving the cursor in the first direction,
Wherein the second instruction and the fourth instruction are instructions for moving the cursor in the second direction,
The movement amount of the cursor by the third instruction is larger than the movement amount of the cursor by the first instruction,
Wherein the movement amount of the cursor by the fourth instruction is larger than the movement amount of the cursor by the second instruction.
delete delete The method according to claim 1,
Wherein the first peripheral point comprises:
A point located above the second point,
Wherein the second peripheral point comprises:
And the second point is a point located below the second point.
delete A user input unit for receiving touch and tapping from a user; And
Wherein when the first point is touched while the first point is touched after the first point and the second point of the user input unit are touched, And a processor for performing a second command when the first point touched when the second point is touched is tapped,
The processor comprising:
When the first peripheral point of the second point touched in the touched state is touched,
A sixth command is executed when a second peripheral point of the second point that is touched while the first point is touched is tapped,
Wherein the first instruction is a command related to a first direction,
Wherein the second instruction is a command related to a second direction,
The fifth instruction is an instruction related to the third direction,
And the sixth instruction is an instruction related to the fourth direction.

Images