JP2016009473A - Terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device which achieves operation by a pseudo operation key which can be more easily used.SOLUTION: A terminal device comprises: a display part 113 for displaying a pseudo operation key (pseudo operation joystick) 131; a touch panel for detecting contact of an indication body to the pseudo operation key 131; and a control part for determining whether or not a drag operation by the indication body is performed, based on contact of the indication body to the pseudo operation key 131 detected by the touch panel, and controlling a display position of the pseudo operation key 131. The control part changes the display position of the pseudo operation key according to a contact position of the indication body, when the contact position of the indication body exceeds a display area of the pseudo operation key 131 by the drag operation.

Description

  The present invention relates to a terminal device capable of operating a pseudo operation key displayed on a display unit via a touch panel.

  Conventionally, as represented by a smartphone, in a terminal device including a display unit such as a liquid crystal display and a touch panel provided so as to cover it, pseudo operation keys such as a cross key used in a game are displayed on the display. There is known a terminal device that can display and control the display of other characters that are also displayed on the display.

  For example, in Patent Document 1, an operation button for instructing a moving direction of a character displayed on a display is displayed, and when a user touches an arbitrary position on the touch panel corresponding to the operation button with a finger, the position is displayed. It is described that a corresponding command is generated to control the moving direction of the character.

JP 2011-034538 A

  However, in the conventional terminal device, once the display position of the pseudo operation key is determined, the display position of the pseudo operation key is fixed during the operation, which is not always easy to use. For example, when a game program is executed on a terminal device, even if the user continuously touches the left thumb with the pseudo-displayed cross key, the game progresses such as character movement. Due to the concentration, the finger moved from the cross key and the movement of the character stopped unintentionally.

  Therefore, according to various embodiments of the present invention, a terminal device that can be operated with a pseudo operation key that is more convenient to use is provided.

  A terminal device according to an embodiment of the present invention includes a display unit that displays a pseudo operation key, a touch panel that detects contact with the pseudo operation key by an indicator, and the indicator detected via the touch panel. A control unit that determines whether or not a drag operation by the indicator is performed based on contact of the pseudo operation key, and controls a display position of the pseudo operation key. When the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation, the display position of the pseudo operation key is changed according to the contact position of the indicator. is there.

  A program according to an embodiment of the present invention displays a pseudo operation key on a display unit of a computer, and the indicator based on contact of the pseudo operation key by an indicator detected via a touch panel included in a terminal device. Is a program that determines whether a drag operation is performed and functions as a control unit that controls the display position of the pseudo operation key, wherein the control unit determines the contact position of the indicator by the drag operation. When the display area of the pseudo operation key is exceeded, the display position of the pseudo operation key is changed according to the contact position of the indicator.

  A display control method according to an embodiment of the present invention includes a step of displaying a pseudo operation key on a display unit, a step of detecting contact of an indicator with the display unit via a touch panel, and a detection via the touch panel. Determining whether a drag operation by the indicator is performed based on the touch of the pseudo operation key by the indicator, and controlling the display position of the pseudo operation key. In the display control method, when the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation, the display position of the pseudo operation key is changed according to the contact position of the indicator. It is characterized by.

  According to various embodiments of the present invention, a terminal device that can be operated with a pseudo-operation key that is more convenient to use is provided.

FIG. 1 is a diagram illustrating a usage state of a user of a terminal device according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a screen displayed on the display unit of the terminal device according to the embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of a terminal device according to an embodiment of the present invention. FIG. 4 is a diagram for explaining a method for determining the direction and distance of the contact position as viewed from the reference position in the pseudo joystick 131. FIG. 5 is a diagram for explaining a display control method of the pseudo joystick 131. FIG. 6 is a diagram for explaining a display control method of the pseudo joystick 131. FIG. 7 is a flowchart showing the flow of processing performed by the control unit 110 of the terminal device 100. FIG. 8 is a schematic diagram illustrating a screen example obtained by executing the program according to the present embodiment. FIG. 9 is a schematic diagram showing a screen example according to another embodiment showing the display position of the pseudo joystick 131. FIG. 10 is a schematic diagram illustrating a screen example when the terminal device 100 is used in the vertically long direction. FIG. 11 is a schematic diagram illustrating a screen example when the terminal device 100 is connected to the external display device 200. FIG. 12 is a schematic diagram illustrating a screen example when a pseudo cross key is applied as a pseudo operation key. FIG. 13 is a schematic diagram illustrating a screen example when a key imitating a bow and arrow is applied as a pseudo operation key.

  Embodiments of the present invention will be described with reference to the accompanying drawings. In addition, the same referential mark is attached | subjected to the common component in drawing.

<Outline of One Embodiment of the Present Invention>
Hereinafter, as a terminal device according to an embodiment of the present invention, a terminal device 100 having a touch panel that can execute the program according to the present embodiment (mobile phone, smartphone, portable game machine, portable information terminal, PDA, wireless controller terminal) An arcade game terminal installed in a desktop personal computer, a laptop personal computer, a game center, or the like will be described in detail.

  FIG. 1 is a diagram illustrating a usage state of a user of a terminal device 100 according to an embodiment of the present invention. Referring to FIG. 1, the user uses the terminal device 100 in the landscape direction and holds both ends with the left hand and the right hand. When the program according to the present embodiment is executed by the control unit 110, a pseudo joystick 131 that simulates a so-called joystick and a movable object 132 are displayed on the display unit 113. Then, the pseudo joystick 131 is operated with, for example, the thumb of the left hand via the touch panel to control the movement of the displayed movable object 132. Further, the display of the weapon held by the movable object 132 is controlled by operating the pseudo operation button A 133 and / or the pseudo operation button B 134 with the thumb of the right hand via the touch panel. In addition to the characters such as people, animals, and monsters, the movable object 132 can include anything that moves in the virtual space during execution of the program, such as weapons and rocks.

  In the present embodiment, an example is described in which a finger is used as an indicator and contact of the finger is detected by a touch panel, but the indicator is not limited to a finger. A known indicator suitable for each method, such as a stylus pen, can be used depending on the method of the touch panel employed.

  An example of the program according to the present embodiment is a game program, but is not limited thereto. Any program may be used as long as it requires an operation with a pseudo operation key as shown in FIG. Such a program is stored in advance in the memory unit 114 of the terminal device 100, but can be received from an external server device (not shown) via the communication processing unit 111. Further, the program can be stored in a predetermined cartridge, the terminal device 100 is connected to the cartridge via the connector 124, and the control unit 110 can read the program from the cartridge. Further, like a program called a so-called native application, the program can be stored in the server device and downloaded to the terminal device 100 and executed.

  Furthermore, in this embodiment, although the case where the execution of the said program is performed in the terminal device 100 control part 110 is demonstrated, the said program is memorize | stored in an external server apparatus like the program called what is called a web application, In accordance with an instruction / command transmitted from the terminal device 100 according to the progress of the program, processing is executed by the program in the server device, and the result is transmitted to the terminal device 100, whereby the display according to the present embodiment is displayed. It can also be realized.

  FIG. 2 is an example of a screen displayed on the display unit of the terminal device according to the embodiment of the present invention, and shows a state where the user is operating the pseudo joystick 131. On the display unit 113 of the terminal device 100, a pseudo joystick 131 that functions as a pseudo operation key is displayed at a predetermined position. The pseudo joystick 131 is formed of a circle centered on the reference position C0. In addition, the display unit 113 includes an operation object 135 formed of a circle centered on the contact position C1 of the user's finger in order to explicitly grasp the position on the display unit 113 where the user touched the finger. it's shown.

  Here, in the present embodiment, the displayed pseudo joystick 131 and the operation object 135 are displayed in a translucent manner so that the movable object 132 is visible even when the display is superimposed on the movable object 132, for example. .

  FIG. 2 shows a state in which the user touches an arbitrary position on the pseudo joystick 131 with a finger and then drags the finger in an arbitrary direction to the position of the contact position C1. Then, the direction A0 of the contact position C1 viewed from the reference position C0 and the distance D0 between the two positions are determined from the coordinate value of the reference position C0 and the coordinate value of the contact position C1. Then, based on the determined direction A0 and the distance D0, the moving direction Ax and the moving distance Dx of the display position of the movable object 132 are determined. As a result, the movable object 132 is moved and displayed by the distance Dx in the direction Ax determined from the initially displayed position (the position of the movable object 132 indicated by a broken line in the drawing).

  In the present embodiment, the pseudo joystick 131 and the operation object 135 are displayed semi-transparently as described above. However, the pseudo joystick 131 and the operation object 135 are not necessarily displayed at all times. Although not shown in particular, as an example, they may be displayed for the first time when the indicator touches the touch panel 116. It is also possible to virtually provide areas corresponding to the pseudo joystick 131 and the operation object 135 at corresponding positions on the touch panel so that these are not explicitly displayed on the display unit 113.

<Terminal device>
FIG. 3 is a block diagram illustrating a configuration of the terminal device 100 according to an embodiment of the present invention. Note that the terminal device 100 according to the present embodiment does not have to include all of the components illustrated in FIG. 3, and may have a configuration in which some are omitted.

  Referring to FIG. 3, the terminal device 100 according to an embodiment of the present invention includes a control unit 110, a wireless communication processing unit 111 connected to an antenna 112, a display unit 113, a memory unit 114, a touch panel 116, and a hard key 117. An operation processing unit 115 including the sound processing unit 118 connected to the speaker 119 and the microphone 120, a detection unit 121 including the acceleration sensor 122 and the GPS sensor 123, a connector 124, and an image processing unit 125 connected to the camera 126. Each of these elements is electrically connected to each other via a control line and a data line.

  The control unit 110 is configured by a CPU (microcomputer), and controls display of each image information stored in the memory unit 114 on the display unit 113 based on coordinate information input by touching the touch panel 116. To do. Further, the control unit 110 reads the program according to the present embodiment stored in the memory unit 114 from the memory unit 114 and controls the progress of the application according to the present embodiment. That is, the control unit 110 controls other connected components based on various programs stored in the memory unit 114.

  The control unit 110 may be configured with a single CPU, but may be configured with a plurality of CPUs. In addition, a GPU specialized for image processing, that is, display control for the display unit 113 may be provided separately.

  The communication processing unit 111 transmits information stored in the memory unit 114 to other remotely installed terminals via the connected wireless communication antenna 112, or information transmitted from other terminals. In order to receive the signal, various processes such as modulation and demodulation are performed. For example, when the program according to the present embodiment is received from the server device, the communication processing unit 111 collects the program according to the present embodiment as needed according to the progress of the process or at the start of execution of the server device or the like. Control receiving from. It also controls sending various processes or results from the execution of the program to the server device.

  The communication processing unit 111 is processed based on a wideband wireless communication system represented by a W-CDMA (Wideband-Code Division Multiple Access) system, but a wireless LAN such as IEEE802.11. It is also possible to perform processing based on a method related to narrowband wireless communication such as Bluetooth (registered trademark).

  The display unit 113 displays, for example, a pseudo operation key such as a movable object or a pseudo joystick instructed by a control unit that executes a predetermined program based on image information stored in the memory unit 114. As an example, it is composed of a liquid crystal display. In addition, although the terminal device which concerns on this embodiment is provided with a single display part, it may be provided with two or more display parts.

  The memory unit 114 includes a ROM, a RAM, a nonvolatile memory, and the like. The ROM is a memory that stores a program according to the present embodiment, for example. The control unit 110 executes various processes by loading this program. The RAM is a memory used for writing and reading data while various commands generated by executing a program stored in the ROM are processed by the control unit 110. The nonvolatile memory is a memory in which data is written and read by executing the program, and the data written therein is stored even after the execution of the program is completed.

  The operation unit 115 includes a touch panel 116, hard keys 117, and the like, and accepts various instructions from the user.

  The touch panel 116 is arranged so as to cover the display unit 113, and outputs position coordinate data corresponding to image data displayed on the display unit 113 to the control unit 110. As the touch panel system, a known system such as a resistive film system, a capacitive coupling system, and an ultrasonic surface acoustic wave system can be used. Moreover, according to the system to be used, a touch on a touch panel by a known indicator such as a finger or a stylus pen is detected.

  The hard key 117 controls the on / off of a signal by physically pressing a switch, and includes a power key, a volume key, and the like. These hard keys 117 control the power on / off of the terminal device, the volume of back music during program execution, and the like. In addition to the pseudo operation keys, each function key used for the game can be installed.

  The detection unit 121 includes an acceleration sensor 122 and a GPS sensor 123. The acceleration sensor detects the acceleration in the triaxial direction of the terminal device 100, for example, detects the rotation of the terminal device 100.

  For example, the connector 124 inserts a cartridge or a storage medium in which a program according to the present embodiment is stored, and mediates reading and writing by the control unit 114. Further, for example, a terminal portion for outputting image information to an external display device such as a liquid crystal television can be included.

  The audio processing unit 118 encodes the audio information input from the microphone 120 for storage in the memory unit 114. In addition, the audio control unit 118 decodes audio information such as back music stored in the memory unit 114 and outputs the decoded audio information from the speaker 119.

  The image processing unit 125 is connected to the camera 126, converts an image captured by the camera 126 into a data format suitable for storage, and stores the data in the memory unit 114.

<Outline of operation to pseudo joystick>
FIG. 4 is a diagram for explaining a method for determining the direction and distance of the contact position as viewed from the reference position in the pseudo joystick 131.

  FIG. 4 shows the relationship between the pseudo joystick 131 displayed on the display unit 113 and the contact position of the indicator. First, the pseudo joystick 131 is formed of a circle centered on the point C0. The initial display position of the pseudo joystick 131 is determined in advance to an arbitrary coordinate position on the display unit 113, and a circle indicating the pseudo joystick 131 is displayed at the coordinate position as the program is executed. The display unit coordinate system is associated with the touch panel coordinate system.

  In the present embodiment, the reference position is a reference for determining the direction and distance of the contact position on the touch panel by the indicator, and is the center of the circle forming the pseudo joystick 131 (point C0). is there. The reference position only needs to be a reference for determining the direction and distance of the contact position as described above. For example, when the pseudo operation key is not formed in a circle, the center of the operation key ( It does not have to be the center of gravity. Since it only needs to be a reference, it may be an arbitrary position determined in advance.

  The user touches an arbitrary position in the pseudo joystick 131 displayed in advance on the display unit 113 and drags the pseudo joystick 131 in an arbitrary direction to move the contact position. Then, the touch panel 116 detects the position coordinates of the contact position during or after the movement, and reports the position coordinates to the control unit 110. In FIG. 4, the position coordinates (X2, Y2) of the contact position C2 or the position coordinates (X3, Y3) of the contact position C3 are reported to the control unit 110 as the contact position of the finger during or after the drag operation. The

  The control unit 110 uses the predetermined position coordinates (X0, Y0) of the reference position C0, the obtained position coordinates (X2, Y2) of the contact position C2, or the position coordinates (X3, Y3) of the contact position C3. The angle and length formed by the line segments A2 and A3 to be formed are determined. In addition, the said angle means the direction of each contact position C2 and C3 seen from the reference position C0. The length means a distance between the reference position C0 and the contact positions C2 and C3.

These angles (directions) and lengths (distances) can be determined by a known method. An example is as follows. Taking the line segment A2 as an example, first, the angle (direction) is set to the angle θ2 formed by the line segment A2 with respect to the X axis and the length L2 of the line segment A2 with respect to the X axis in a virtual XY coordinate with the reference position C0 as the origin. It is calculated from the mathematical formula (Formula 1).

  The memory unit 114 is formed with the position coordinates (X0, Y0) of the reference position C0 and the obtained position coordinates (X2, Y2) of the contact position C2 or the position coordinates (X3, Y3) of the contact position C3. Angles and lengths formed by the line segments A2 and A3, that is, the directions of the contact positions C2 and C3 viewed from the reference position C0, the distances between the reference position C0 and the contact positions C2 and C3, and the moving direction of the movable object 132 A table indicating the correspondence between the movement amount and the movement amount is stored. The control unit 110 refers to the table and moves the movable object 132 from the direction of the contact positions C2 and C3 viewed from the determined reference position C0 and the distance between the reference position C0 and the contact positions C2 and C3. The direction and amount of movement are determined, and display control of the movable object is performed accordingly.

  In the above example, a table is used. However, a predetermined relational expression may be stored, and the movement amount and movement amount of the movable object may be determined based on the stored relational expression. Can be used. The moving amount of the movable object may be, for example, a moving speed or a moving distance, and can be selected as appropriate.

  FIG. 5 is a diagram for explaining a display control method of the pseudo joystick 131. First, in the pseudo joystick 131 according to the present embodiment, an operation detection area 136 is defined on the touch panel 116 in advance corresponding to the display area of the pseudo joystick 131. The operation detection area 136 is an area for the control unit to recognize as an operation to the pseudo joystick 131 when a contact operation with an indicator is performed in this area.

  Referring to FIG. 5A, a case where the same area as the display area of the pseudo joystick 131 formed by a circle is set as the operation detection area 136 is shown. The display area of the pseudo joystick 131 and the operation detection area 136 are the same area completely corresponding to each other. The contact position C1 indicates a position where the user has moved the indicator by dragging the pseudo joystick 131 by operating the indicator. When the user operates the indicator and drags it further away from the reference position C0, which is the center of the pseudo joystick 131, the contact position C1 of the indicator exceeds the display area of the pseudo joystick 131, that is, the operation detection area 136.

  At that time, the control unit 110 performs control so that the display position of the pseudo joystick 131 is changed according to the position of the contact position C1 of the indicator that has passed. That is, the control unit 110 performs control so that the pseudo joystick 131 is displayed following the moving direction of the indicator. As an example, the control unit 110 starts moving the display position of the pseudo joystick 131 when the contact position C1 of the indicator exceeds the display area of the pseudo joystick 131 by a predetermined distance D1. Then, the follow-up display control of the pseudo joystick 131 is performed so that the distance between the contact position of the indicator C1-1 and the outer edge of the display area of the pseudo joystick 131 is maintained at the distance D1. In other words, when the contact position exceeds the display area of the pseudo joystick 131 by the drag operation by the indicator, the control unit 110 is a position that is the contact position of the indicator and the center of the circle that forms the operation object 135. The display is controlled so that C1-1 is positioned outside the display area of the pseudo joystick 131, that is, outside the circle forming the pseudo joystick 131.

  By providing the distance D1 until the follow-up display is performed in this way, it is possible to provide the user with a feeling that does not move the display area itself of the pseudo joystick 131 but comes later.

  In the above case, the contact position of the indicator is actually C1-1. In such a case, the angle and the length of the line segment A1 determined based on the contact position between the reference position C0 and the indicator are such that the line segment connecting the reference position C0 and the contact position C1-1 is the pseudo joystick 131. Is determined based on the position that intersects the outer edge of the display area and the reference position C0.

  5B and 5C show other examples of display control of the pseudo joystick 131. FIG. According to FIG. 5B, the operation detection area 136 is set in advance to be slightly wider than the display area of the pseudo joystick 131. In such a case, even if the contact position of the indicator is inadvertently outside the display area of the joystick 131, it can be recognized as an operation to the pseudo joystick 131. Further, the control unit 110 does not perform control to immediately follow the display even when the contact position C1 of the indicator exceeds the display area of the pseudo joystick 131, and the display of the pseudo joystick 131 is not performed until the operation detection area 136 is exceeded. Follow-up display control for changing the position according to the contact position C1 of the indicator is started. When the user touches the operation key with the indicator, a slight shift in the target position can be absorbed, so that the operability for the user is further improved. Similarly to the case of FIG. 5A, by providing the “play” time and distance until the follow-up display, the operability of the user after the start of the drag operation is further improved.

  According to FIG. 5C, the operation detection area 136 is set in advance to be narrower than the display area of the pseudo joystick 131. In such a case, the control unit 110 starts the follow-up display of the pseudo joystick 131 when it exceeds the operation detection area 136 as a result of the drag operation of the indicator. That is, the follow-up display is started even though the contact position of the indicator is still on the display area of the pseudo joystick 131. By doing in this way, since the contact position of the indicator by the user does not deviate from the display area of the pseudo joystick, it is possible to obtain a certain feeling that the user is always touching.

  Note that the follow-up display control of the pseudo joystick 131 to such a contact position can use any of the modes shown in FIGS. 5A to 5C and can be set as appropriate.

  FIG. 6 is a diagram for explaining a display control method of the pseudo joystick 131. In the present embodiment, a pseudo operation button A 133 and / or a pseudo operation button B 134 are displayed on the right side of the display unit 113. When the pseudo joystick 131 is displayed following the contact position of the indicator by the drag operation by the indicator exceeding the display area or the operation detection area 136 of the pseudo joystick 131, the display position of the pseudo operation key 131 is changed. If the predetermined area is exceeded, the control unit 110 causes the display unit to display such that the following display is temporarily stopped.

  Specifically, when the display unit 113 is divided into a left region and a right region with the center (line AA ′) of the display unit 113 as an axis, the region where the pseudo joystick 131 is displayed (in FIG. 6). The left area) is set as the movable area 137. That is, in FIG. 6, the area where the pseudo joystick 131 is displayed before the operation on the pseudo joystick 131 is started and the side where the predetermined fixed position exists is set as the movable area 137. ing. The movable area 137 is used to move the display position of the pseudo joystick 131 (follow-up display) when the display position of the pseudo joystick 131 is within the area, and to move beyond the area. In order to display the pseudo joystick 131 so as to stay on the boundary between the movable area and another area, the area is determined in advance. That is, the area divided into half at the center of the display unit 113 does not necessarily need to be the movable area 137, and may be an area wider than the display area and the operation detection area 136 of the pseudo joystick 131. For example, it can be appropriately changed according to the arrangement of other pseudo keys and the arrangement of the displayed movable object. When the user's finger is used as the indicator, the movable region 137 can be set to a range in which the finger that is the indicator can be relatively contacted with the terminal device held.

  Referring to FIG. 6, when the display position of the pseudo joystick 131 (for example, the reference position C0 in the pseudo joystick 131) exceeds the movable area 137 as a result of the follow-up display control of the pseudo joystick 131, the movable area The pseudo joystick 131 is displayed so as to remain on the boundary 139 between 137 and another area 138 of the display unit. In the example of FIG. 6, the pseudo joystick 131 is displayed so as to remain at a position where the line 140 parallel to the outer edge of the display unit 113 passing through the contact position C <b> 1 by the indicator and the boundary 139 intersect. Therefore, when the indicator is dragged up and down in another area 138, the pseudo joystick 131 is displayed so as to move up and down on the boundary line.

  FIG. 6 shows an example in which the pseudo joystick 131 is displayed so as to remain on the boundary 139 when the display position of the pseudo joystick 131 exceeds the movable region 137 as a result of the follow-up display control of the pseudo joystick 131. However, it is not limited to this. For example, in the above case, the control unit 110 can control the display so that the display position of the pseudo joystick returns to a predetermined fixed position where the pseudo joystick 131 was originally displayed.

<Control flow of pseudo joystick>
FIG. 7 is a flowchart showing a flow of processing performed by executing the program according to the present embodiment in the control unit 110 of the terminal device 100. When the control unit 114 executes the program according to the present embodiment stored in the memory unit 114, the processing flow is started. Then, it is detected by the user's indicator that the pseudo joystick 131 is touched via the touch panel 116 (S101). Next, the control unit 110 determines whether or not the contact position is still within the display area of the pseudo joystick 131 (S102). As described with reference to FIG. 5, the operation detection area 136 can be used in place of the display area of the pseudo joystick 131 as the determination criterion in S <b> 102.

  In S102, when it is determined that the contact position of the indicator is still in the pseudo joystick, the direction and contact of the contact position viewed from the reference position based on the contact position and the reference position provided in the pseudo joystick. The distance between the position and the reference position is determined (S103 and S104). Then, based on the determined direction and distance, the control unit 110 determines the moving direction and moving amount of the movable object displayed on the display unit 113 from the reference table stored in the memory unit 114, and moves the movable object. The movement display of the object is controlled (S105).

  Next, it is determined whether or not contact with the touch panel by the indicator continues, that is, whether or not a drag operation is being performed (S106). As a result, if it is determined that the contact is continued and the drag operation is performed, the process returns to S102 again, and it is determined whether or not there is a contact position in the display area of the pseudo joystick 131 based on the contact position after the drag operation.

  If it is determined in S102 that it is not within the display area of the pseudo joystick 131, that is, if it is determined that the contact position of the indicator exceeds the display area of the pseudo joystick 131 by the drag operation, the process proceeds to S107. To do.

  Next, in S107, the control unit 110 determines whether or not the display position of the pseudo joystick 131 is within the movable area 137 (S107). If the control unit 110 determines that the contact position is still within the movable region 137, the control unit 110 controls to change the display position of the pseudo joystick 131 according to the contact position (S108). That is, the control unit 110 performs display control for following the contact position of the pseudo joystick 131.

  Next, in S109 and S110, based on the contact position of the indicator and the reference position provided in the pseudo joystick, the direction of the contact position viewed from the reference position and the distance between the contact position and the reference position are determined. To do. Although the contact position is used to determine the distance, the line segment determined based on the contact position between the reference position and the indicator is based on the position where the outer edge of the display area of the pseudo joystick 131 intersects with the reference position. It is also possible to decide.

  Then, based on the determined direction and distance, the control unit 110 determines the moving direction and moving amount of the movable object displayed on the display unit 113 from the reference table stored in the memory unit 114, and moves the movable object. The movement display of the object is controlled (S111).

  In step S106, the control unit 110 determines whether or not the pointer continues to touch the touch panel, that is, whether or not a drag operation is being performed (S106). As a result, when the control unit 110 determines that the drag operation is continued, the process returns to S102. Here, as described above, when the control unit 110 determines that the display area of the pseudo joystick 131 is exceeded, the process proceeds to S107.

  In S107, the control unit 110 determines whether or not the display position of the pseudo joystick 131 is within the movable area 137 (S107). If it is determined that the display position has been exceeded, the process by the control unit 110 proceeds to S112.

  In S112, the control unit 110 changes the display position of the pseudo joystick 131 on the boundary 139 between the movable region 137 and the other region 138 of the display unit 113. In S113 and S114, based on the contact position of the indicator and the reference position provided in the pseudo joystick, the direction of the contact position viewed from the reference position and the distance between the contact position and the reference position are determined. In this case, the contact position is used to determine the distance, but instead of this contact position, a line segment determined based on the contact position between the reference position and the indicator is the display area of the pseudo joystick 131. It is preferable to determine the position based on the position intersecting the outer edge and the reference position.

  Then, based on the determined direction and distance, the control unit 110 determines the moving direction and moving amount of the movable object displayed on the display unit 113 from the reference table stored in the memory unit 114, and moves the movable object. The movement display of the object is controlled (S115).

  Then, the process returns to S106 again, and it is determined whether or not the pointer continues to touch the touch panel, that is, whether or not a drag operation is being performed. If it is determined in S106 that the indicator has been released from the touch panel, the processing flow ends.

<Screen transition>
FIG. 8 is a schematic diagram illustrating a screen example obtained by executing the program according to the present embodiment. 8A, when the control unit 110 of the terminal device 100 starts executing the program according to the present embodiment, the control unit 110 displays the pseudo joystick 131 and the predetermined movable object 132 at a predetermined fixed position on the display unit 113. To do. In addition to the characters such as people, animals, and monsters, the movable object 132 can include anything that moves in the virtual space during execution of the program, such as weapons and rocks.

  Further, referring to FIG. 8A, the display unit 113 displays an operation object 135 for explicitly grasping the position on the touch panel 116 where the user touches the indicator. The operation object 135 moves the display position along with the movement of the indicator so that the touch position by the indicator becomes the center of the operation object 135.

  In FIG. 8A, since the user has not yet performed the touch operation on the touch panel 116 using the indicator, both the pseudo joystick 131 and the movable object 132 are displayed at predetermined positions. Yes. Specifically, the center C0 of the pseudo joystick 131 and the center of the operation object 135 indicating the contact position are displayed so as to overlap each other.

  FIG. 8B is a schematic diagram illustrating a screen example when the user performs a drag operation on the pseudo joystick 131 with an indicator when the display illustrated in FIG. 8A is performed. Referring to FIG. 8B, the display position of the operation object 135 is also moved by contacting the position of the contact position C1 with the indicator. Further, the direction of the contact position C1 and the distance to the contact position C1 are determined based on the reference position C0 and the contact position C1, and the display of the movable object 132 is performed using the determined direction and distance based on the determined direction and distance. The position has been moved. At this time, since the contact position of the indicator does not exceed the display area of the pseudo object 131, the control unit 110 performs control so that the display position of the pseudo object 131 is not displayed, but is displayed at a fixed position. .

  FIG. 8C shows a case where the user drags on the pseudo joystick 131 with an indicator while the display shown in FIG. 8A is being performed, and the contact position exceeds the display area of the pseudo joystick 131. It is a schematic diagram which shows the example of a screen. In this example, whether or not to perform the follow-up display control of the pseudo joystick 131 is based on the display area, but the operation detection area 136 can also be used. Referring to FIG. 8C, since the follow-up display control of the pseudo joystick 131 is performed, the display area of the pseudo joystick 131 is moved together with the movement of the contact position. Further, the direction of the contact position C1 and the distance to the contact position C1 are determined based on the reference position C0 and the contact position C1, and the display of the movable object 132 is performed using the determined direction and distance based on the determined direction and distance. The position has been moved.

  In FIG. 8D, similarly to FIG. 8C, when the display shown in FIG. 8A is made, the user drags the pseudo joystick 131 with the indicator and the contact position is simulated. FIG. 6 is a schematic diagram illustrating an example of a screen when a display area of a joystick 131 is exceeded. As described in FIG. 8C, the follow-up display control of the pseudo joystick 131 is performed. In addition, the movable object 132 has moved a longer distance as compared with the case of FIG. 8C as the operation time for the pseudo operation object 131 at the fixed position has elapsed.

  8 (e) is similar to FIGS. 8 (c) and 8 (d), when the display shown in FIG. 8 (a) is made, the user drags the pseudo joystick 131 with the indicator, FIG. 10 is a schematic diagram illustrating a screen example when the contact position exceeds the display area of the pseudo joystick 131. Here, in the example of FIG. 8E, the display unit 113 is divided into a left region and a right region with the center (line AA ′) of the display unit 113 as an axis, and the region where the pseudo joystick 131 is displayed. (A left area in FIG. 6) is set as a movable area 137. Then, the contact position C1 indicating the contact position of the indicator exceeds the movable area 137, and the display position of the pseudo joystick 131 (specifically, the reference position C0) is about to exceed the movable area 137. Therefore, the pseudo operation object 131 is displayed so that the reference position C0 comes on the boundary 139 between the movable area 137 and the other area 138. Here, when the reference position C0 is exceeded, it stays on the boundary line. Naturally, when the outer edge of the display area of the pseudo joystick 131 closest to the boundary 139 exceeds the movable area 137, not the reference position. Alternatively, it may be displayed so as to stay on the boundary line.

  As described above, in this embodiment, when the contact position of the indicator moves beyond the pseudo joystick 131 or the operation detection area 136, the display position of the pseudo joystick 131 also moves based on the contact position. Since the follow-up display control is performed, for example, although the focus is on the movement of a movable object such as a moving character, it is possible to prevent the inconvenience that the position of the finger indicator is detached from the pseudo joystick 131 before long. Further, since the display position of the pseudo operation object 131 is displayed so as to stay on the boundary between the movable area 137 and the other area 138 when the movable area 137 is exceeded, it can be input relatively from the position of the finger as the indicator. The follow-up display control is performed in a wide range, and an operation without a sense of incongruity for the user is possible.

<Other Embodiments of the Present Invention>
Another embodiment of the present invention will be described. In addition, description is abbreviate | omitted about what fulfill | performs the same function as the terminal device 100 which concerns on the said embodiment. In addition, the above-described embodiment and other embodiments described below can be appropriately combined with part or all of them.

1. Display Position of Pseudo Joystick 131 In the above embodiment, when the program according to the above embodiment is executed, the pseudo operation object 131 is displayed at a predetermined fixed position, and the pseudo operation object 131 is touched with an indicator. The case where the process is started has been described. However, instead, the processing may be started by contacting an arbitrary position with an indicator.

  FIG. 9 is a schematic diagram showing a screen example according to another embodiment showing the display position of the pseudo joystick 131 as a specific example. Referring to FIG. 9, a pseudo joystick 131 is displayed at a fixed position (indicated by a broken line in FIG. 9) by executing the program. Thereafter, when an arbitrary position is touched by the indicator, the pseudo joystick 131 is moved to a display position centered on the reference position C0 with the contact position as the reference position C0. Then, display control of the movable object using the pseudo operation object 131 and tracking display control of the pseudo operation object 131 are performed at the position after the movement. The specific processing flow is the same as that performed in the above embodiment.

  Thus, the convenience of the user can be further improved by setting the display position.

2. Control when the terminal device 100 is used in the longitudinal direction The terminal device 100 according to the embodiment includes the acceleration sensor 122. Using this acceleration sensor 122, it is possible to detect the rotation of the terminal device 100 by a known method. In the above embodiment, the case where the terminal device 100 is used in the horizontally long direction has been described. However, the user changes the terminal device 100 in the vertically long direction, and in this embodiment, the acceleration sensor 122 detects the rotation of the terminal device 100. Then, the display on the display unit 113 is switched.

  FIG. 10 is a schematic diagram showing a screen example when the terminal device 100 is used in the vertically long direction as a specific example. Referring to FIG. 10A, the movable object 132 displayed as the program progresses in the upper part of the display unit 113, and the pseudo operation of the pseudo joystick 131, the pseudo operation button A133, and the pseudo operation button B134 are displayed in the lower part. The key is displayed. That is, when the terminal device 100 is used in the horizontally long direction, the pseudo operation key such as the pseudo joystick 131 is displayed on the display object that changes as the program progresses, but the terminal device 100 is displayed in the vertically long direction. When used, the display is controlled so that they are displayed in different display areas.

  FIG. 10B is a schematic diagram of a screen example in which display control is performed by the pseudo joystick 131 following the contact position by the indicator. The following display control method is the same as the method described in the above embodiment.

  FIG. 10C is a schematic diagram illustrating a screen example when the contact position by the indicator is dragged beyond the movable region 137. In FIG. 10C, the lower left of the display unit 113 is set as the movable region 137 in consideration of the arrangement of the pseudo operation button A133 and the pseudo operation button B134 and the range in which the left thumb used as an indicator can be contacted. ing. Since the contact position C1 moves beyond the movable area 137, the display position of the pseudo joystick 131 is controlled to remain on the boundary of the movable area 137 set at the lower left of the display unit 113.

  As described above, by switching the display mode of the display unit 113 based on the output of the acceleration sensor 122 and also switching the display mode of the pseudo operation key, various operation methods can be provided by the user.

  In the above embodiment, the pseudo joystick 131 and the operation object 135 are displayed translucently. However, in this embodiment, these display areas and display areas such as the movable object 132 are separate display areas. Therefore, the pseudo joystick 131 and the operation object 135 are not necessarily displayed semi-transparently.

3. Control when Terminal Device 100 is Connected to External Display Device 200 In the above embodiment, the case where a display object that changes as the program progresses is displayed on the display unit 113 of the terminal device 100 has been described. It is also possible to connect to an external display device so that image information such as a display object that changes as the program progresses is displayed on the external display device.

  FIG. 11 is a schematic diagram illustrating a screen example when the terminal device 100 is connected to the external display device 200. According to FIG. 11, the terminal device 100 is connected to the external display device 200 through a wireless line, and outputs image information such as a display object that changes as the program progresses. Note that this connection can use a method related to narrowband wireless communication such as a wireless LAN or Bluetooth (registered trademark) via the communication processing unit 111. Also, a wired connection using HDMI (registered trademark) or the like can be performed via the connector 124 included in the terminal device 100.

  Referring to FIG. 11, a pseudo operation key including a pseudo joystick 131 is displayed on the display unit 113 of the terminal device 100, and a display object that changes as the game progresses including the movable object 132 is displayed on the external display device 200. Yes. The display control of the movable object 132 using the pseudo joystick 131 and the follow-up display control of the pseudo joystick 131 are the same as in the above embodiment.

  By doing in this way, the terminal device 100 can be used as a controller only for operation, and a higher realism can be provided to the user.

  In the above embodiment, the pseudo joystick 131 and the operation object 135 are displayed translucently. However, in this embodiment, these display areas and display areas such as the movable object 132 are separate display areas. Therefore, it is not necessary to display the pseudo joystick 131 and the operation object 135 in a translucent manner.

4). Other Examples of Pseudo Operation Keys In the above embodiment, the case where the pseudo joystick 131 is used as a pseudo operation key has been described. However, the pseudo operation key to which the present invention can be applied is not limited to the pseudo joystick 131. For example, the present invention can be applied to a pseudo operation key that needs to be kept in contact for a predetermined time or longer.

  FIG. 12 is a schematic diagram illustrating a screen example when a pseudo cross key is applied as a pseudo operation key. Referring to FIG. 12, a pseudo cross key 151 is displayed at a predetermined position on the display unit 113 of the terminal device 100. The user can control the movement of the movable character 132 by touching the pseudo operation keys in the four directions of up, down, left, and right provided on the pseudo cross key 157 with a contact body.

  In the case of the pseudo cross key 151, compared to the pseudo joystick 131, the pseudo cross key 151 is composed of a plurality of fine pseudo keys, and therefore the user needs to operate with a finer indicator. Therefore, naturally, the follow-up display control of the pseudo cross key 151 can also be started when the contact position of the indicator exceeds the display area of each pseudo operation key constituting the pseudo cross key 151. However, it is more preferable to set an operation detection area 136 wider than the display area of the pseudo cross key 151 and to perform the follow-up display control of the pseudo cross key 151 based on the operation detection area 136.

  FIG. 13 is a schematic diagram illustrating a screen example when a key imitating a bow and arrow is applied as a pseudo operation key. In the above embodiment, the case where the pseudo joystick 131 is used as the pseudo operation key has been described. That is, a case has been described in which a pseudo operation key circle is formed and the center of the circle is set as the reference position. However, as in this embodiment, the reference position is not limited to the center or the center of gravity of the pseudo operation key, and an arbitrary position can be set as the reference position.

  Referring to FIG. 13, a pseudo operation key 161 imitating a bow and arrow is displayed. When the user performs an operation of pulling the bow of the pseudo operation key 161, that is, touches the arrow with a pointer, drags in a predetermined direction as it is and releases it, the control unit 110 causes the arrow to fly in the virtual space To control the display. In such a case, the reference position serving as a reference for determining the direction and distance of the contact position can be appropriately set to an arbitrary position C4. In addition, an area serving as a reference for determining whether or not to perform the follow-up display control of the pseudo operation key 161 can be set as an operation detection area 136 instead of the display area of the pseudo operation key 161.

  By doing so, it is possible to express a variety of pseudo operation keys.

  The processes and procedures described in the present specification can be realized not only by those explicitly described in the embodiment but also by software, hardware, or a combination thereof. Specifically, the processes and procedures described in this specification are realized by mounting logic corresponding to the processes on a medium such as an integrated circuit, a volatile memory, a nonvolatile memory, a magnetic disk, or an optical storage. Is done. Further, the processes and procedures described in this specification can be implemented as a computer program and executed by various computers.

  Even though the processes and procedures described herein are described as being performed by a single device, software, component, or module, such processes or procedures may include multiple devices, multiple software, It may be executed by multiple components and / or multiple modules. Further, even if it is described that the data, table, or database described in this specification is stored in a single memory, such data, table, or database may be stored in a single device. Or a plurality of memories arranged in a distributed manner in a plurality of devices. Further, the software and hardware elements described herein may be realized by integrating them into fewer components or by disassembling them into more components.

DESCRIPTION OF SYMBOLS 100 Terminal device 110 Control part 113 Display part 116 Touch panel 200 External display apparatus

Claims (17)

A display unit for displaying pseudo operation keys;
A touch panel for detecting contact by an indicator to the pseudo operation key;
A control unit that determines whether a drag operation by the indicator is performed based on contact of the pseudo operation key by the indicator detected via the touch panel, and controls a display position of the pseudo operation key; , Including a terminal device,
When the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation, the control unit changes the display position of the pseudo operation key according to the contact position of the indicator. The terminal device. The touch panel includes an operation detection area that detects an operation on the pseudo operation key corresponding to the display area of the pseudo operation key,
The said control part changes the display position of the said pseudo operation key according to the contact position of the said indicator, when the contact position of the said indicator exceeds the said operation detection area | region by the said drag operation. The terminal device according to 1.   The terminal device according to claim 2, wherein the operation detection area is a display area of the pseudo operation key. The display unit displays a predetermined movable object,
The said control part determines the moving direction of the said movable object based on the direction obtained from a predetermined reference position and the contact position of the said indicator, The Claim 1 characterized by the above-mentioned. Terminal device. The display unit displays a predetermined movable object,
The said control part determines the moving amount | distance of the said movable object based on the distance between a predetermined reference position and the contact position of the said indicator, The Claim 1 characterized by the above-mentioned. Terminal equipment. The reference position exists in the operation detection area,
When the contact position of the indicator exceeds the operation detection area by the drag operation, the control unit sets a line segment connecting the reference position and the contact position to an outer edge of the display area of the pseudo operation key. The terminal device according to claim 4, wherein a moving direction and a moving amount of the movable object are determined based on a distance between the intersecting position and the reference position.   When the display position exceeds the movable area preset in the display unit when the display position of the pseudo operation key is changed according to the contact position of the indicator, The terminal device according to claim 1, wherein the pseudo operation key is displayed on a boundary between the movable area and another area.   The terminal device according to claim 7, wherein the control unit displays the pseudo operation key at a predetermined position before detecting a drag operation on the pseudo operation key.   The movable region is a region where the fixed position exists when the display unit is divided into a left region and a right region with the center of the display unit as an axis. The terminal device described.   The said control part displays the said pseudo operation key in the contact position, if the contact to the touch panel by the said indicator is detected after displaying the said pseudo operation key in the said fixed position. 9. The terminal device according to 9. The pseudo operation key is formed of a circle,
The terminal device according to claim 4, wherein the reference position is a center of a circle forming the pseudo operation key.   The said control part displays the operation object which shows the contact position by the said indicator on the said display part, and changes the display position of the said operation object according to the movement of the said contact position. Terminal equipment. The operation object is formed of a circle,
When the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation, the center of the circle forming the operation object is outside the circle forming the pseudo operation key. The terminal device according to claim 12, wherein the display position of the pseudo operation key is controlled so as to be located at the terminal.   The terminal device according to claim 1, wherein the pseudo operation key is displayed in a translucent manner.   The terminal device according to claim 1, wherein the pseudo operation key is a pseudo joystick that simulates a joystick. Computer
Display pseudo operation keys on the display,
Control for determining whether a drag operation by the indicator is performed based on contact of the pseudo operation key by the indicator detected via a touch panel included in the terminal device, and controlling the display position of the pseudo operation key A program that functions as a part,
When the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation, the control unit changes the display position of the pseudo operation key according to the contact position of the indicator. Said program. Displaying pseudo operation keys on the display unit;
Detecting the contact of the indicator to the display unit via a touch panel;
Determining whether a drag operation by the indicator is performed based on contact of the pseudo operation key by the indicator detected via the touch panel, and controlling a display position of the pseudo operation key; A display control method of pseudo operation keys including
The display control, wherein the display position of the pseudo operation key is changed according to the contact position of the indicator when the contact position of the indicator exceeds the display area of the pseudo operation key by the drag operation. Method.

Images