JP5896446B2 - Controller device - Google Patents

Description

  The present invention relates to a controller device for performing an operation input to an information processing apparatus, and a core unit constituting the controller device.

  For example, there is a controller device used for performing various operation inputs to an information processing apparatus such as a home game machine. Such a controller device is required to include various operation members such as buttons and analog sticks in accordance with the contents of an application program executed by the information processing apparatus to be operated. However, if all such various operation members are provided, the controller device becomes large, which causes problems such as inconvenience in handling and high cost. Therefore, an expandable controller device has been proposed by attaching an attachment having a specific operation member to a controller device body (core unit) as necessary. Such a controller device can be additionally provided with various operation members by changing the attachment according to the user's needs, and can realize various types of operation inputs.

  However, the above-described expansion attachment needs to include an electric circuit in order to transmit the user's operation content on the operation member included in the expansion attachment to the core unit or the information processing apparatus. If it does so, the electric power supply by a battery etc. will be needed with respect to each of an attachment, and will take time, such as battery replacement | exchange and charge.

  The present invention has been made in consideration of the above circumstances, and one of its purposes is to perform various operation inputs to the information processing apparatus through the attachment even if the attachment does not have an electric circuit. It is to provide a controller device that can be used.

  The controller device according to the present invention is a controller device including a core unit having a touch sensor disposed on one surface and an attachment attached to the core unit so as to cover the touch sensor, the attachment being the attachment Is configured to be able to contact the touch sensor in a state of being attached to the core unit, and includes an operation member whose contact mode with respect to the touch sensor changes according to a user operation.

  In the controller device, the operation member may be configured such that a contact position with respect to the touch sensor moves in accordance with a user operation along a direction parallel to a detection surface of the touch sensor.

  In the controller device, the operation member includes a planar operation area corresponding to the detection surface of the touch sensor, and when the user performs a pressing operation on any position in the operation area. The contact mode with respect to the position of the touch sensor according to the position of the pressing operation may be changed.

  Furthermore, the operation member is configured such that at least one of a pressure applied to the touch sensor and a contact area with respect to the touch sensor changes according to the strength of the pressing operation, and the touch The sensor may detect at least one of a pressure applied to the detection surface by the operation member and a contact area of the operation member.

  Further, in the controller device, the operation member is disposed so as to contact a detection surface of the touch sensor even when the user operation is not performed in a state where the attachment is attached to the core unit. The attachment maintains the operation member at a position away from the detection surface of the touch sensor until the attachment to the core unit is completed, and the attachment of the operation member to the core unit is completed when the attachment to the core unit is completed. It is good also as providing the mechanism moved to the position made to contact the detection surface of a touch sensor.

  The core unit according to the present invention is a core unit of a controller device that is used by attaching an attachment including an operation member, and for attaching the attachment at a position that covers at least a part of the touch sensor and the touch sensor. And the operation member is configured to be able to contact the touch sensor in a state where the attachment is attached to the core unit, and the touch sensor is configured to allow the user to operate the operation member. It is characterized by detecting a change in a contact mode with respect to the touch sensor.

1 is an overall schematic diagram of an information processing system including a controller device according to an embodiment of the present invention. It is a perspective view which shows a mode that the core unit of the controller device which concerns on this embodiment was seen from the front side. It is a perspective view which shows a mode that the core unit was seen from the back side. It is a perspective view which shows a mode that the 1st button unit was seen from the front side. It is a perspective view which shows a mode that the 1st button unit was seen from the back side. It is a perspective view which shows a mode that the grip unit was seen from the front side. It is a perspective view which shows a mode that the grip unit was seen from the back side. It is a perspective view which shows the controller device of the state which attached the 1st button unit and the grip unit to the core unit. It is a perspective view which shows a mode that the 2nd button unit was seen from the front side. It is a perspective view which shows a mode that the 2nd button unit was seen from the back side. It is a perspective view which shows a mode that the three-dimensional operation input unit and the auxiliary | assistant grip unit were seen from the front side. It is a perspective view which shows a mode that the three-dimensional operation input unit and the auxiliary | assistant grip unit were seen from the back side. It is a perspective view which shows the controller device of the state which attached the 2nd button unit, the three-dimensional operation input unit, and the auxiliary | assistant grip unit to the core unit. It is a perspective view which shows a mode that the integrated three-dimensional operation input unit was seen from the front side. It is a perspective view which shows a mode that the integrated three-dimensional operation input unit was seen from the back side. It is a perspective view which shows a mode that the sphere unit was seen from the front side. It is a perspective view which shows a mode that the sphere unit was seen from the back side. It is a perspective view which shows the controller device of the state which attached the sphere unit to the core unit. It is a perspective view which shows an example of a press operation unit. It is sectional drawing of the press operation unit shown in FIG. It is a perspective view which shows another example of a press operation unit. It is sectional drawing of the press operation unit shown in FIG. It is a perspective view which shows the external appearance of a throttle lever unit. It is sectional drawing which shows an example of the internal structure of a throttle lever unit. It is a figure which shows another example of the internal structure of a throttle lever unit. It is sectional drawing of the throttle lever unit shown in FIG. It is a figure which shows the attachment provided with the operation member which imitated the handle. It is a figure which shows the attachment provided with the operation member which imitated the shift lever. It is a figure which shows the attachment provided with the operation member which imitated the accelerator pedal and the brake pedal. It is a figure which shows the attachment provided with the operation member which imitated the keyboard. It is a figure which shows the attachment provided with the operation member which imitated the piston bubble of the trumpet. It is a figure which shows the attachment provided with the operation member which imitated the drum. It is a figure which shows the attachment provided with the operation member which imitated the reel of the fishing rod. It is a figure which shows an example of an attachment provided with a some light emission part. It is a figure which shows another example of an attachment provided with a some light emission part. It is a figure which shows an example of an attachment provided with a marker. It is a figure which shows an example of the attachment which functions as a remote controller which operates household appliances. It is a figure which shows a mat-type attachment. It is a figure which shows an example of the controller device with which the attachment provided with a touch sensor was attached. It is a perspective view which shows an example of an operation member drive mechanism. It is a figure explaining operation | movement of the operation member drive mechanism shown to FIG. 40A. It is a figure explaining operation | movement of the operation member drive mechanism shown to FIG. 40A. It is a perspective view which shows another example of an operation member drive mechanism. It is a perspective view which shows another example of the operation member drive mechanism.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is an overall schematic diagram of an information processing system including a controller device 1 according to an embodiment of the present invention. In the present embodiment, the information processing system is configured to include a controller device 1 and an information processing apparatus 2 that are connected to each other via a wireless communication interface. The user grips the controller device 1 with his / her hand and performs various operation inputs on the operation members included in the controller device 1. The controller device 1 transmits a signal indicating the user's operation content to the information processing apparatus 2 by wireless communication, and the information processing apparatus 2 executes various types of information processing according to the operation signal received from the controller device 1.

  The controller device 1 includes a core unit 10 that is a main body of the controller device 1 and a plurality of types of attachments that can be attached to the core unit 10. In FIG. 1, the controller device 1 with the first button unit 20 attached to the core unit 10 is illustrated.

  The information processing device 2 is a consumer game machine or the like, and includes a control unit 3, a communication unit 4, and a storage unit 5, and is connected to the display device 6 and the imaging device 7.

  The control unit 3 is a program control device such as a CPU, and executes various types of information processing according to programs stored in the storage unit 5. Specifically, for example, the control unit 3 reads a game program from the storage unit 5 and executes a game process. The communication unit 4 is a wireless communication interface such as Bluetooth (registered trademark), and performs wireless communication with the core unit of the controller device 1.

  The storage unit 5 includes a memory element such as a RAM or a ROM, and stores a program executed by the control unit 3. The storage unit 5 also functions as a work memory for the control unit 3.

  The display device 6 is a home television receiver or the like, and displays an image indicating the result of processing executed by the information processing device 2.

  The imaging device 7 is a CCD camera or the like and is installed with the user facing the upper surface of the display device 6, for example, and images the controller device 1 held by the user's hand. The information processing apparatus 2 detects changes in the position and orientation of the controller device 1 in the space by analyzing the captured image. In particular, when the user grips and moves the controller device 1 with a hand attached to an optically easy-to-detect attachment such as a sphere unit 80 described later, the information processing apparatus 2 captures the captured image of the imaging apparatus 7. By using this, it is possible to detect the movement of the controller device 1. The information processing apparatus 2 can acquire the detected movement of the controller device 1 as a kind of user operation input and execute information processing according to the content.

  2 and 3 are perspective views showing the appearance of the core unit 10, in which FIG. 2 shows the core unit 10 as seen from the front side, and FIG. 3 shows the state as seen from the back side. . As shown in these drawings, the core unit 10 has a thin plate shape, and a touch sensor 11 is disposed on the front surface 10a thereof. Hereinafter, the width direction (left-right direction) of the core unit 10 is referred to as an X-axis direction, the height direction (up-down direction) is referred to as a Y-axis direction, and the thickness direction (front-back direction) is referred to as a Z-axis direction.

  The touch sensor 11 in this embodiment is a multipoint detection type sensor. That is, a plurality of detection areas are arranged over substantially the entire detection surface of the touch sensor 11, and the touch sensor 11 detects whether or not an object has contacted each of these detection areas. Accordingly, the touch sensor 11 can detect the contact positions of the plurality of objects even when a plurality of objects such as a plurality of fingers of the user simultaneously contact the detection surface of the touch sensor 11. In addition, when a relatively large object contacts the detection surface of the touch sensor 11, not only the position of the region where the object contacts the detection surface but also the size (that is, the contact area) can be specified. Furthermore, the touch sensor 11 detects the magnitude of the pressure on the detection surface of the contacted object. That is, the touch sensor 11 can detect not only the contact position of the object but also how much the object is pressed against the position.

  The core unit 10 is provided with a plurality of attachment mechanisms, and a plurality of types of attachments are attached to different positions by these attachment mechanisms. Specifically, a groove 12 is formed as a first attachment mechanism on both side surfaces of the core unit 10, and an attachment that can be attached to the groove 12 is provided. An attachment of the type attached to the first attachment mechanism in this way is hereinafter referred to as a front attachment type attachment. The front-mounted attachment is attached to the core unit 10 so as to cover at least a part of the touch sensor 11 arranged on the front surface 10a (first surface) of the core unit 10.

  In addition, on the back surface 10c of the core unit 10, two vertical holes 14a and a claw accommodating portion 14b are arranged as a second attachment mechanism. The claw accommodating portion 14b is disposed at a substantially central position in the X-axis direction of the core unit 10, and the two vertical holes 14a are disposed on both sides of the claw accommodating portion 14b so as to extend in the Y-axis direction. Moreover, as for the two vertical holes 14a, one end is formed wide in the X-axis direction, and the width of the other end in the X-axis direction is narrower than this wide portion. The type of attachment attached to the second attachment mechanism is hereinafter referred to as a back attachment type attachment. The back-mounted attachment is attached to the core unit 10 so as to cover at least a part of the back surface 10c (second surface) of the core unit 10. Here, since the front surface 10a and the back surface 10c face each other, different attachments can be attached to the front side and the back side of the core unit 10, respectively. Therefore, for example, an attachment provided with an operation member to be operated by the user is attached to the front surface of the core unit 10, and an attachment provided with a grip portion for facilitating gripping the core unit 10 is attached to the back surface of the core unit 10, Alternatively, it is possible to expand with a high degree of freedom, such as attaching different types of attachments on both sides.

  Moreover, the attachment part 13 in which the insertion port 13a was provided is arrange | positioned in the position away from the vertical hole 14a and the nail | claw accommodating part 14b of the back surface 10c of the core unit 10 as a 3rd attachment mechanism. The insertion opening 13 a is open toward the side surface 10 b of the core unit 10. The type of attachment attached to the third attachment mechanism is hereinafter referred to as a side attachment type attachment. The side-mounted attachment is attached to the core unit 10 so as to cover at least a part of each of the back surface 10c and the side surface 10b (third surface).

  In addition, a posture detection sensor 15 that detects a change in the posture of the core unit 10 is disposed inside the core unit 10. The posture detection sensor 15 may be an acceleration sensor that detects gravitational acceleration, a gyroscope that detects angular velocity of rotation, a magnetic sensor that detects the direction of geomagnetism, or the like. Moreover, these combinations may be sufficient. The detection result by the posture detection sensor 15 is transmitted to the information processing device 2 and used for processing of the information processing device 2.

  Hereinafter, specific examples of various attachments attached to the core unit 10 will be described.

  4 and 5 are perspective views showing the appearance of the first button unit 20 which is a specific example of the front-mounted attachment. Specifically, FIG. 4 shows a state of the first button unit 20 viewed from the front side, and FIG. 5 shows a state of the first button unit 20 viewed from the back side. In addition, in the perspective view of each attachment including the subsequent figures, the core unit in a state in which the attachment is attached to the core unit 10 in order to show the attachment direction when the attachment is attached to the core unit 10. An arrow indicating each of the ten reference axis directions is attached.

  A holding portion 21 is provided on the left and right side surfaces of the first button unit 20, and a claw 21 a is provided in the middle of each of the left and right holding portions 21. When the first button unit 20 is superimposed on the core unit 10 from the bottom side so that the holding portion 21 holds the side surface of the core unit 10, the claw 21a engages with the groove 12 provided on the side surface of the core unit 10, The first button unit 20 is fixed to the core unit 10. At that time, the back surface of the first button unit 20 faces the front surface 10 a of the core unit 10, and a part of the front surface 10 a of the core unit 10 is covered with the first button unit 20.

  On the front face of the first button unit 20, four action buttons 22, four direction instruction buttons 23, and three function buttons 24 to be operated by the user are arranged. These buttons all extend so as to penetrate the first button unit 20 in the depth direction, and end portions on the back side of these buttons (that is, opposite to the front side end portions operated by the user). End) is exposed on the back side of the first button unit 20. Specifically, as shown in FIG. 5, the lower end 22 a of the action button 22, the lower end 23 a of the direction instruction button 23, and the lower end 24 a of the function button 24 are all exposed on the back side of the first button unit 20. Yes. Each of these buttons is located within the detection surface of the touch sensor 11 when viewed from the front side of the controller device 1 when the first button unit 20 is attached to the core unit 10. Therefore, when the user presses each button in the Z-axis direction, the lower end of the pressed button comes into contact with the detection surface of the touch sensor 11. That is, when the user presses any button, the touch sensor 11 detects the touch of the button, and the core unit 10 transmits information indicating the contact position to the information processing apparatus 2. The information processing device 2 specifies which button the user has pressed using information on the detection position of the touch sensor 11. Each button is urged to the front side, and when the user removes the finger from the button, the button returns to the original position and is separated from the touch sensor 11. That is, the lower end of each button contacts the touch sensor 11 only while the user performs an operation of pressing the button.

  Next, the grip unit 30 will be described as a specific example of the back-mounted attachment. 6 and 7 are perspective views showing the appearance of the grip unit 30. FIG. 6 shows the grip unit 30 as viewed from the front side, and FIG. 7 shows the state as viewed from the back side. .

  As shown in FIG. 6, two convex portions 31 a and claws 31 b are arranged on the front side of the attachment portion 31 of the grip unit 30. Here, the tip of the convex portion 31a extends in the X-axis direction. When the two convex portions 31a are inserted into the wide portions of the vertical holes 14a on the back surface of the core unit 10 and the grip unit 30 is slid in the Y-axis direction, the convex portions 31a move to the portions where the width of the vertical holes 14a is narrowed. And the claw 31b engages with the claw accommodating portion 14b, and the grip unit 30 is fixed to the core unit 10. At this time, the front surface of the grip unit 30 covers the back surface 10 c of the core unit 10.

  Two gripping portions 32 are connected to the back side of the attachment portion 31. The user can operate the controller device 1 more easily by attaching the grip unit 30 to the core unit 10 and holding each of the two grip portions 32 with his / her hand.

  Note that attachments having different attachment positions with respect to the core unit 10 can be attached to the core unit 10 at the same time. That is, the user can use the controller device 1 with the front-mounted attachment attached to the front side of the core unit 10 and the back-mounted attachment attached to the rear side. FIG. 8 is a perspective view showing the controller device 1 in a state where both the first button unit 20 and the grip unit 30 described so far are attached to the core unit 10 at the same time. In this way, by attaching the attachment including the operation member on one surface of the core unit 10 and the attachment including the gripping portion on the surface opposite to the surface, the user can hold the gripping portion 32. Each button such as the action button 22 and the direction instruction button 23 can be operated. The operation content performed by the user on each button is detected by the touch sensor 11 on the core unit 10 side and transmitted to the information processing apparatus 2.

  Next, as another example of the front-mounted attachment, the second button unit 40 will be described with reference to FIGS. 9 and 10.

  Similar to the first button unit 20, a plurality of buttons 41 are arranged on the front surface of the second button unit 40. These buttons may have the same structure as that provided in the first button unit 20. Similarly to the first button unit 20, the second button unit 40 is also provided with a holding portion 21 having a claw 21 a and is attached to the core unit 10 by the claw 21 a.

  Here, the first button unit 20 and the second button unit 40 both have buttons having the same structure, but their button arrangements are different. Therefore, when the user operates each button 41 with the second button unit 40 attached, the position where the lower end 41a on the back side of the operated button 41 contacts the touch sensor 11 of the core unit 10 is It is different from the position when the 1 button unit 20 is attached.

  The core unit 10 includes means for acquiring identification information for identifying the type of attachment attached to the core unit 10. By combining this identification information and the detection result of the touch sensor 11, the information processing apparatus 2 can specify which operation member of which type of attachment is operated.

  Here, a specific method for the core unit 10 to acquire the attachment identification information will be described. About a front attachment type attachment, since it attaches to the core unit 10 so that the touch sensor 11 may be covered, this touch sensor 11 can be used in order to acquire identification information. In this case, each of the plurality of types of front-mounted attachments includes one or a plurality of protrusions with different arrangement patterns. This protrusion protrudes on the back side of the front-mounted attachment so as to come into contact with the touch sensor 11 in a state where the attachment is attached to the core unit 10. When the touch sensor 11 detects the contact position of the one or the plurality of protrusions, the core unit 10 can classify the front-mounted attachment. In other words, the information on the contact position of the protrusion detected by the touch sensor 11 plays a role as attachment identification information.

  Alternatively, the core unit 10 may acquire identification information optically represented on the surface of each attachment. For example, an identification tag is attached to a predetermined position of each attachment, and the core unit 10 reads information displayed on the identification tag by an optical sensor. Thereby, the core unit 10 can discriminate | determine the classification of the attached attachment. This method can be applied to any attachment of a front mounting type, a back mounting type, and a side mounting type.

  Alternatively, each attachment may include an RFID tag such as an IC tag that records its identification information, and the core unit 10 may incorporate a tag reader that reads information recorded on the RFID tag. By doing so, the core unit 10 can determine the type of attachment attached to the core unit 10 by reading the information recorded on the RFID tag existing in the vicinity of the core unit 10 using the tag reader. This method can also be applied to an attachment attached to each position.

  In the above description, the core unit 10 determines the type of attachment attached to itself. However, the core unit 10 acquires the identification information and transmits the acquired identification information to the information processing apparatus 2. The information processing apparatus 2 may determine the type of attachment using the identification information received from the core unit 10.

  Next, an example of the side-mounted attachment and the back-mounted attachment used in the set will be described with reference to FIGS. 11 and 12. In these drawings, perspective views of the three-dimensional operation input unit 50 and the auxiliary grip unit 60 that are assumed to be attached to the core unit 10 at the same time are shown.

  The three-dimensional operation input unit 50 is an example of a side-mounted attachment, and includes an insertion portion 51 used for attachment to the core unit 10, a left hand grip portion 52, and an analog stick 53. The three-dimensional operation input unit 50 is attached to the core unit 10 by inserting the insertion portion 51 into the insertion port 13a from above the core unit 10. In a state of being attached to the core unit 10, the user holds the left hand holding part 52 with the left hand and operates the analog stick 53. The analog stick 53 is operated by being tilted up and down, left and right (X-axis and Y-axis directions), and can be pushed in the front-rear direction (Z-axis direction). Thereby, the user can give a direction instruction to an arbitrary direction in the three-dimensional space. The three-dimensional operation input unit 50 directly transmits a signal indicating a user operation content on the analog stick 53 to the information processing apparatus 2 independently of the core unit 10.

  The auxiliary grip unit 60 includes an attachment portion 31 in which convex portions 31 a and claws 31 b are arranged, like the grip unit 30, and is attached to the back surface of the core unit 10 via the attachment portion 31. Further, the auxiliary grip unit 60 includes a right hand grip 61 for a user to grip with the right hand.

  FIG. 13 shows the controller device 1 in a state where the second button unit 40 is attached to the front surface 10a of the core unit 10, the auxiliary grip unit 60 is attached to the rear surface 10c, and the three-dimensional operation input unit 50 is attached to the side surface 10b. Yes. Thus, three attachments are simultaneously attached to the core unit 10 via each of the first to third attachment mechanisms. Further, as shown in FIG. 13, the left hand gripping portion 52 of the three-dimensional operation input unit 50 and the right hand gripping portion 61 of the auxiliary grip unit are 90 degrees with respect to the gripping portion 32 of the grip unit 30 with respect to the core unit 10. Can be mounted in different orientations. Therefore, in a state where the three-dimensional operation input unit 50 and the auxiliary grip unit 60 are attached to the core unit 10, the user holds the controller device 1 in a direction different from the case where the grip unit 30 is attached. Become.

  As described above, the user can hold the controller device 1 in various orientations and perform an operation input in accordance with the direction of the operation member or gripping portion included in each attachment and the direction in which each attachment is attached to the core unit 10. it can. Here, by using the detection result of the posture detection sensor 15 incorporated in the core unit 10, the information processing apparatus 2 can specify the orientation in which the user holds the controller device 1. Accordingly, by interpreting the user's operation direction with respect to the operation member using such orientation information, the operation member can be operated with the same operational feeling no matter what orientation the user holds the controller device 1. Can do. For example, when the detection result of the posture detection sensor 15 determines that the user holds the core unit 10 sideways (the X-axis direction is close to the horizontal direction and the Y-axis direction is close to the vertical direction), the information processing apparatus 2 interprets the operation input of the analog stick 53 along the X-axis direction as a horizontal direction instruction, and interprets the operation input of the analog stick 53 along the Y-axis direction as a vertical direction instruction. On the other hand, when it is determined that the user holds the core unit vertically (the X-axis direction is close to the vertical direction and the Y-axis direction is close to the horizontal direction), the information processing apparatus 2 is in the X-axis direction. The operation input of the analog stick 53 along the direction is interpreted as a vertical direction instruction, and the operation input of the analog stick 53 along the Y-axis direction is interpreted as a horizontal direction instruction.

  Next, an integrated three-dimensional operation input unit 70 will be described with reference to FIGS. 14 and 15 as another example of the back-mounted attachment. The integrated three-dimensional operation input unit 70 is an attachment that independently includes members equivalent to the above-described three-dimensional operation input unit 50 and auxiliary grip unit 60. That is, the integrated three-dimensional operation input unit 70 includes a left hand grip 52, an analog stick 53, and a right hand grip 61. Moreover, the attachment part 31 provided with the two convex parts 31a and the nail | claw 31b is provided as an attachment mechanism to the core unit 10. FIG. In addition, when this back surface attachment type attachment is attached to the core unit 10, the orientation of the grip part with respect to the core unit 10 differs from the three-dimensional operation input unit 50 and the auxiliary grip unit 60 by 90 degrees.

  Next, as another example of the back-mounted attachment, a sphere unit 80 will be described with reference to FIGS. 16 and 17. The sphere unit 80 includes a spherical light emitting portion 81 and a cylindrical gripping portion 82, and a trigger button 83 is disposed on the gripping portion 82. Further, the attachment portion 31 similar to the grip unit 30 or the like is connected to the grip portion 82, and the attachment portion 31 is provided with two convex portions 31a and a claw 31b. The sphere unit 80 is attached to the back surface of the core unit 10 by the convex portions 31a and the claws 31b in the same manner as the grip unit 30 and the like. Furthermore, the sphere unit 80 is configured to be able to directly communicate with the information processing apparatus 2 independently of the core unit 10, and transmits a signal indicating the operation content for the trigger button 83 to the information processing apparatus 2. Further, the light emitting unit 81 is caused to emit light in response to an instruction from the information processing apparatus 2. The information processing apparatus 2 identifies the position of the controller device 1 in the real space by imaging the light from the light emitting unit 81 with the imaging apparatus 7.

  FIG. 18 is a perspective view showing the controller device 1 in a state where the sphere unit 80 is attached to the core unit 10. The user can intuitively perform an operation input to the information processing apparatus 2 by holding the grip 82 and moving the controller device 1 to various positions.

  Next, various attachments used mainly for detecting the contents of the user's operation input by the touch sensor 11 will be described. These attachments are front-mounted attachments that are attached to the core unit 10 so as to cover the touch sensor 11 in order to detect the content of the user's operation input by the touch sensor 11. Furthermore, these attachments are configured to be able to contact the touch sensor 11 in a state where they are attached to the core unit 10, and include an operation member whose contact mode with respect to the touch sensor 11 changes in accordance with a user operation. . Since these attachments detect the user's operation content by the touch sensor 11 on the core unit 10 side, it is not necessary to provide an electric circuit or the like on the attachment side, and the user's operation content is mechanically transferred to the touch sensor 11. What is necessary is just to provide the mechanism to transmit.

  As an example of such an attachment, an attachment including an operation member having a planar operation region having a size corresponding to the detection surface of the touch sensor 11 will be described below. As described above, since the touch sensor 11 is a multi-point detection type and can detect pressure, not only when an object touches one point in the detection surface but also when a soft and large object touches, the object It is possible to detect in what manner the contact is made. Therefore, by using an operation member that is provided with a surface-shaped operation region of a certain size corresponding to the detection surface of the touch sensor 11 and is made of an elastic material, an operation feeling different from the conventional one can be performed. Can be realized.

  FIG. 19 is a perspective view showing an example of a pressing operation unit 90 including an operating member (hereinafter referred to as a pressing operation member 91) having such a planar operation area. FIG. 20 is a cross-sectional view of the pressing operation unit 90 shown in FIG. In addition, since the attachment mechanism with respect to the core unit 10 of an attachment demonstrated here may be the same as the front attachment type attachment demonstrated so far, illustration of an attachment mechanism is abbreviate | omitted in subsequent figures.

  As shown in these drawings, the pressing operation member 91 penetrates the inside of the pressing operation unit 90 in the Z-axis direction, and occupies substantially the entire surface on both the front side and the back side of the pressing operation unit 90. Has been placed. The pressing operation member 91 may be formed using a material such as rubber, elastomer, or filler, for example. When the user performs an operation of pressing a finger or the like against an arbitrary position on the surface of the pressing operation member 91, the pressure is transmitted through the inside of the pressing operation member 91, and the surface on the touch sensor 11 side of the pressing operation member 91. Is pressed against the detection surface of the touch sensor 11. At this time, the position where the touch sensor 11 detects the pressure changes depending on the position where the user performs an operation of pressing the pressing operation member 91. In addition, the size and shape of the area where the touch sensor 11 detects pressure, and the size of the pressure to be detected depend on the magnitude of the force when the user performs an operation of pressing the pressing operation member 91 and how the force is applied. Change. Furthermore, the touch sensor 11 depends on the operation mode such as whether the user has pressed the pressing operation member 91 with one finger, whether the pressing operation member 91 has been pressed with a plurality of fingers, or has been pressed with the palm of the hand. The magnitude of the pressure detected by the touch sensor 11 and the range in which the touch sensor 11 detects the contact of the pressing operation member 91 change. Using the detection result of the touch sensor 11, the information processing apparatus 2 detects which part of the pressing operation member 91 is pressed by what level of force and reflects it in the contents of the information processing.

  FIG. 21 and FIG. 22 are diagrams showing an example of another type of pressing operation unit 90. In the example of this figure, the surface of the pressing operation member 91 is fur. Thus, by making the material of the surface of the pressing operation member 91 different, an attachment group that can be operated with various tactile sensations can be provided to the user. Further, as shown in the cross-sectional view of FIG. 22, the pressing operation member 91 may be formed by laminating a plurality of materials having different hardness and elasticity. By doing so, it is possible to provide an operation member that is close to the touch of an actually existing object such as an animal or a human skin.

  Next, another example of an attachment including an operation member whose contact mode with respect to the touch sensor 11 changes in accordance with a user operation will be described. Specifically, in the following, an example of an attachment including a moving operation member configured so that a contact position with respect to the touch sensor 11 changes in accordance with a user operation will be described. Unlike the operation buttons included in the first button unit 20 and the second button unit 40 described above, the movement operation member does not simply change in contact / non-contact with the presence / absence of a user operation. The contact position of the touch sensor 11 with respect to the detection surface moves in accordance with a user operation along a direction parallel to the detection surface. Therefore, the information processing device 2 determines how the user is moving the moving operation member by acquiring information indicating a change in the contact position detected by the touch sensor 11, and performs processing according to the content. Can be executed.

  The structure of the throttle lever unit 100, which is an example of an attachment including a moving operation member, will be described with reference to FIGS. FIG. 23 is a perspective view showing the appearance of the throttle lever unit 100, and FIG. 24 is a cross-sectional view showing the internal structure. As shown in these drawings, the throttle lever unit 100 includes a base 101 and a lever 102. The lever 102 includes a rotating shaft 103, an operation target unit 104, a sensor contact unit 105, and a spring 106.

  The lever 102 is disposed so as to penetrate the inside of the throttle lever unit 100 as a whole, and is fixed to the base 101 via a rotation shaft 103 so as to be rotatable. The user performs an operation of holding the operation target portion 104 of the lever 102 by hand and moving it forward and backward. As a result of this operation, as indicated by a solid arrow in FIG. 24, the operation target unit 104 rotates about the rotation shaft 103 as a rotation center. With this rotational movement, the sensor contact portion 105 moves on the detection surface of the touch sensor 11 along the Y-axis direction. Here, since the spring 106 built in the lever 102 applies a force in a direction to press the sensor contact portion 105 against the touch sensor 11, the sensor contact portion 105 is maintained in contact with the touch sensor 11. Further, the tip portion of the sensor contact portion 105 is moved along the direction parallel to the detection surface of the touch sensor 11 as indicated by the broken arrow in FIG. . That is, by the action of the spring 106, the rotational movement of the operation target unit 104 is converted into a linear movement parallel to the touch sensor 11 at the tip of the sensor contact unit 105. Thereby, when the user performs an operation of rotating the operation target unit 104, the operation can be detected using the touch sensor 11 having a flat detection surface.

  25 and 26 show another example of the internal structure of the throttle lever unit 100. FIG. In this example, the lever 102 includes an operation target unit 104 to which the rotating shaft 103 and the action unit 107 are connected, and an interlocking unit 108 that is configured separately from the operation target unit 104. The sensor contact portion 105 is formed so as to protrude from the bottom surface of the interlocking portion 108. The interlocking portion 108 includes two standing portions 108b each having a vertical hole 108a, and both ends of the action portion 107 of the lever 102 are respectively inserted into the vertical holes 108a. Further, a groove 108c is formed on the left and right of the interlocking portion 108 along a direction parallel to the detection surface of the touch sensor 11, and an end portion of the guide portion 101a provided in the base 101 is inserted into the groove 108c. Has been.

  When the user performs an operation of moving the operation target unit 104 of the lever 102 back and forth, the operation target unit 104 rotates about the rotation shaft 103, and as a result, the action unit 107 exerts a force on the interlocking unit 108. Here, since the end portion of the guide portion 101 a extending in a direction parallel to the touch sensor 11 is inserted into the groove 108 c, the interlocking portion 108 moves along a direction parallel to the touch sensor 11. The movement of the action unit 107 in the direction perpendicular to the touch sensor 11 is absorbed by the vertical hole 108 a and is not transmitted to the interlocking unit 108. As a result, as in the example of FIG. 24, the rotational motion of the operation target unit 104 is converted into a linear motion in a direction parallel to the touch sensor 11 of the sensor contact unit 105.

  Furthermore, an example of another attachment provided with various operation members will be described. FIGS. 27 to 29 each show an example of an attachment including an operation member simulating a device used when maneuvering a vehicle, like the throttle lever unit 100 of FIG.

  FIG. 27 shows an attachment including an operation member imitating a handle. When the user performs an operation of rotating the handle, a sensor contact portion (not shown) connected to the handle keeps a state in contact with the detection surface of the touch sensor 11 and draws a circle on the detection surface. To move. When the touch sensor 11 detects such movement of the sensor contact portion (not shown), the information processing apparatus 2 can acquire information on the amount and speed of the user's handle operation.

  FIG. 28 shows an attachment provided with an operation member simulating a shift lever. Similarly to the attachment shown in FIG. 27, when the user performs an operation of moving the shift lever in a direction parallel to the touch sensor 11, the sensor contact portion connected to the shift lever is touched in conjunction with this attachment. It moves on the detection surface of the sensor 11.

  FIG. 29 shows an attachment provided with operation members simulating an accelerator pedal and a brake pedal. In this attachment, when the user performs an operation of pressing each of the accelerator pedal and the brake pedal, the pressure with which the sensor contact portion connected to these pedals presses the touch sensor 11 changes according to the operation amount. Has been. The information processing device 2 can know how much the user has pressed each pedal using the pressure intensity detected by the position of the touch sensor 11 corresponding to each pedal.

  30 to 32 show an example of an attachment provided with an operation member imitating a musical instrument. Specifically, the attachment shown in FIG. 30 includes an operation member simulating a keyboard, and the attachment shown in FIG. 31 includes an operation member simulating a trumpet piston / valve. These operation members include a sensor contact portion that comes into contact with the detection surface of the touch sensor 11 in accordance with a user's pressing operation, for example, like the buttons included in the first button unit 20 and the second button unit 40. Further, the attachment of FIG. 32 includes an operation member imitating a drum. This operation member may be the same as the pressing operation member 91 shown in FIGS.

  FIG. 33 shows an example of an attachment including an operation member simulating a fishing rod reel. This operation member may operate in the same manner as the operation member imitating the handle shown in FIG.

  34 to 36 show an example of an attachment including a member to be optically detected, like the sphere unit 80. 34 and 35 show an attachment including a plurality of light emitting units similar to the sphere unit 80. FIG. FIG. 36 shows an attachment provided with a marker instead of the light emitting unit. This marker may represent a code image such as a two-dimensional barcode. When the imaging device 7 captures an image including the marker and the information processing device 2 analyzes the code image represented by the marker, the information processing device 2 can execute various processes according to the contents of the marker. .

  FIG. 37 is a diagram illustrating an example of an attachment that functions as a remote controller for operating household appliances and the like. In this example, the core unit 10 has a function of communicating household appliances with infrared rays or the like, and when the touch sensor 11 detects that the user has pressed any button provided in the attachment, the core unit 10 Transmits an operation signal corresponding to the button to the home appliance.

  FIG. 38 shows an example of a mat-type attachment in which an operation input is performed by a user stepping on a foot. The attachment shown in this example transmits information indicating the position where the user steps on the mat with his / her foot to the information processing apparatus 2.

  In addition to those shown above, various attachments may be attached to the core unit 10. For example, an attachment including a touch sensor different from the touch sensor 11 may be attached to the core unit 10. In particular, by adopting an attachment having such a touch sensor as a back-mounted attachment, as shown in FIG. 39, the controller device 1 has a touch sensor 11 of the core unit 10 on the front surface and an attachment touch sensor on the back surface. Thus, touch sensors can be provided on both sides. Alternatively, the core unit 10 itself may be configured to be attachable to another core unit 10. In particular, by configuring the attachment mechanism so that the back surfaces of the two core units 10 can be connected to each other, a controller device including touch sensors on both sides as described above can be realized.

  Further, an attachment including an external battery that supplies power to the core unit 10 may be attached to the core unit 10. In this case, a power supply terminal is provided at a position in contact with the attachment of the core unit 10, and the attachment is attached via this terminal.

  Moreover, in the above description, the attachment other than the front-mounted attachment that includes the operation member that comes into contact with the touch sensor 11 does not include the operation member, or information indicating the operation content for the operation member provided by itself. The information is directly transmitted to the information processing apparatus 2. However, the present invention is not limited to this, and each attachment includes a connector or the like that can be connected to the core unit 10, and a signal indicating the user's operation content with respect to the operation member included in the attachment is sent to the core unit 10 via this connector. It is good also as transmitting. In this case, the core unit 10 transmits a signal indicating the operation content received from the attachment attached thereto to the information processing apparatus 2 together with the detection result of the touch sensor 11.

  In the above description, the controller device 1 is used exclusively for operation input from the user. In addition, the controller device 1 may have an output function for the user. Specifically, the core unit 10 or an attachment attached to the core unit 10 may include a vibration unit such as a motor or an actuator, a speaker that outputs sound, a light for presenting information to the user, and the like. Further, a mechanism for performing force feedback with respect to the user's operation may be provided for the operation member, the grip portion, and the like provided in the touch sensor 11 and the attachment.

  Next, an example of an operation member drive mechanism for avoiding contact of the operation member with the touch sensor 11 when an attachment including an operation member that can contact the touch sensor 11 is attached to the core unit 10 will be described. 40A, 40B, and 40C are diagrams illustrating an example of such an operation member driving mechanism. FIG. 40A is a perspective view of the attachment 110 including the operation member 111, and FIG. 40B is a diagram illustrating the attachment 110 as the core unit 10. FIG. 40C is a cross-sectional view showing a state where the attachment of the attachment 110 to the core unit 10 is completed. FIG. 40A shows a state where the cover 116 is removed to show the internal structure of the attachment 110.

  In a state where it is not attached to the core unit 10, the plate 112 including the operation member 111 is connected to the base 113 of the attachment 110 by a fulcrum 115, and upwards so as to be slightly separated from the base 113 by a spring (not shown). Has been pushed up. The plate 112 is supported by a lever 114. A claw 114 a is provided at the lower end of the lever 114, and the claw 114 a projects downward from the bottom surface of the base 113. When attaching the attachment 110 to the core unit 10, as shown in FIG. 40B, the attachment 110 is slid from one end of the core unit 10 in the direction indicated by the arrow in the drawing. At this time, since the plate 112 is floating from the base 113, the lower end of the operation member 111 is maintained at a position away from the touch sensor 11. Here, when the attachment 110 is further moved to a position where the entire attachment 110 overlaps the core unit 10, the lever 114 is rotated by the claw 114a being pushed by the core unit 10, and the plate 112 is pushed downward. By the action of the lever 114, when the attachment of the attachment 110 to the core unit 10 is completed, the plate 112 moves in a direction parallel to the touch sensor 11, and the lower end of the operation member 111 contacts the detection surface of the touch sensor 11. . That is, the operation member 111 does not contact the touch sensor 11 until the attachment of the attachment 110 is completed, and comes into contact with the touch sensor 11 when the attachment to the attachment 110 is completed.

  41 and 42 are diagrams illustrating another example of the operation member driving mechanism. In the example of FIG. 41, the plate 112 is supported at four corners by a total of four levers, two levers 114 with claws and two levers 118 without claws, and is pushed upward by a spring 117. ing. As a result, in a state where the attachment 110 is not attached to the core unit 10, the plate 112 is maintained in a position substantially parallel to the base 113 and away from the base 113. When this attachment 110 is attached to the core unit 10, the claws provided on the two levers 114 are pushed by the core unit 10 and the lever 114 rotates as in the example shown in FIGS. 40A to 40C. At this time, the rotation of the lever 114 is also transmitted to the lever 118 having no claw by the parallel link 119, and as a result, all the four levers rotate to push the plate 112 down to the touch sensor 11 side. For this reason, the operation member 111 arranged on the plate 112 comes into contact with the touch sensor 11.

  In the example of FIG. 42, the four corners are supported by four guide pins 120 so that the plate 112 moves only in the vertical direction. Further, a spring 117 is attached to a part of these guide pins 120, and the plate 112 is pushed upward by the action of the spring 117. When the attachment 110 is attached to the core unit 10, the claw provided at the tip of the lever 114 is pushed by the core unit 10 as in the example described so far, and the lever 114 rotates to push the plate 112 downward. At this time, the plate 112 moves along the guide pins 120 in a direction perpendicular to the touch sensor 11. As a result, the operation member 111 disposed on the plate 112 comes into contact with the touch sensor 11.

  By applying the operation member driving mechanism described above, the operation member such as the pressing operation unit 90 and the throttle lever unit 100 is arranged so that the operation member contacts the touch sensor 11 even when the user does not operate the operation member. Even when the attachment is attached to the core unit 10, the operation member can be prevented from coming into contact with the core unit 10, and the attachment can be smoothly attached to the core unit 10. In addition, all the configurations of the operation member driving mechanism described here are merely examples, and the operation member may not contact the touch sensor 11 when the attachment is attached by another method. For example, in the above description, the state in which the plate 112 is separated from the base 113 by the action of the spring is described. However, an elastic member other than the spring may be used.

  DESCRIPTION OF SYMBOLS 1 Controller device, 2 Information processing apparatus, 3 Control part, 4 Communication part, 5 Storage part, 6 Display apparatus, 7 Imaging apparatus, 10 Core unit, 11 Touch sensor, 12 Groove, 13 Mounting part, 13a Insertion port, 14a Vertical hole , 14b Claw receiving portion, 15 posture detection sensor, 20 first button unit, 30 grip unit, 40 second button unit, 50 3D operation input unit, 60 auxiliary grip unit, 70 integrated 3D operation input unit, 80 sphere Unit, 90 pressing operation unit, 100 throttle lever unit.

Claims (13)

A core unit having a touch sensor disposed on a first surface;
A first attachment attached to the core unit so as to cover the touch sensor;
A controller device connected to the information processing apparatus,
The first attachment is
The first attachment is configured to be able to contact the touch sensor in a state of being attached to the core unit, and includes an operation member whose contact mode with respect to the touch sensor changes according to a user operation,
The core unit is
A first attachment mechanism disposed on a side surface with respect to the first surface for attaching the first attachment so as to cover the touch sensor;
A second attachment mechanism for attaching a second attachment different from the first attachment, disposed on a second surface that is the back surface of the first surface;
A third attachment mechanism for attaching a third attachment different from the first attachment that is disposed on the second surface and away from the second attachment mechanism;
At least one of said 2nd attachment and said 3rd attachment is provided with the operation member used as a user's operation object. The controller device characterized by the above-mentioned. The controller device of claim 1, wherein
The controller device, wherein at least one of the second attachment and the third attachment includes a grip part for a user to grip. The controller device according to claim 1 or 2,
The core unit is
An identification information acquisition means for acquiring identification information for identifying the type of each of the first attachment, the second attachment, and the third attachment;
The identification information acquired by the identification information acquisition unit is used for identification of each type of the first attachment, the second attachment, and the third attachment by the information processing apparatus. . The controller device of claim 3, wherein
The core unit provides the information processing apparatus with the acquired identification information, a detection result of the touch sensor, and an operation content for an operation member to be operated by the user,
The information processing apparatus uses the combination of the identification information and the detection result to specify the content of the operation on the operation member included in the first attachment, and uses the identification information and the operation content. the combination identifies the content of the operation to the operating member provided on the second attachment, and a content of the operation to the operating member provided on the third attachment by using it,
A controller device characterized by that. The controller device according to any one of claims 1 to 4,
The operation member is arranged so as to contact the detection surface of the touch sensor even when the user operation is not performed in a state where the first attachment is attached to the core unit.
The first attachment maintains the operation member at a position away from the detection surface of the touch sensor until the attachment to the core unit is completed, and the operation is performed when the attachment to the core unit is completed. A controller device comprising a mechanism for moving a member to a position where the member comes into contact with the detection surface of the touch sensor. A core unit with a touch sensor on one side;
A first attachment attached to the core unit so as to cover the touch sensor;
A controller device connected to the information processing apparatus,
The first attachment is
The first attachment is configured to be able to contact the touch sensor in a state of being attached to the core unit, and includes an operation member whose contact mode with respect to the touch sensor changes according to a user operation,
The operation member is arranged so as to contact the detection surface of the touch sensor even when the user operation is not performed in a state where the first attachment is attached to the core unit.
The first attachment maintains the operation member at a position away from the detection surface of the touch sensor until the attachment to the core unit is completed, and the operation is performed when the attachment to the core unit is completed. A controller device comprising a mechanism for moving a member to a position where the member comes into contact with the detection surface of the touch sensor. A controller device according to any one of claims 1 to 6, comprising:
The core unit is
An identification information acquisition means for acquiring identification information for identifying the type of the first attachment;
The controller device, wherein the identification information acquired by the identification information acquisition unit is used for identifying the type of the first attachment by the information processing apparatus. The controller device of claim 7 , wherein
The first attachment further includes a contact member that contacts a predetermined position of the touch sensor when the first attachment is attached to the core unit.
The said identification information acquisition means acquires the information of the position where the said contact member contacts the said touch sensor as said identification information. The controller device characterized by the above-mentioned. The controller device according to claim 7 or 8,
The core unit provides the acquired identification information and the detection result of the touch sensor to the information processing apparatus,
The said information processing apparatus specifies the content of operation with respect to the operation member with which a said 1st attachment is provided by using the said identification information and the said detection result in combination. The controller device characterized by the above-mentioned. The controller device according to any one of claims 1 to 9,
The controller device is configured such that a contact position with respect to the touch sensor moves in accordance with a user operation along a direction parallel to a detection surface of the touch sensor. The controller device according to any one of claims 1 to 10,
The operation member includes a planar operation region corresponding to the detection surface of the touch sensor, and when the user performs a pressing operation on any position in the operation region, the operation member is positioned at the position of the pressing operation. A controller device configured to change a contact mode with respect to a position of a touch sensor in response. The controller device of claim 11, wherein
The operation member is configured such that at least one of the pressure applied to the touch sensor and the contact area with respect to the touch sensor changes according to the strength of the pressing operation.
The controller device, wherein the touch sensor detects at least one of a pressure applied to the detection surface by the operation member and a contact area of the operation member. A core unit of a controller device that is connected to an information processing apparatus and uses a first attachment having an operation member attached to a first surface ,
A touch sensor;
A first attachment mechanism for attaching the first attachment to a position covering at least a part of the touch sensor, which is disposed on a side surface with respect to the first surface;
A second attachment mechanism for attaching a second attachment different from the first attachment, disposed on a second surface that is the back surface of the first surface;
A third attachment mechanism for attaching a third attachment different from the first attachment, disposed on the second surface and at a position away from the second attachment mechanism;
With
The operation member is configured to be able to contact the touch sensor in a state where the first attachment is attached to the core unit.
The touch sensor detects a change in the contact mode with respect to the touch sensor of the operation member with the operation of the User chromatography THE,
A core unit of a controller device characterized by that.

Images