JP2011118725A - Information processing equipment, information processing method, and information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide information processing equipment, an information processing method and an information processing program, which allow a user to input intended gestures easily and to learn about the gestures corresponding to operation contents while using the equipment. <P>SOLUTION: The information processing equipment operable by gestures includes: a gesture object recognition section 211 for recognizing a gesture object imaged by a camera 102; a position determination section 221 for determining whether the recognized gesture object is in a predetermined start position relative to the position of the camera; and a guidance display control section 224 for displaying guidance on a display corresponding to the operation contents when the recognized gesture object is in the predetermined start position relative to an imaged position, the guidance indicating a movement method of the recognized gesture object. The user can input gestures easily, and learn about the gestures while using the information processing equipment, and thus a barrier for starting to use can be lowered. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing device that can be operated by a gesture, an information processing method using the same, and an information processing program to be executed by the information processing method.

  Conventionally, information processing devices such as personal computers, mobile phones, and television receivers have a display unit such as a liquid crystal display and inputs such as a keyboard, buttons, remote control, mouse, or touch panel for inputting predetermined operation contents and characters. Part. In general, the information processing device executes a predetermined process according to the operation content input by the key operation, and displays the execution result on the display unit.

  In recent years, in addition to a keyboard, a mouse, and a touch panel, a device that recognizes an image of a user with an externally connected camera and automatically inputs operation contents in accordance with the movement of the user has been proposed. A series of movements of a person's hand can have a specific meaning. For example, moving the hand to the left and right means “goodbye” and moving the hand to move from the back to the front means “I want you to come here”. Further, not only hand movements but also other body movements can have specific meanings as well. With such image recognition of a series of specific movements (hereinafter referred to as gestures) by a part of the body, specific information corresponding thereto can be input (hereinafter referred to as gesture input).

  When such a device is used, the user needs to learn a gesture corresponding to the operation content with reference to an instruction manual or the like. The user remembers each gesture and makes the device recognize the operation content that the user wants to input. Even if the user intends to perform the gesture correctly, the user may not input the device as intended, or may not know the action actually recognized by the device. On the other hand, a method has been proposed in which the user is fed back to the learning process until the recognition target motion is recognized (see, for example, Patent Document 1).

JP 2001-306049 A

  However, although the device described in Patent Document 1 generates a visual feedback screen representing the locus of hand movement, the explanation of the operation does not appear on the screen, and the user does not remember the gesture by referring to the instruction manual or the like. Must not. On the other hand, when the device gesture described in Patent Document 1 is input by mistake, the user cannot realize that the user has made a mistake. And such a device has a high barrier for a user to start using. Moreover, since the learning effect for the user is not enhanced, an easy-to-use device cannot be provided.

  The present invention has been made in view of such circumstances, and an information processing device, an information processing method, and an information processing that can easily input an intended gesture and can learn a gesture corresponding to the operation content while using the device. The purpose is to provide a program.

  (1) In order to achieve the above object, an information processing device according to the present invention is an information processing device that can be operated by a gesture, the gesture target recognition unit recognizing a gesture target photographed by a camera, and the recognition target. A position determination unit that determines whether or not the gesture target is at a predetermined start position with respect to the camera position, and a start position that is determined with respect to the recognized gesture target with respect to the camera position. A guidance display control unit that displays a guidance for instructing a movement method of the recognized gesture object on a display in correspondence with the operation content.

  By displaying the guidance in this way, the user can easily input the intended gesture, can learn the gesture corresponding to the operation content while using the information processing device, and can reduce the barrier to starting use.

  (2) In the information processing apparatus of the present invention, the guidance display control unit recognizes the gesture target on the display when the gesture target recognition unit recognizes the gesture target photographed by the camera. It is characterized by displaying. Accordingly, the user can know that the gesture target has been recognized, and can easily convey the gesture.

  (3) Further, in the information processing apparatus according to the present invention, the guidance display control unit, the gesture target recognition unit, and the gesture target photographed by the camera are set at a predetermined start position with respect to the position of the camera. When it is recognized that there is a gesture, the fact that the gesture object photographed by the camera is at the start position is displayed on the display. Thereby, the user can know that the gesture target is at the start position, and can easily convey the gesture.

  (4) Moreover, the information processing apparatus of this invention is characterized by the said guidance display control part displaying the instruction | indication which matched the movement direction of the said gesture object, and the operation content as said guidance. Thereby, the user can easily know the moving direction of the gesture target for realizing the desired operation.

  (5) Further, the information processing apparatus according to the present invention includes a mirroring processing unit that performs a mirroring process on the recognized video image of the gesture target, and a gesture display control unit that displays the gesture target subjected to the mirroring process on the display. And further comprising. Thus, by displaying the gesture object as a mirror image, it is possible to prevent the user who performs the gesture while facing the display from feeling uncomfortable.

  (6) Further, in the information processing device of the present invention, the guidance display control unit displays a capture marker indicating that the photographed gesture target has been recognized, corresponding to the predetermined start position of the display. It is characterized by being displayed at a position. The display of such a captured marker allows the user to know the start position of the gesture and learn the correspondence between the gesture from there and the operation content.

  (7) Further, the information processing apparatus of the present invention further includes a movement determination unit that determines which path the movement indicates matches with the guidance when the recognized gesture target moves, The guidance display control unit is characterized in that, when the recognized movement of the gesture target matches any one of the routes indicated by the guidance, a message indicating the match is displayed on the display.

  In this way, when the recognized movement of the gesture target matches any of the routes instructed by the guidance, the fact of the match is displayed on the display. For example, when a gesture is actually performed, the gesture target trajectory is drawn to show a match with a predetermined operation, so that the input of the operation content can be completed while checking the reception status of the gesture on the device side. Can eliminate anxiety about input.

  (8) In the information processing device of the present invention, the guidance display control unit may indicate a mismatch when the recognized movement of the gesture target does not match any of the routes indicated by the guidance. It is characterized by being displayed on the display. Thereby, when an incorrect operation content is input, the actually recognized operation can be clarified, and the result can be fed back to the user. For example, a mismatch display that there is no operation content corresponding to a gesture can be displayed. Although the position of the hand for starting the gesture was correct, the user can understand that the operation contents have not been executed because the subsequent movement of the hand was bad, and learning for gesture input proceeds.

  (9) An information processing method according to the present invention is an information processing method performed using an information processing device operable by a gesture, the step of recognizing a gesture object photographed by a camera, and the recognized gesture. Determining whether the target is at a predetermined start position relative to the camera position, and when the recognized gesture target is at a predetermined start position relative to the camera position And a step of displaying on the display a guidance instructing a method of moving the recognized gesture object in correspondence with the operation content.

  By displaying the guidance in this way, the user can easily input an intended gesture, can learn a gesture corresponding to the operation content while using the device, and can lower the barrier for starting use.

  (10) An information processing program according to the present invention is an information processing program executed by an information processing device operable by a gesture, the process for recognizing a gesture object photographed by a camera, and the recognized gesture object Is determined at a predetermined start position with respect to the camera position, and when the recognized gesture target is at a predetermined start position with respect to the camera position, And a process for displaying a guidance for instructing a movement method of the recognized gesture target on a display in correspondence with the operation content.

  By displaying the guidance in this way, the user can easily input the intended gesture, can learn the gesture corresponding to the operation content while using the information processing device, and can reduce the barrier to starting use.

  According to the present invention, a user can easily input an intended gesture, can learn a gesture corresponding to an operation content while using an information processing device, and can reduce a barrier to start of use.

1 is a front view illustrating an information processing device according to a first embodiment. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus according to the first embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment. FIG. It is a figure which shows the table which matched the operation content, guidance, and gesture determination criteria of Embodiment 1. FIG. 3 is a flowchart illustrating an input operation of the information processing apparatus according to the first embodiment. 3 is a flowchart illustrating an input operation of the information processing apparatus according to the first embodiment. It is a figure which shows the example of a display of the capture marker and guidance of Embodiment 1. FIG. 3 is a flowchart showing a display operation of the information processing apparatus according to the first embodiment. 3 is a flowchart showing a display operation of the information processing apparatus according to the first embodiment. It is a figure which shows an example of the usage scene of the information processing apparatus which concerns on Embodiment 1. FIG. FIG. 6 is a front view showing an information processing device according to a second embodiment. It is a figure which shows the table which matched the operation content, guidance, and gesture determination criteria of Embodiment 2. It is a figure which shows an example of the usage scene of the information processing apparatus which concerns on Embodiment 2. FIG.

  Next, embodiments of the present invention will be described with reference to the drawings. In order to facilitate understanding of the description, the same reference numerals are given to the same components in the respective drawings, and duplicate descriptions are omitted.

[First Embodiment]
(Appearance of television receiver)
FIG. 1 is a front view showing a television receiver 100 (information processing device). In the following example, the television receiver 100 is described as an example of the information processing apparatus, but the information processing apparatus of the present invention is not necessarily limited thereto. The television receiver 100 includes a display 101 and a camera 102. The display 101 displays received video and visual information for the user by means of liquid crystal, plasma, cathode ray tube, organic EL, or the like. The camera 102 is composed of elements that can be converted into digital data, and photographs a user's gesture. What is necessary is just to comprise using common image sensors, such as CMOS and CCD. Further, the camera 102 may include a distance sensor, a depth sensor, and the like in order to increase recognition accuracy. The camera 102 is preferably arranged in a state facing the direction of the user. For example, the camera 102 is arranged in the same direction as the display surface of the display 101.

(Hardware configuration)
FIG. 2A is a block diagram illustrating a hardware configuration of the television receiver 100. As illustrated in FIG. 2A, the television receiver 100 includes a display 101, a camera 102, a television function processing unit 103, a camera IF 104, a calculation unit 105, a memory 106, a storage unit 107, a graphic processing unit 108, and a control unit 109. ing. The description will focus on the necessary elements, and a general functional description will be omitted. The TV function processing unit 103 performs a decoding of a moving image included in a tuner or reception data that receives a television broadcast, a sound, and the like, and writes the result in the memory 106.

  The camera IF 104 converts data photographed by the camera 102 into a data format that can be used by the arithmetic unit 105 and the like, and writes the data in the memory 106. The arithmetic unit 105 recognizes a gesture target (for example, a hand or an eye) from a video photographed by the camera 102, and performs processing for converting the gesture into a command. The memory 106 temporarily stores data when the calculation unit 105 performs processing. The storage unit 107 stores data that does not need to be rewritten as frequently as the memory 106. For example, a specification list (to be described later) of commands and corresponding gestures is stored.

  The graphic processing unit 108 performs data conversion processing for displaying the display data processed by the television function processing unit 103, the calculation unit 105, and the like and written in the memory 106 on the display 101. Also, a plurality of images are superimposed and mirrored. The control unit 109 controls the entire device.

(Functional configuration)
FIG. 2B is a block diagram showing a functional configuration of the television receiver 100. The camera IF 104, the arithmetic unit 105, the memory 106, the storage unit 107, the graphic processing unit 108, and the control unit 109 are functionally configured as a gesture target recognition unit 211, a shape determination unit 212, a mirror image processing unit 213, a gesture. This corresponds to the display control unit 214, the position determination unit 221, the movement determination unit 222, the operation execution unit 223, and the guidance display control unit 224. Each part will be described.

  The gesture target recognition unit 211 recognizes a gesture target from an image captured by a camera. A gesture target is an object that performs a gesture, and often includes a part of a body such as a hand or an eye, but is not limited thereto, and may also include a hand holding a pen. Note that gesture object recognition methods include, but are not limited to, contour extraction, background separation, and pattern matching. The shape determination unit 212 determines the shape of the gesture target. By determining the shape, it becomes easy to cut out the outer shape on the video. The shape determined by the shape determination unit 212 may be used as one element of gesture recognition. Specifically, the gesture target recognition unit 211 recognizes an extended hand and a closed hand as different gestures. In that case, even if it is the same position and route, the criterion is that the gesture is different when the hand shape is expanded and when it is closed.

  The mirroring processing unit 213 cuts out the outer shape of the gesture target video whose shape has been determined, and performs a mirroring process on the gesture target video. The gesture display control unit 214 causes the display 101 to display the gesture target subjected to the mirroring process. The position determination unit 221 determines whether or not the recognized gesture target is at a predetermined start position with respect to the camera position. It is similarly determined whether or not the recognized gesture target is at a predetermined end position.

  The movement determination unit 222 determines which route is the movement of the gesture target. When the recognized gesture target moves, it is determined which route the movement matches is instructed by the guidance. The operation execution unit 223 executes the validated operation content.

  The guidance display control unit 224 displays guidance that associates the contents of selectable operations with the movement direction of the gesture target. For example, the guidance display control unit 224 displays a capture marker indicating that the photographed gesture target has been recognized at a display position corresponding to a predetermined start position of the display 101. In addition, when the recognized gesture target is at a predetermined start position with respect to the position of the camera, guidance for instructing how to move the recognized gesture target is displayed on the display 101 in correspondence with the operation content. . An instruction that associates the movement direction of the gesture target with the operation content is displayed.

  The guidance display control unit 224 causes the display 101 to display a match when the recognized movement of the gesture target matches any of the routes indicated by the guidance. When the recognized movement of the gesture target does not match any of the routes instructed by the guidance, the guidance display control unit 224 causes the display 101 to display a mismatch.

(Gesture list)
FIG. 3 is a diagram illustrating a table in which commands (operation contents), guidance, and gesture determination criteria are associated with each other. The table shown in FIG. 3 represents the contents of each No. command. A table in which actions that the user needs to take in order to be recognized as a command and a gesture is referred to as a gesture list. Normally, table information is stored in the memory 106 or the storage unit 107.

  A command 301 is a command for actually controlling a device, and is interpreted by the control unit 109 to control each unit of the device. The guidance 302 is character information display that indicates a part of the guidance displayed on the display 101. The gesture target 303 is a specific gesture target such as a hand or an eye. In the example illustrated in FIG. 3, the gesture target 303 is a hand, and a gesture for inputting a command is performed by hand. In addition to the hand, in addition to fingers, eyes, feet, etc., the entire body can be a gesture target.

  The start position 304 indicates a range in which the gesture target is recognized before the gesture. The outer square shown at the start position 304 is the shooting range of the camera, and the inner square (with diagonal lines) is a position where the gesture target 303 can be recognized as being at the start position. For example, for the command No. 0001, the start of the gesture is recognized if the hand is reflected near the center within the shooting range of the camera.

  The path 305 is a path that the gesture target should take in order to be recognized as a gesture. Regarding the command No. 0001, the gesture is recognized by moving the gesture target downward from the center within the photographing range. The outer square shown at the end position 306 is the shooting range of the camera, and the inner square (with diagonal lines) indicates the position where the gesture object 303 can be recognized as being at the end position.

  Therefore, regarding the command No. 0001, when the gesture target is reflected in the lower center of the shooting range, it is recognized that the gesture has ended. When the user wants to transmit a stop command (No. 0001) to the television receiver 100, the user inserts his / her gesture target hand so that it appears in the vicinity of the center of the camera shooting range, and after the gesture recognition is started, Must be moved downward. This is represented by the start position 304, path 305, and end position 306 of No. 0001 shown in FIG.

(Input operation)
4A and 4B are flowcharts showing the input operation of the television receiver 100. FIG. 4A and 4B, internal processing from when a gesture is recognized until the user is prompted to learn how to use will be described.

  First, processing is started by turning on the television receiver 100 or starting application software. At this point, no gesture target has been found. Next, a gesture target is searched from the video captured by the camera (step S1), and it is determined whether or not the gesture target is recognized (step S2). If not recognized, the process returns to step S1 to search for a gesture target. If it is recognized, an instruction is given to display on the display 101 the gesture target image captured and stored by the camera 102 (step S3). Next, it is determined whether or not the gesture target exists at the start position of the gesture list (step S4). If the gesture target does not exist at the start position, the process returns to step S1. If it exists, it is determined that the gesture target has been captured, and the display of the capture marker and guidance is instructed (step S5). Capturing refers to a situation where the gesture object is continuously recognized.

  Next, it is determined whether or not the gesture target has moved (step S6). If it is not moving, wait until it moves. When the user has moved, it is determined that the user no longer needs the guidance, the guidance erasure is instructed, and the guidance is erased (step S7). Then, it is determined whether the gesture target is captured (step S8). If not captured, the process returns to step S1.

  On the other hand, when the gesture target is captured, it is determined whether or not the gesture target trajectory matches any of the gesture list paths 305 that can be taken based on the start position of the gesture target. If they do not match, it is displayed that the gesture is not in the list (step S10), and the process returns to step S1. If they match, an instruction is given to display the locus of movement of the gesture target. By displaying this trajectory, the user can understand that the content shown in the guidance matches the movement of his / her gesture.

  Next, it is determined whether or not the end position 306 is determined by the path 305 where the gesture target is taken (step S12). If it is determined that the end position 306 is not reached, the process returns to step S9. If it is determined that the position is the end position 306, the gesture is completed, a command corresponding to the gesture is issued, control corresponding to the command is performed, and the process is completed.

(Guidance display)
The capture marker and guidance will be described. FIG. 5 is a diagram showing a display example 500 of a captured marker and guidance. The capture marker 501 is a mark that tells the user that the gesture target is at the start position. By displaying the capture marker 501 as described above, the user can know the start position of the gesture, and can learn the correspondence between the gesture and the operation content. The guidance is displayed when the gesture object is recognized as being at the start position, and is a list of gestures that can be recognized and commands that can be issued from the start position. That is, this is a guide for teaching the user how to move the gesture target to recognize each command.

  In the example of guidance shown in FIG. 5, the movement direction of the gesture target is indicated by arrows 511 to 514, and the content of the command is indicated by character information 521 to 524. Therefore, in this display example, a command for issuing a menu is issued if the gesture target is moved upward, stopped if it is moved downward, fast-forwarding if it is moved right, and fast-returning if it is moved left. Thereby, the user can easily know the moving direction of the gesture target for realizing the desired operation. The correspondence between these gestures and commands is determined by the gesture list shown in FIG. Note that the guidance is not limited to the above example, and any shape or method may be used as long as the purpose of transmitting the start position to the user is achieved.

(Display operation)
6A and 6B are flowcharts showing the display operation of the television receiver 100. FIG. Processing related to display will be described with reference to FIG. The display processing is mainly performed by the graphic processing unit 108 in response to the internal processing described with reference to FIGS. 4A and 4B.

  First, it starts when the television receiver 100 is turned on. An image by the basic function of the television receiver 100 is displayed on the display 101. For example, broadcasting (including broadcasting by radio waves, IP, on-demand, etc.) and recorded video are displayed (step T1). Next, it is determined whether or not there is an instruction to display a gesture target (step T2). If there is no display instruction, the process returns to step T1. If there is a display instruction, a gesture target photographed and recognized by the camera is displayed on the display 101.

  At this time, since it is important for the user to display as if looking at the mirror so as not to make the user feel uncomfortable, the left and right coordinates of the photographed gesture target image are reversed and mirrored, It is displayed superimposed on the basic function image (step T3). By making a mirror image, the gesture target is displayed on the display 101 so as to be reflected in the mirror. For example, if the user raises his right hand, the hand reflected on the right side of the screen will rise.

  Next, it is determined whether there is an instruction to display a capture marker and guidance (step T4). If there is no display instruction, the process returns to step T2. If there is a display instruction, the captured marker and the guidance are displayed superimposed on the video and gesture target display already displayed (step T5). Then, it is determined whether there is an instruction to delete the guidance (step T6). If there is no erasure instruction, the process proceeds to step T8. If there is a deletion instruction, the guidance is deleted (step T7).

  Next, it is determined whether a trajectory display instruction or a disagreement display instruction has been issued (step T8). If a disagreement display instruction is received, a disagreement display is displayed (step T9), and the process proceeds to step T11. move on. If there is an instruction to display a trajectory, the trajectory when the gesture target moves is displayed (step T10). As the display of the trajectory, for example, a trace of movement of the gesture target is drawn with a line or the like. At the same time, the guidance display is deleted. Then, it is determined whether or not there is a command input (step T11). This determination is a determination as to whether or not the gesture has been completed. If no command is input, the process returns to step T10 to display the locus. If there is a command input, the gesture is completed, it is determined that the command has been input, the captured marker and the locus are erased (step T12), and the process is completed.

(Use scene)
Next, a series of usage scenes when the user uses the television receiver 100 will be described. FIG. 7 is a diagram illustrating an example of a usage scene of the television receiver 100.

  In the usage scene P1, the user U1 is watching the television receiver 100. At this time, the screen of the television receiver 100 displays an image 711 such as broadcast or video as an image based on the basic function. Next, in the usage scene P2, when the user U1 spreads his hand forward and holds it over the television receiver 100, the user U1's hand image taken by the camera 102, the gesture target capture marker 712, the arrow 713, and the character information A guidance composed of 714 is superimposed on the video 711 and displayed.

  Thereafter, in the usage scene P3, the user U1 raises his / her hand displayed on the television receiver 100 with his hands spread out so as to overlap the character information 713 of the guidance “MENU”, and the character “MENU” is displayed. Hands are put on the information 713. On the display of the television receiver 100, a trace 715 of a hand movement is displayed, and guidance other than the character information 713 of “MENU” disappears. If it is held for a certain time (for example, a design value of 1 second), a menu screen is displayed on the display of the television receiver 100 as intended by the user U1 as shown in the usage scene P4.

  By operating in this way, the user U1 can know the start position of the gesture while using the television receiver 100, and can learn how the gesture leads to the intended command. Then, since the trajectory is drawn if the gesture is actually performed, the command input can be completed while confirming the reception status on the device side. As a result, the user U1 can eliminate anxiety about the gesture input.

[Second Embodiment]
In the above embodiment, the information processing device that can be operated by the gesture is the television receiver 100, but may be an electronic book terminal. Hereinafter, the difference from the first embodiment will be mainly described.

(Appearance of e-book reader)
FIG. 8 is a front view showing the electronic book terminal 600. The display 601 displays an image by display means such as liquid crystal or organic EL. In the example of FIG. 8, an electronic book is displayed. The camera 602 is arranged in the direction in which the user is photographed (the direction facing the user) and is in the same direction as the display. The camera 602 captures the user and the user's gesture.

(Gesture list)
FIG. 9 is a diagram illustrating a table in which operation contents, guidance, and gesture determination criteria are associated with each other. The gesture list will be described with reference to FIG. In the above embodiment, the television receiver 100 is used by a user relatively far away. On the other hand, since the electronic book terminal 600 is used by the user and gives operability close to that of an actual book, the content of the gesture list is significantly different from that of the first embodiment. Specifically, the gesture list command type is for electronic books. Further, since the gesture target hand is close to the camera, the area indicating the gesture target at the start position / end position becomes large.

(Use scene)
FIG. 10 is a diagram illustrating an example of a usage scene of the electronic book terminal 600. In the usage scene Q1, the user U2 performs a gesture of turning the page of the electronic book according to the gesture list. In the electronic book terminal 600, the user U2 takes a hand that has been extended to the lower left of the screen with the camera and processes the image, and the image of the hand is displayed on the display 601. Since the hand that is the gesture target is at the start position, guidance by the capture marker 712, the arrow 713, and the character information 714 is displayed.

  When the user U2 moves the hand in the right direction according to the guidance in the usage scene Q2, the locus 715 of the hand moved from the start position is displayed on the display 601. Further, when the user U2 moves his hand in the right direction in the usage scene Q3, the gesture target hand reaches the end position described in the gesture list, and a page feed command is executed.

  If the user U2 makes a gesture of a route that does not follow the guidance and is not in the gesture list in the usage scene Q1, no trace is displayed on the display 601 between the capture marker 712 and the hand image. Further, a non-matching display 811 is displayed to notify the user that there is no command corresponding to the gesture made by the user U2. As a result, the user U2 can understand that the position of the hand at the start of the gesture is appropriate, and that the command has not been executed because of the improper movement of the hand thereafter, and learning for gesture input is possible. Advances.

100 Television receiver (information processing equipment)
DESCRIPTION OF SYMBOLS 101 Display 102 Camera 103 Television function processing part 105 Operation part 106 Memory 107 Storage part 108 Graphic processing part 109 Control part 211 Gesture object recognition part 212 Shape determination part 213 Mirror image processing part 214 Gesture display control part 221 Position determination part 222 Movement determination Unit 223 operation execution unit 224 guidance display control unit 301 command 302 guidance 303 gesture target 304 start position 305 path 306 end position 500 display example 501 capture marker 511-514 arrow 521-524 character information 600 electronic book terminal 601 display 602 camera 711 video 712 Capture marker 713 Arrow 714 Character information 715 Trajectory 811 Mismatch display P1-P4, Q1-Q3 Usage scene

Claims (10)

An information processing device that can be operated by a gesture,
A gesture object recognition unit for recognizing a gesture object photographed by a camera;
A position determination unit that determines whether or not the recognized gesture target is at a predetermined start position with respect to the position of the camera;
When the recognized gesture target is at a predetermined start position with respect to the position of the camera, guidance indicating the movement method of the recognized gesture target is displayed on the display in correspondence with the operation content. An information processing device comprising: a guidance display control unit.   The said guidance display control part displays that the gesture object is recognized on the said display, when the said gesture object recognition part recognizes the gesture object image | photographed with the said camera. Information processing equipment.   The guidance display control unit is photographed by the camera when the gesture object recognition unit recognizes that the gesture object photographed by the camera is at a predetermined start position with respect to the position of the camera. The information processing apparatus according to claim 1, wherein the display object displays that the gesture target is at the start position.   The information processing device according to any one of claims 1 to 3, wherein the guidance display control unit displays, as the guidance, an instruction that associates a movement direction of the gesture target with an operation content. . A mirroring processing unit that mirrors the recognized gesture target video;
The information processing apparatus according to claim 1, further comprising: a gesture display control unit configured to display the mirrored gesture target on the display.   The said guidance display control part displays the capture marker which shows that the said image | photographed gesture object was recognized at the display position corresponding to the said predetermined start position of the said display. The information processing apparatus according to claim 5. A movement determination unit for determining, when the recognized gesture target moves, which path the movement indicates matches with the guidance;
2. The guidance display control unit, when the recognized movement of the gesture target matches any of the routes indicated by the guidance, displays a match on the display. The information processing apparatus according to claim 6.   8. The guidance display control unit, when the recognized movement of the gesture target does not match any of the routes indicated by the guidance, displays a message indicating a mismatch on the display. The information processing equipment described. An information processing method performed using an information processing device operable by a gesture,
Recognizing a gesture object photographed by a camera;
Determining whether the recognized gesture object is at a predetermined starting position relative to the position of the camera;
When the recognized gesture target is at a predetermined start position with respect to the position of the camera, guidance indicating the movement method of the recognized gesture target is displayed on the display in correspondence with the operation content. And an information processing method comprising: steps. An information processing program to be executed by an information processing device operable by a gesture,
A process of recognizing a gesture object photographed by a camera;
A process of determining whether the recognized gesture target is at a predetermined start position with respect to the position of the camera;
When the recognized gesture target is at a predetermined start position with respect to the position of the camera, guidance indicating the movement method of the recognized gesture target is displayed on the display in correspondence with the operation content. And an information processing program.

Images