WO2006098299A1

WO2006098299A1 - Information processing system and information input device for the same

Info

Publication number: WO2006098299A1
Application number: PCT/JP2006/304959
Authority: WO
Inventors: Hiromu Ueshima; Hitoshi Obori
Original assignee: Ssd Company Limited
Priority date: 2005-03-14
Filing date: 2006-03-14
Publication date: 2006-09-21
Also published as: JPWO2006098299A1

Abstract

A controller (40) not posing a positional limitation on a user and capable of inputting information for information processing proceed control without using a hand is attached to a bottom of a sandal-type controller body mounted on a part of user’s body (such as a foot). The controller (40) includes a step sensor (72) for detecting a motion of the user’s body and an LED (60) for radio-transmitting a predetermined code by infrared rays in response to detection of a motion of the user’s body by the step sensor (72). By setting the controller to the learning mode by a 3-point switch (74), it can be set to transmit a code corresponding to an information processing device or a device such as DVD player of various manufacturers.

Description

Specification

Information processing system and information input device therefor

Technical field

The present invention relates to an information processing system that presents information such as images and sounds to a user by performing information processing in response to the movement of the user's body, and information input for such an information processing system With regard to the device, in particular, by changing the screen display, generated sound, etc. in response to the movement of the user's body, it is possible to simulate walking, traveling, sports, exercise, etc. or entertain the user The present invention relates to an information processing system and an information input device suitable for use in the system. Background art

There are various types of electronic information processing apparatuses used at home. Among them, the most popular is the ROM (read only memory) or DVD (Digital Versatile Disc) that stores the program, which can be installed in a home television receiver (hereinafter simply referred to as “TV”). Or the like, or a sound is output. A typical example is an electronic game device.

[0003] A controller for performing an operation on a game is attached to a conventional electronic game device. There are various types of controllers as well. For example, a game controller disclosed in Patent Document 1 described later has a case that can be held firmly with both hands, and the operator holds this case. It is common that buttons for giving various instructions to the Google program are arranged at the part where the finger of the hand is located.

[0004] Besides this, there are various types such as a bat-type controller for performing a baseball simulated experience, a ball-type controller for performing a simulated bowling experience, and a fishing rod-type controller for performing a simulated fishing experience. There is a deformation. In particular, a simulated experience device (program) that uses a bat-type controller, etc., moves the body and moves the simulated experience according to the movement. Unlike conventional electronic games, This is a simulated experience and gives an impression different from an electronic game device. [0005] A typical example of a device that performs information processing that should be referred to as such a sensation-type simulation is a dance game device disclosed in Patent Document 2 listed below. This dance game apparatus includes two sheet-like controllers each installed on the floor. Two players get on each of these two controllers and step on them, so the footswitch placed in the seat detects the two steps, changes the image accordingly, and plays music. A dance game with two players is advanced while changing.

Patent Document 1: JP 2004-313492 A, FIG.

Patent Document 2: Japanese Patent Laid-Open No. 2003-038696, FIG.

Disclosure of the invention

Problems to be solved by the invention

[0006] When the controller for the dance game device disclosed in Patent Document 2 is used, information relating to the movement of the player is obtained only by the movement of the foot without using a hand, and the information is processed to obtain the dance game. Can be advanced. This is impossible with the game controller disclosed in Patent Document 1. In addition, because it is in the form of a sheet, it is easy to store and suitable for use in a home simulation experience device.

[0007] In the sheet-like controller disclosed in Patent Document 2, there is a problem that the movement of the user is restricted by the position of the controller. In particular, in a bodily sensation-type system such as a dance game, it is desirable to eliminate restrictions by the controller as much as possible.

[0008] Such a problem is not a problem peculiar to an electronic game device and a dance game device. This is a problem common to all information processing systems that process information obtained from the user's body movements and present various information according to the processing results. For example, in a device that changes the simulation environment according to the movement of the user's body, or changes information such as images and sounds that are presented to the user, physical restraint by an information input device such as a controller is as light as possible. Les are preferred.

[0009] Therefore, an object of the present invention is to provide an information input capable of inputting information related to body movements to an information processing system without being subjected to positional restrictions by an information input device as much as possible and without using a hand. Processing information provided from the device and the information input device, It is to provide an information processing system that performs appropriate processing in response to the movement of the user's body.

Means for solving the problem

[0010] An information input device according to a first aspect of the present invention is used by being attached to a part of a user's body, and a detection unit for detecting a predetermined movement of the user's body, and a detection unit And wireless transmission means for wirelessly transmitting a predetermined signal in response to the detection of the predetermined movement of the user's body.

[0011] The user wears this information input device on a part of the body and performs some operation. The detection means detects a predetermined movement of the user's body, and in response to this, a predetermined signal is wirelessly transmitted by the wireless transmission means. Since there is no need to hold the information input device in the hand, the user can move without being aware of the information input device. When a predetermined movement of the user's body is detected, a predetermined signal is transmitted wirelessly. For example, when this signal is received by any information processing apparatus, the information processing apparatus is set to execute the predetermined information processing. Programming. The information input device is attached to the body and moves with the body. As a result, it is possible to control the progress of information processing while the user moves freely without being subject to positional restrictions.

[0012] Preferably, the detection means includes a mounting part that the user can wear on a part of the body, and a means that is provided in the mounting part and detects the walking motion of the user.

[0013] The information input device detects a user's walking motion and transmits a predetermined signal. Control the progress of information processing without imposing restrictions on the user's movements when, for example, the information processing is advanced by walking or the control of the information processing is changed by a foot movement such as dancing. It becomes possible.

[0014] More preferably, the mounting portion has a shape of footwear that can be worn by a user.

[0015] More preferably, the means for detecting includes a switch that is provided on the bottom surface of the footwear of the mounting portion and that outputs a detection signal in contact with the floor surface.

[0016] Since the mounting portion has the shape of footwear, it is possible to control the progress of information processing by wearing this information input device in the same way as normal footwear.

[0017] The means for detecting may include an acceleration sensor attached to the mounting portion. [0018] By using the acceleration sensor, it is possible to surely detect a predetermined movement of the user's body, particularly a movement accompanied by an impact.

[0019] Preferably, the information input device includes a code storage unit for storing a plurality of predetermined codes, and a plurality of codes stored in the code storage unit in response to a user instruction. And a selection code storage means for storing a code selected by a user's instruction from the inside, and the wireless transmission means transmits the code stored in the selection code storage means.

[0020] A plurality of codes are stored in advance in the code storage means, and one of them is selected and stored in the selected code storage means. In transmitting information to the information processing apparatus, the selected code is transmitted. For example, when the codes that can be used differ depending on the transmission destination, such as devices manufactured by different manufacturers, the code can be selected according to the transmission destination. As a result, the versatility of the information input device is enhanced.

[0021] More preferably, the wireless transmission means includes infrared communication means for transmitting the code by infrared rays.

[0022] Since the code is transmitted using infrared rays, the code can be transmitted relatively stably even if the orientation of the user changes.

[0023] More preferably, the infrared communication means includes a plurality of LEDs each for generating infrared rays for transmitting a code, and the plurality of LEDs are arranged to emit infrared rays in directions different from each other. It has been done.

[0024] Since the plurality of LEDs emit infrared rays in different directions, the code can be transmitted stably even if the user's direction changes greatly.

[0025] An information processing system according to a second aspect of the present invention is used by being attached to a part of a user's body and detecting a predetermined movement of the user's body; In response to detection of a predetermined movement of the user's body by the detection means, an information input device including a wireless transmission means for wirelessly transmitting a predetermined signal, and a wireless transmission means And an information processing apparatus that performs predetermined information processing in response to the incoming signal.

[0026] A user operates by wearing an information input device on a part of the body. The detection means detects a predetermined movement of the user's body, and in response, a predetermined signal is wirelessly transmitted by the wireless transmission means. Sent. The information processing apparatus executes information processing in response to this signal.

[0027] Since there is no need to hold the information input device in the hand, the user can move without being aware of the information input device. When a predetermined movement of the user's body is detected, a predetermined signal is transmitted wirelessly, and the information processing apparatus operates in response thereto. The information input device is attached to the body and moves with the body. As a result, it is possible to control the progress of information processing in the information processing apparatus while moving freely without the user being subject to positional restrictions.

[0028] Preferably, the wireless transmission means includes means for modulating and transmitting a predetermined signal wirelessly in response to detection of a predetermined movement of the user's body by the detection means. The processing means includes an information processing apparatus that receives and decodes a signal transmitted from the means for wireless transmission and performs predetermined information processing according to the decoded predetermined signal.

[0029] The means for wireless transmission modulates and transmits a predetermined signal according to the motion detected by the detection means. When the information processing apparatus receives this signal, it decodes it and executes information processing according to the predetermined decoded signal. As a result, various kinds of information can be transmitted to the information processing device depending on the movement, and various controls for information processing become possible.

[0030] Preferably, the information processing apparatus receives a signal transmitted from a reproduction unit for reproducing information recorded on a predetermined medium and a unit for wireless transmission, and receives the received signal. And a playback control means for controlling playback processing by the playback means.

[0031] More preferably, the recorded information is a recorded video, and the playback means includes a recording / playback device for playing back the recorded video recorded on a predetermined medium. The recorded video may be a live-action video of the landscape.

[0032] The recorded information may be an image created by computer graphics. The image created by the computer graphics may include a landscape image.

[0033] More preferably, the information processing apparatus performs video generation processing by the video generation unit based on a video generation unit for generating and outputting a video by computer graphics and a signal transmitted from the wireless transmission unit. Video generation control means for performing control.

[0034] The video generation control means may include means for controlling the video generation means so that the video generation means causes a predetermined event to occur on the video in response to the signal. Predetermined thing The elephant may be a visual representation of an event that is independent of the user's predetermined movements.

[0035] A remote controller according to the third aspect of the present invention is a remote controller capable of remotely controlling a plurality of types of devices, and transmits a code wirelessly with an operation unit operated by a user. Wireless transmission means capable of storing, a code set storage means for storing a plurality of code sets each consisting of a predefined code for remote control of a specific device, and a user operation on the operation unit In response to the remote controller unit that refers to a preset code set stored in the code set storage means and transmits a code corresponding to the operation using the wireless transmission means, and a user Means for outputting a predetermined trigger signal in response to a predetermined operation, and stored in the code set storage means in response to the trigger signal. In addition, a single code determined according to a predetermined standard is selected from each of the plurality of code sets, and the time-sequential transmission is performed using wireless transmission means until a predetermined termination condition is satisfied. And means for setting the remote controller so that the remote controller refers to the code set to which the code transmitted by the wireless transmitter immediately before the end condition is generated.

Brief Description of Drawings

FIG. 1 is a diagram showing a schematic configuration of a moving simulated experience system 30 according to a first embodiment of the present invention.

FIG. 2 is an external perspective view of a controller 40 according to the first embodiment.

FIG. 3 is a bottom view of the controller 40. FIG.

FIG. 4 is a block diagram of a control circuit 76 and peripheral circuits of the controller 40.

FIG. 5 is a flowchart showing a control structure of a program during learning executed by MCU 90 of controller 40.

FIG. 6 is a flowchart showing a control structure of a program when executing a pseudo-experience executed by MCU 90 of controller 40.

FIG. 7 is a diagram showing a monitor display example in a simulated experience using the controller 40 according to the first embodiment.

FIG. 8 is a diagram showing a monitor display example in a simulated experience using the controller 40 according to the first embodiment. FIG. 9 is a bottom view of a controller 52 according to a second embodiment.

FIG. 10 is a block diagram of a control circuit 76 and peripheral circuits of a controller 52 according to a second embodiment.

FIG. 11 is a diagram showing a player wearing a pedometer controller 182 according to a third embodiment.

FIG. 12 is an external perspective view of a pedometer-type controller 182 according to a third embodiment.

FIG. 13 is a block diagram of a pedometer controller 182 according to a third embodiment.

FIG. 14 is a diagram showing a schematic configuration of an exercise support system 240 according to a fourth embodiment.

FIG. 15 is a block diagram showing a schematic configuration of an adapter 250 and a cartridge 252 used in the fourth embodiment.

FIG. 16 is a block diagram of a pedometer controller 300 used in the fourth embodiment.

FIG. 17 is a flowchart of a program executed by the multimedia processor 280 in the fourth embodiment.

FIG. 18 is a diagram showing an example of a computer graphics screen displayed on the television monitor 254 in the fourth embodiment.

Explanation of symbols

[0037] 30 mobile simulation experience system, 40, 52 controller, 42 DVD player, 46, 254 TV monitor, 48, 180 player, 50 infrared, 60, 62, 198 LED, 70 sonore, 72 step sensor, 74, 200 3 Point switch, 76 control circuit, 90, 210 MCU, 92 code table memory, 94 memory, 96 LED drive circuit, 182, 300 pedometer controller, 192 LCD, 194 display switching button, 196 reset button, 212 acceleration sensor Sensor, 240 exercise support system, 250 adapter, 252 cartridge, 270 IR receiver BEST MODE FOR CARRYING OUT THE INVENTION

In the following embodiment, a DVD player is taken as an example of the information processing apparatus, and the DVD player is operated by an information input device including a remote controller that detects the movement of the user's body. The DVD player used here may be a commonly used one.

[0039] In a DVD player, for example, video may be recorded in advance according to a predetermined scenario. Thus, the video can be advanced or returned in accordance with the signal from the controller. A live-action video of a busy street or mountain road is recorded as a video. When a user wearing the remote controller actually walks, the remote controller detects the movement, and gives a signal to the DVD player indicating that the video should be advanced when walking, for example. In response to the signal, the DVD player changes the video to a scene one step ahead. Therefore, you can simulate the experience of walking on that road. The video may be created and recorded in advance by computer graphics instead of a real image.

[0040] The information processing apparatus is not limited to the DVD player, but can be variously considered. A typical one is an information processing apparatus that is equipped with a computer, executes information processing for signals from the outside, and executes a predetermined program that outputs various kinds of information to a user. By controlling the progress of the program executed by such an information processing device in accordance with a signal from the controller, the information processing can proceed according to a predetermined movement of the user's body, and the output information can be manipulated. it can.

[0041] <First embodiment>

[Summary]

The first embodiment relates to a sandal-type remote controller for inputting information related to playback control to a DVD player as an example of an information processing apparatus. The controller is not limited to sandals, and may be a shoe type or a type attached to shoes. Controllers can be worn by humans just like regular sandals. In short, it is only necessary that the controller can be mounted on a human leg. An LED (Light Emitting Diode) is embedded in the toe part of the controller. For example, the LED can send a code indicating a command to a DVD player. In the first embodiment, only one LED is embedded. In the present embodiment, only one type of command can be sent from the LED to the DVD player, thereby simplifying the configuration of the controller.

[0042] According to this controller, even if the player does not hold the controller in his / her hand, the movement of the player (especially the stepping on the foot) can be detected, and the player can freely move around. There are also few restrictions on the player's position. [0043] [Configuration]

FIG. 1 shows a schematic configuration of a moving simulation experience system 30 using a DVD player according to the present embodiment. Referring to FIG. 1, this mobile simulation experience system 30 includes a TV monitor 46, a DVD player 42 connected to the TV monitor 46, and a sandal type capable of transmitting commands to the DVD player 42 by infrared rays 50. A pair of controllers 40. The player 48 puts on the controller 40 to experience a simulated movement by walking.

The simulated movement experience assumed in the present embodiment uses the video recorded on the DVD attached to the DVD player 42, detects the step of the player 48, and the controller 40 detects the step of the DVD player 42. The video to be displayed next is selected according to the code to be transmitted. In this way, the video progression is switched in various ways by switching the video according to the steps of the player 48.

FIG. 2 shows the appearance of one controller 40, and FIG. 3 shows the bottom surface of the controller 40.

Referring to FIGS. 2 and 3, an LED 60 is embedded in the front surface of the controller 40. In addition, on the bottom surface of the sole 70 of the controller 40, a step sensor 72 that outputs a detection signal when the player 48 touches the floor surface by stepping on the foot (hereinafter referred to as “step”), and a three-point switch 74. And are provided. Further, inside the sole 70, an LED 60, a step sensor 72, and a three-point switch 74 are connected. In response to a detection signal from the step sensor 72, infrared light is modulated with a predetermined code and transmitted. A control circuit 76 for controlling the lighting of the LED 60 is embedded.

[0046] The three-point switch 74 is used to turn on / off the power of the control circuit 76 and a learning mode to be set when learning a code to be transmitted according to the manufacturer of the DVD player 42, as will be described later. Switchable at 3 points.

FIG. 4 shows a block diagram of the control circuit 76. Referring to Figure 4, the control circuit

76 is connected to the step sensor 72 and the three-point switch 74, and executes a predetermined program stored in the built-in ROM (read-only memory) to control the LED 60. MCU, 90), a memory 94 consisting of a non-volatile memory that can be read and written by the MCU 90, and remote controllers (hereinafter referred to as “MCU”) for DVD players from various manufacturers. "Remote controller " Code table memory 92 consisting of a non-volatile memory for storing the control code table, and an LED drive circuit 96 connected to the MCU 90 for driving the LED 60 according to a signal given from the MCU 90. Including.

[0048] The MCU 90 has a normal structure and executes a program stored in an internal ROM. The control structure of this program will be described later with reference to FIG.

[0049] Although not shown in FIG. 4, the three-point switch 74 is connected to a power supply circuit including a dry cell, and when the contact is turned on, the power supply to the control circuit 76 is started and a reset signal is supplied. To initialize MCU90. When the contact is turned off, the power supply to the control circuit 76 is stopped. When the contact is switched to “learn”, the three-point switch 74 gives a predetermined signal to the MCU 90. In response to this signal, the MCU 90 starts executing the program for learning.

FIG. 5 shows a control structure of a program for learning by MCU 90. This program is activated when the contact point of the 3-point switch 74 is switched to “learn”, and uses which of the code table for remote control of each manufacturer's DVD player stored in the code table memory 92. It has a function to decide.

Referring to FIG. 5, in the learning program, a predetermined flag is set to 0 in step 110. This flag is used to determine whether or not this program has just started, and is set here to 0 immediately after starting. After the start, this flag is set to 1 if the signal from the step sensor 72 is read even once.

[0052] In step 112, a subscript variable i designating a code table is initialized to zero. Assuming that there are M code tables stored in the code table memory 92, the value of the variable i is one of 1 to M.

[0053] In step 114, it is determined whether or not the condition that either the force at which the step sensor 72 is on or the flag is 0 is satisfied. That is, the step sensor 72 is turned on when being pressed, and gives a predetermined first level signal to the MCU 90. Further, the step sensor 72 is turned off when not pressed, and gives the MCU 90 a second level signal different from the first level. The MCU 90 reads the signal level of the port to which the signal from the step sensor 72 is given, and determines whether or not the step sensor 72 is turned on. wear.

If it is determined that the step sensor 72 is ON or the flag is 0, control proceeds to step 116. Otherwise (ie if step sensor 72 is off and flag is 1), control proceeds to step 128. The processing in step 128 will be described later.

The processing after step 116 is the processing for learning described above. In step 116, 1 is assigned to the flag. In step 118, the value S1 of the variable i is added. In step 120, it is determined whether or not the value of the variable i is greater than the number M in the code table 92. When the variable i is larger than M, the routine proceeds from step 122 to step 124. Otherwise, control proceeds directly to step 124.

In step 122, 1 is substituted for the value of variable i, and the process proceeds to step 124.

In step 124, the code of the remote control signal for turning off the power of the DVD player is read from the i-th code table indicated by the variable i, and the LED 60 blinks in accordance with the code. In step 126, the process is stopped for a predetermined time. After this, control returns to step 114.

[0058] This code is transmitted to the DVD player by blinking the LED according to the code read from the i-th code table. DVD players will receive this code, but if it is a code from their own remote control, they will turn off their own power, otherwise they will not respond. If the DVD player is automatically turned off during the process shown in Fig. 5, the value of variable i at this time points to the code table of the DVD player manufacturer. become. Therefore, the user finishes learning when the DVD player is turned off during this process. In order to ensure that the user can confirm whether or not the power of the DVD player has been turned off, the time from transmission of one code to transmission of the next code needs to be somewhat long.

[0059] More specifically, the user releases the step sensor 72 when the power of the DVD player is turned off. As a result, the sensor output is turned off in step 114 shown in FIG. 5, and the determination result is NO. Control proceeds to step 128. In step 128, the value of the variable i at that time is written in the memory 94, and the process ends. By reading the value written in the memory 94, it is possible to know the ability to correctly control the DVD player used by the user by reading the code of the table in the code table memory 92. .

[0061] After step 128, the program ends execution.

[0062] If the process shown in Fig. 5 is performed, the controller 40 is set correctly for the user's environment, and there is no need to perform learning again unless the DVD player is changed to that of another manufacturer.

FIG. 6 shows a flowchart of a program that realizes the normal operation of the control circuit 76. Execution of this program is started when the contact of the three-point switch 74 shown in FIG. 4 is switched on.

Referring to FIG. 6, in step 140, it is determined whether or not step sensor 72 is on. When the step sensor 72 is on, the routine proceeds to step 142. Otherwise, return to step 140.

In step 142, a predetermined code is read from the code table indicated by the variable i stored in the memory 94 in step 128 shown in FIG. In the present embodiment, the code read out here corresponds to an instruction “play / frame advance from playback / pause” to the DVD player 42. After this step, control returns to step 140.

In the present embodiment, this process is performed for both the left and right controllers 40.

In this embodiment, a remote control signal code for turning off the power of the DVD player is transmitted during learning. However, the present invention is not limited to such an embodiment. Assuming that the DVD player is turned off, a code for turning on the DVD player may be sent, or on the assumption that the DVD player is already turned on. Send the forward / reverse code a predetermined number of times.

[0068] [Operation] The controller 40 whose configuration has been described above operates as follows. Controller 40 has two modes of operation. The first mode is the learning mode, and the second mode is the execution mode. This will be described in order below. In the following description, it is assumed that there are ten code tables stored in the code table memory 92 in advance. That is, the maximum value of variable i is M = l 0.

[0069] One learning one

In response to the player 48 (see FIG. 1) switching the contact point of the three-point switch 74 shown in FIG. 3 to “learn”, the MCU 90 shown in FIG. Start execution. The user keeps pressing the step sensor 72 arranged on the back surface of the controller 40.

Referring to FIG. 5, 0 is substituted for the flag at step 110, and 0 is substituted for variable i at step 112. In step 114, it is determined whether or not the force at which the step sensor 72 is turned on or the flag is zero. Since flag = 0 at the beginning of the loop, control proceeds to step 116.

[0071] In step 116, 1 is assigned to the flag. In step 118, 1 is added to variable i. As a result, the value of variable i is 1. In step 120, it is determined whether or not the value of variable i is greater than M (= 10). Since the value of variable i is 1, the determination result here is NO, and control proceeds to step 124. In step 124, the power-off code is read from the code table indicated by the variable i and provided to the LED drive circuit 96. The LED drive circuit 96 causes the LED 60 to blink in response to the power-off code, transmits this code to the DVD player 42 via the infrared ray 50, waits for a predetermined time in step 126, and then returns to step 114.

[0072] If the DVD player 42 generated in the process of step 124 is the product of the first manufacturer, the DVD player 42 receiving this code will automatically turn off the power. If the DVD player 42 is turned off, the player 48 knows that the controller 40 has been set correctly. Therefore, the player 48 releases the step sensor 72. In this case, the determination result in step 114 in FIG. Control proceeds to step 128, where 1 is stored as the value of variable i in memory 94 shown in FIG. 4, and the learning process ends.

On the other hand, if the power of the DVD player 42 is not turned off, the player 48 keeps pressing the step sensor 72. Therefore, the determination result in step 114 in FIG. Proceed to step 116.

Thereafter, the above-described processing is repeated, and when the value of variable i matches the code table number of the manufacturer of DVD player 42, the determination result at step 114 is NO, and the processing proceeds to step 128. In step 128, the value of this variable i is stored in the memory 94, and the process is terminated.

The above is the operation of the control circuit 76 in the learning mode.

[0076] Execution of a simulated experience

When the player 48 sets the three-point switch 74 shown in FIG. 3 to “◯ N”, the program for executing the simulated experience, which shows the control structure in FIG. 6, is started. This process is very simple. In step 140, it is determined whether or not the step sensor 72 is on. If it is on, it corresponds to the value of the variable i in the code table stored in the code table memory 92 in step 142. Reads a predetermined code (corresponding to “Play / Pause frame from pause”) from the source code and outputs it via LED60. If it is off, the process returns to step 140.

That is, when the player 48 steps, the step sensor 72 of the controller 40 is turned on, and the “playback / pause state” is the same as when the normal remote control force is generated for the DVD player 42 such as the LED 60 force. The signal “frame advance” is given. The DVD player 42 switches the video in response to this signal. Of course, it is assumed that the DV D attached to the DVD player 42 has contents prepared in advance in such a manner that the video along the scenario is switched and displayed by such switching of the video.

In the present embodiment, the remote control signal output from controller 40 is the same regardless of whether controller 40 is for the right foot or the left foot. Therefore, when the player 48 takes a step with the controller 40, the DVD player 42 reproduces the image at the position where a predetermined number of frames have been forwarded in order and gives the image to the TV monitor 46. On the TV monitor 46, an image as if the player 48 walks along a certain path is displayed.

For example, as shown in FIG. 7, it is assumed that the torii and the building behind it are displayed on the TV monitor 46 at a certain point in time. As the player 48 takes the steps, the virtual player 48 moves forward, and as a result, the torii disappears almost from view and only the building in the back is displayed as shown in Figure 8. Can proceed. In this example, Also, it is possible to record and reproduce on DVD a video created by computer graphics that changes the landscape according to the step of the player's step.

[0080] According to the controller 40 of the first embodiment, unlike the case of Patent Document 2, the position where the player 48 takes a step becomes much free. This is because the controller 40 moves with the player 48. The player 48 can move to any position as long as the infrared ray 50 from the controller 40 can reach the remote control signal receiver of the DVD player 42. In general, the infrared rays from the controller 40 can be reflected on the wall of the room and reach the DVD player 42, so that even if the player 48 is not completely facing the DVD player 42, it is simulated. There is little impact on the progress of the experience.

The above is the operation of the controller 40 in the execution mode.

In this embodiment, infrared communication is used. However, in general, such a simulated experience is executed in a small place such as a room, so the configuration is almost the same as in this embodiment.

The communication part can also be performed using weak radio waves instead of infrared rays.

[0083] In the above embodiment, the left and right controllers 40 output the same code. However, the present invention is not limited to such an embodiment. For example, separate codes may be output from the left and right controllers. In this case, the operation of the DVD player 42 differs depending on how each code is determined in advance.

In the embodiment described above, the step sensor 72 detects the step of the player 48 and records it. However, the present invention is not limited to such an embodiment. For example, an acceleration sensor may be included in the controller 40 to detect a step impact.

[0085] <Second Embodiment>

[Summary]

In the first embodiment, one controller 40 has only one LED. However, the present invention is not limited to such an embodiment. For example, two or more LEDs may be provided for each controller. As a result, for example, even if a high directivity LED is used or an LED with a small output is used, the player 48 The remote control signal can be transmitted reliably to the DVD player 42

[0086] A second embodiment described below is an example in which one controller includes two LEDs.

[0087] [Configuration and Operation]

FIG. 9 shows a bottom shape of the controller 52 according to the second embodiment. Figure 10 shows a block diagram of the controller 52. Referring to FIGS. 9 and 10, this controller 52 is different from the controller 40 shown in FIG. 3 in that the LED 60 includes a second LED 62 disposed at the position of the sandal body and the heel position. is there. In FIG. 9, parts that are the same as in FIG. 3 are given the same reference numbers. Their names, functions, and operations are also the same. Therefore, detailed description thereof will not be repeated here.

In the present embodiment, the output of the LED drive circuit 96 is simply distributed to the LED 60 and the LED 62. Therefore, the same control circuit as the control circuit 76 according to the first embodiment can be used.

Even if the controller 52 according to the second embodiment is used, the same effect as that of the first embodiment can be obtained. In addition, since the LED is provided at multiple locations on the sandal body, it can be surely attached to the DVD player 42 no matter which player 48 is facing, even if the LED output is weak or the directionality is strong. Remote control signals can be transmitted.

In the first embodiment and the second embodiment, a sandal type controller is used. However, the present invention is not limited to such an embodiment. The present invention may be implemented in any form as long as it can detect a player step and send a predetermined remote control signal to the DVD player 42. The controller according to the third embodiment described below is of the pedometer type.

[0091] The pedometer includes, for example, a mechanical acceleration sensor, and is attached to the user's waist or the like to detect the user's steps and count the number of the steps.

FIG. 11 shows a player 180 equipped with a pedometer controller 182. In addition, Figure 12 The appearance of the pedometer controller 182 is shown in FIG. 13 and its block diagram is shown.

Referring to FIG. 12, pedometer-type controller 182 includes a flat rectangular housing 190 with a rounded corner, and a liquid crystal display device (hereinafter “ LCD ”) 192, LED 198 placed next to LCD 192, display switching button 194, reset button 196, and three-point switch 200 disposed on the upper side of housing 190.

[0094] The LCD 192 displays the result of counting the number of steps by the pedometer-type controller 182, the display mainly based on the time, the display regarding the setting state of the pedometer-type controller 182, and the display during the learning of the pedometer-type controller 182. It is for switching and displaying. The display switching button 194 is used to switch the information displayed on the LCD 192. The reset button 196 is a switch operated when resetting the number of steps counted by the pedometer type controller 182 to 0 and when learning the pedometer type controller 182 as described later. The three-point switch 200 is similar to the three-point switch 74 shown in FIG. 3, and is used to switch the learning mode of the pedometer controller 182 as a controller and the on / off of the pedometer controller 182.

[0095] Referring to FIG. 13, the pedometer controller 182 includes the same codetape memory memory 92, LED horse motion circuit 96 and memory 94 as shown in FIG. 4, the reset button 196 shown in FIG. Display switch button 194, three-point switch 200, LCD 192, MCU 210 connected to these components, and acceleration sensor 212 for detecting that the player has stepped

The operation itself performed by the MCU 210 as a controller for the simulated experience system is substantially the same as the operation of the MCU 90 in the first embodiment. Other operations as a pedometer are not directly related to the present invention, and therefore will not be described in detail here.

However, in the present embodiment, the player cannot directly control the acceleration sensor 212. During learning, the output of the speed sensor 212 cannot be turned on intentionally like the step sensor 72 shown in FIG. Therefore, the reset button 196 is used in place of the step sensor 72 during learning.

The pedometer controller 182 has three main operation modes. The first operation mode is the learning mode as a controller, the second operation mode is the execution mode, and the third operation mode. The operation mode is an operation mode as a simple pedometer. Among these, the third operation mode is almost the same as the second execution mode, and only the point that no signal is output to the LED drive circuit 96 is different.

[0099] The apparatus is turned on / off and the learning mode is switched by the three-point switch 200. In order to switch the operation mode of the pedometer controller 182 with the power on, the display switch button 194 is operated.

[0100] In the learning mode, the user keeps pressing the reset button 196 with the front of the pedometer controller 182 facing the DVD player 42, and releases the reset button 196 when the DVD player 42 is turned off. By this operation, it is possible to learn which code table of the code table stored in the code table memory 92 can be used to control the DVD player 42 as in the first embodiment. The learning result is stored in the memory 94 as in the first embodiment.

[0101] The execution mode is the same as that in the first embodiment, except that whether to output a predetermined code as an infrared line is determined depending on whether there is an output from the acceleration sensor 212 or not. Therefore, detailed description thereof will not be repeated here.

[0102] <Fourth embodiment>

Similar to the first to third embodiments, the simulated experience system according to the fourth embodiment of the present invention is a system for assisting a player to exercise before monitoring. As the controller, a pedometer type similar to the pedometer type controller 182 used in the third embodiment is used. However, unlike the first to third embodiments, the system according to the third embodiment supports the player's exercise by displaying the CG generated by the program instead of the DVD player on the monitor screen. To do. Referring to FIG. 14, in the exercise support system 240 according to the present embodiment, an adapter 250 and a television monitor 254 are used, and an exercise support program, data, and program execution program are connected to the adapter 250. Install cartridge 252 with built-in processor. The adapter 250 is basically a single box, and if the cartridge 252 is not installed, nothing will work. However, the adapter 250 includes a mounting portion to which the cartridge 252 is mounted, a connector (not shown) for the cartridge 252 and various interfaces including an IR (infrared) receiver. It has a function to connect G252 and various interfaces. That is, the adapter 250 includes a power supply circuit that supplies power to the cartridge 252 and further includes an AV connector (not shown) on the back surface. Insert one plug of the AV cable 260 into this AV connector and the other plug of the AV cable 260 into the AV terminal 258 of the television monitor 254, and the audio video signal (AV signal) created by the cartridge 252 is Can be given to John Monitor 254. Accordingly, various images for exercise support can be displayed on the screen 256 of the television monitor 254, and music and sound effects can be output from a speaker (not shown).

[0103] Referring to FIG. 15, the adapter 250 includes an IR receiver 270. The cartridge 252 attached to the adapter 250 includes a multimedia processor 280 having an external interface block connected to the IR receiver 270 by a connector (not shown), and a nose 284 connected to the multimedia processor 280. , Connected to node 284: including ROM282.

[0104] The multimedia processor 280 can access the ROM 282 via the bus 284.

Therefore, the multimedia processor 280 can execute the program stored in the ROM 282 and can read and process the data stored in the ROM 282. The ROM 282 stores in advance a program for performing each process shown in the flowchart described later, image data, audio data, and the like.

Although not shown, the multimedia processor 280 includes a central processing unit (hereinafter referred to as “CPU”), a graphics processing unit (hereinafter referred to as “GPU”), a sound processing unit (hereinafter referred to as “CPU”). , "SPU"), geometry engine (hereinafter referred to as "GE"), external interface block, main RAM, and A / D converter (hereinafter referred to as "ADC").

[0106] The CPU executes a program stored in the ROM 282 to perform various calculations and control of the entire system. As CPU processing related to graphics processing, a program stored in ROM282 is executed, parameters for enlargement / reduction, rotation, and / or translation of each object and each sprite, viewpoint coordinates (camera coordinates), and line of sight Perform vector calculations. Here, a unit composed of one or a plurality of polygons or sprites and applied with the same transformation of enlargement / reduction, rotation, and translation is called an “object”. [0107] The GPU generates a 3D image composed of polygons and sprites in real time and converts it into an analog composite video signal. The SPU generates PCM (pulse code modulation) waveform data, amplitude data, and main volume data, and multiplies them to generate an analog audio signal. GE performs geometric operations to display a three-dimensional image. Specifically, GE includes matrix products, outer ruffin transformation, outer orthogonal transformation, perspective projection transformation, vertex brightness / polygon brightness calculation (vector inner product), and polygon back surface force ring processing (vector outer product). Perform the operation.

[0108] The external interface block is an interface with a peripheral device (in this embodiment, the IR receiver 270 of the adapter 250) and includes a 24-channel programmable digital input / output (I / O) port. The ADC is connected to the 4-channel analog input port, and through these, the analog signal input from the analog input device is converted into a digital signal. The main RAM is used as a CPU work area, a variable storage area, and a virtual memory management area.

[0109] The multimedia processor 280 receives from the IR receiver 270 step information (information indicating the presence / absence of a step) of the player transmitted from the controller 300 described later. Based on the player's step information, the multimedia processor 280 performs various operations, graphic processing, and sound processing to generate a video signal and an audio signal. The video signal and the audio signal generated by the multimedia processor 280 are supplied to the television monitor 254 (see FIG. 14) via the adapter 250 and the AV cable 260 (see FIG. 14), and accordingly, the television monitor Video is displayed at 254, and audio is output from the speaker (not shown). Note that the adapter 250 applies the video signal generated by the multimedia processor 280 to the AV cable 260 as it is, and also amplifies the audio signal and applies it to the AV cable 260.

FIG. 16 shows a block diagram of a pedometer controller 300 according to this embodiment.

[0111] Referring to FIG. 16, the pedometer controller 300 includes the same LED drive circuit 96 and memory 94 as shown in FIG. 4, the reset button 196, the display switching button 194, and the L shown in FIG. CD192, MCU210 connected to each part, and player's stepping It includes an acceleration sensor 212 for detecting, and a switch 302 for switching on and off the power of the pedometer controller 300.

[0112] The operation itself performed by the MCU 210 as a controller for the exercise support system is substantially the same as the operation of the MCU 90 in the first embodiment. Other operations as a pedometer are not directly related to the present invention, and therefore will not be described in detail here.

[0113] However, in the present embodiment, the player cannot directly control the acceleration sensor 212. Further, in the present embodiment, the pedometer controller 300 does not send any command, and only information indicating whether or not the acceleration sensor 212 has detected that the player has taken a step is sent to the adapter 250. Send. Therefore, the code table memory 92 as shown in FIGS. 4 and 13 is not necessary.

[0114] The pedometer controller 300 has two main operation modes. The first operation mode is an execution mode as a controller, and the second operation mode is an operation mode as a simple pedometer. Among these, the difference between the first operation mode and the second operation mode is merely whether or not a signal is output to the LED drive circuit 96.

[0115] The device is switched on and off by a switch 302. In order to switch the operation mode of the pedometer controller 300 with the power on, the display switching button 194 is operated.

[0116] In the execution mode, whether to output a predetermined code as an infrared line is determined depending on whether there is an output from the acceleration sensor 212 or not. This is the same as in the third embodiment. Therefore, detailed description thereof will not be repeated here.

FIG. 17 shows a flowchart of a program executed by the multimedia processor 280 for realizing the exercise support system. Referring to FIG. 17, at step 320, multimedia processor 280 performs system initialization. In step 322, the multimedia processor 280 updates the screen of the television monitor 254 (see FIG. 14). In step 324, the multimedia processor 280 refers to the step information received from the IR receiver 270 to determine whether or not a player step has been detected. If a step is detected, go to step 326, otherwise go to step 328. In step 326, the multimedia processor 280 stores corresponding image information (such as image data storage position information and display position information) in the main RAM in order to display an image corresponding to the player's step. In step 328, the multimedia processor 280 stores corresponding image information (such as image data storage position information and display position information) in the main RAM in order to display an image independent of the player's step.

[0119] In step 330, the multimedia processor 280 determines whether or not an interrupt due to the video synchronization signal has occurred. If no interrupt has occurred, the multimedia processor 280 returns to the same step 330. If an interrupt occurs, the process proceeds to step 322, and the display screen of the television monitor 254 is updated based on the processing results of steps 326 and 328.

[0120] If an interrupt other than that caused by the video synchronization signal occurs, program execution is suspended and interrupt processing is executed. In this embodiment, there are two types of main interrupts. The first is an interrupt for voice processing, and the second is an interrupt for obtaining an infrared code. In step 340 of the interrupt process, the multimedia processor 280 determines whether or not the interrupt is an interrupt for voice processing. If “YES”, the process proceeds to step 342 to perform the voice processing. In the case of “N0”, that is, in the case of an interrupt for obtaining an infrared code, the process proceeds to step 344.

[0121] In step 344, the multimedia processor 280 receives the infrared code output from the IR receiver 270, that is, a signal (step information) indicating the presence or absence of the player's step, and stores it in a predetermined storage area.

Referring to FIG. 18, this exercise support screen 360 is a landscape generated by computer graphics, including a firework object 384, a normal display unit 372, a window 374, a time display unit 378, and a calorie consumption display unit 380. And a step number display section 382. In the window 374, a player character 376 that moves in the virtual space instead of the player is displayed.

[0123] Each time the multimedia processor 280 detects a step of the player, the multimedia processor 280 alternately moves the feet of the player character 376 in the virtual space to perform a walking or running motion (step 326 in FIG. 17). The multimedia processor 280 increases the speed of the player character 376's foot movement as the player's step increases, and the player step increases as the player's step increases. Slow the movement of the character 376's legs (step 376 in Fig. 17).

In addition, the multimedia processor 280 stores the number of steps of the player, and displays the total number of steps of the day on the step number display unit 382 (step 326 in FIG. 17). Further, the multimedia processor 280 calculates the calorie consumption of the player using the number of steps, the height and weight input by the player in advance, and the calorie consumption calculation formula stored in advance, and the calorie consumption display unit It is displayed on 380 (step 326 in FIG. 17). Further, the multimedia processor 280 measures the time during which the player is exercising and displays it on the time display unit 378 (step 326 in FIG. 17).

[0125] Each time the multimedia processor 280 detects the player's step, one fireworks object chart 384 appears and disappears (step 326 in FIG. 17). In addition, whenever the multimedia processor 280 detects that the player has performed a certain number of steps, the multimedia processor 280 displays a flashy firework object as compared with the case of one step (step 326 in FIG. 17). Then, the multimedia processor 280 terminates this screen when the player performs the step operation by the number of norms indicated in the norma display section 372. In the example shown in FIG. 18, among “67/200” displayed on the norma display section 372, “200” indicates the norma, and “67” indicates the number of times of completion.

[0126] <Possible variants>

In the above-described embodiment, the information processing apparatus includes a combination of a cartridge including a DVD player and a processor and an adapter. However, the present invention can be applied to other information processing apparatuses as long as the progress is controlled according to the movement of the user's body, which is not limited to such an apparatus.

[0127] In any of the above-described embodiments, infrared rays are used for communication. This is because all currently sold DVD players and the like support remote control using infrared communication, and using such remote control is useful for simplifying the device configuration. . Of course, communications are not limited to those using infrared rays, but they may use weak radio waves. Further, although one or two codes are transmitted from the controller, the present invention is not limited to such an embodiment. It is easy to make design changes such as outputting some special code if a specific condition is met. In the first to third embodiments, learning is performed as to which code table is used among the code tables stored in the code table memory 92 in the learning mode. However, the present invention is not limited to such an embodiment. At the time of learning, it is possible to check only which code is used and store the code itself in the memory.

[0129] In the above embodiment, for example, in step 142 of Fig. 6, the code is output only once. However, the present invention is not limited to such an embodiment. In the process of step 142, the same code may be output a plurality of times, for example, twice.

[0130] The controllers according to the first and second embodiments described above are of a sandal type. However, the present invention is not limited to such an embodiment. For example, it may be a shoe shape or a shape that attaches to a shoe. Further, in the case of using an acceleration sensor similar to the pedometer type used in the third and fourth embodiments, the controller may be configured such that it touches the wrist or ankle or some other body of the player.

The controller according to the fourth embodiment described above is a pedometer type. However, the present invention is not limited to this, and for example, the sandal controller of the first embodiment or the second embodiment can be used. In this case, the code table memory 92 shown in FIGS. 4 and 10 is unnecessary.

Also, the exercise support screen 360 of FIG. 18 is an example, and the screen is not limited to this as long as the screen changes according to the player's step. Of course, as in the first embodiment, it is possible to display a video (live action or CG) in which the scenery changes according to the player's step.

[0133] In the embodiment described above, the player performs the step operation without imposing a special load. However, the player can also perform a step exercise under a load condition. For example, a player may perform a step operation with a dumbbell, a step operation with a weight on an ankle or a wrist, a step operation with a weight on a Z or sandals or shoes (built-in), etc. it can.

By the way, in the first embodiment described above, the image of the player as if the player is walking or running outdoors is actually generated even though it is not actually moving. The player feels as if he is moving. In other words, in the virtual space, a landscape when actually walking or the like is created outdoors, and the indoor step motion in the real space, that is, the simulated act of walking or running is brought close to the actual act.

[0135] However, even when the player performs a stepping motion in a loaded state as described above, the force that can surely control the video displayed on the television monitor to synchronize with the stepping motion. With such control, the player may feel uncomfortable with the transition of the video, that is, the landscape. Also, as shown in FIG. 18, a motion corresponding to the step motion of the player, that is, a motion to be simulated (walking or running) in response to the step motion that is a simulated action, is shown in FIG. The same can be said for the case in which this is done. These are uncomfortable feelings due to the fact that the player character in the virtual space (whether it is displayed or not) is moving in an unloaded state while the player is exercising in a loaded state. As one method for solving such a sense of incongruity, when the player performs a step exercise in a loaded state, there is a method in which the player's loaded state is also reflected in the movement of the player character in the virtual space. However, with such a method, it is difficult to make an appropriate correction that eliminates the uncomfortable feeling. In such cases, it may be preferable to display a video that is unrelated to the behavior to be simulated.

[0136] The video unrelated to the behavior to be simulated is, for example, a firework object 384 in FIG. Of course, the video unrelated to the act to be simulated is not limited to this, and any image can be changed, made to appear, disappear, or any of these can be changed according to the step motion of the player. It is also possible to combine them in the form.

[0137] By displaying the video unrelated to the behavior to be simulated in this way, it is possible to prevent the player from feeling uncomfortable as a result of exercising in a loaded state as much as possible. On the other hand, in the virtual space, the player can feel the interactive fun of something happening or changing in response to his / her simulated movement, and can ease or eliminate fatigue and tiredness caused by repeated movements. It can support continuation of exercise.

[0138] Here, the video unrelated to the act to be simulated is directly related to the act to be simulated. Although it is not related video, it is video that some event occurs in response to the player's movement. In other words, an image unrelated to the behavior to be simulated is an image that responds to a predetermined movement of the player's body and is independent of the predetermined movement of the player's body. It is a visualization of the event. In other words, the movement of the player's body is not directly related to the movement of the player's body, which is not simulated by the movement of the player character (whether or not it is displayed) in the virtual space. For example, it refers to various images such as the above-mentioned video of fireworks display, video in which some object appears in the video, video in which some object in the video moves, video in which the hue of the entire video changes.

[0139] In the above-described embodiment, the step motion of the player is detected and an image responding to the step motion is displayed. However, the detection target is not limited to the step motion, and various motions such as a jump motion, a squat, or a punch motion are targets, and the image can be changed in response to the motion to be detected. In this case, the position where the controller is mounted is appropriately changed according to the detection target.

[0140] Various types of sensors can be used. As in the first and second embodiments, a simple mechanical sensor, pressure sensor, membrane switch, etc. can be used to detect that the pedal has been depressed by providing it directly on the bottom of a sandal or the like. it can. In addition, in order to detect a step without contact as in the third and fourth embodiments, a piezoelectric, electrodynamic, strain gauge, or semiconductor (MEMS: Micro Electro Mechanical Systems) acceleration sensor is used. Can be used.

[0141] Although the present invention has been described by taking a plurality of embodiments as examples, the embodiments disclosed herein are merely examples, and the present invention is not limited to only the above-described embodiments. . The scope of the present invention is indicated by each claim in the scope of claims after taking into account the description of the detailed description of the invention, and the meaning and scope equivalent to the words described therein are all within the scope of the present invention. Includes changes.

Industrial applicability

[0142] The present invention can be used for an information processing system that inputs information according to the movement of the user's body and presents information such as images and voices. By responding to changes in screen display, generated sound, etc., it can be used in an information processing system that simulates walking, travel, sports, exercise size, etc. it can.

Claims

The scope of the claims

[1] Detection means for detecting a predetermined movement of the user's body, which is used by being attached to a part of the user's body,

An information input device comprising: wireless transmission means for wirelessly transmitting a predetermined signal in response to detection of a predetermined movement of the user's body by the detection means.

[2] The detection means includes

A wearing part that the user can wear on a part of the body;

The information input device according to claim 1, further comprising: a means for detecting a walking motion of the user provided in the wearing unit.

[3] The information input device according to [2], wherein the mounting portion has a shape of footwear that the user can wear.

4. The information input device according to claim 3, wherein the means for detecting includes a switch that is provided on a bottom surface of the footwear of the mounting portion and outputs a detection signal in contact with the floor surface.

[5] The information input device according to claim 2, wherein the means for detecting includes an acceleration sensor attached to the mounting portion.

[6] code storage means for storing a plurality of predetermined codes;

A selection code storage means for storing a code selected by the user's instruction from the plurality of codes stored in the code storage means in response to the user's instruction; ,

6. The information input device according to claim 1, wherein the wireless transmission unit transmits a code stored in the selection code storage unit as the predetermined signal.

7. The information input device according to claim 1, wherein the wireless transmission unit includes an infrared communication unit for transmitting the predetermined signal by infrared rays.

[8] The infrared communication means includes a plurality of LEDs for generating infrared rays for transmitting the predetermined signal,

8. The information input device according to claim 7, wherein the plurality of LEDs are arranged to emit infrared rays in directions different from each other.

[9] Used by attaching to a part of the user's body and detecting a predetermined movement of the user's body. Detection means to know,

In response to detecting a predetermined movement of the user's body by the detection means, an information input device including a wireless transmission means for wirelessly transmitting a predetermined signal, and transmitted from the wireless transmission means And an information processing means for performing predetermined information processing in response to the incoming signal.

[10] The information processing means includes:

Reproducing means for reproducing information recorded on a predetermined medium;

10. Reproduction control means for receiving the signal transmitted from the means for wireless transmission and controlling reproduction processing by the reproduction means according to the received signal. The information processing system described.

[11] The recorded information is a recorded video,

The information processing system according to claim 10, wherein the reproduction unit includes a recording / reproducing apparatus that reproduces a recorded video recorded on the predetermined medium.

12. The information processing system according to claim 11, wherein the recorded video includes a landscape video.

13. The information processing system according to claim 10, wherein the recorded information is a video created by computer graphics.

14. The video created by computer graphics includes a video of a landscape.

13. The information processing system according to 13.

[15] The information processing means includes:

Video generation means for generating and outputting video by computer graphics, and control of video generation processing by the video generation means based on the signal transmitted from the wireless transmission means The information processing system according to claim 9, further comprising a video generation control unit.

[16] The video generation control means includes means for controlling the video generation means so that the video generation means causes a predetermined event to occur on the video in response to the signal,

16. The information processing system according to claim 15, wherein the predetermined event is a visualization of an event independent of the predetermined movement of the user's body.