JP6601651B2 - Performance guidance device, performance guidance method, program, and electronic musical instrument - Google Patents

Description

  The present invention relates to a performance guidance device, a performance guidance method, a program, and an electronic musical instrument that are suitable for practice of music performance.

  2. Description of the Related Art Conventionally, various devices for assisting or guiding music performance practice in an electronic musical instrument having a keyboard have been put into practical use. For example, in Patent Document 1, a signal for driving the keys to be sequentially pressed according to the progress of the music is generated, and the key to be pressed is pushed down to a half-pressed state by this signal, so that the user should play next. An apparatus for teaching a key and assisting performance practice is disclosed.

  Further, for example, in Patent Document 2, song data that represents a finger to be played for each sound is provided in song data that represents each sound constituting the song, and song data that is read as the song progresses When infrared light modulated by fingering data extracted from the inside is transmitted, a ring with a vibrator attached to each finger of the performer receives and demodulates the infrared light to obtain fingering data. Of the rings with a vibrator attached to each finger, the ring with a vibrator attached to a finger specified by fingering data drives the vibrator to generate vibration, thereby restraining the movement of the player's hand. There is disclosed an apparatus for tactilely guiding fingering of a keyboard performance without any problem.

Japanese Patent Laid-Open No. 6-27939 JP 2008-122644 A

  By the way, in the technique disclosed in the above-mentioned Patent Document 1, it is necessary to look carefully at the keyboard to find a half-pressed key, that is, a key to be played, and therefore, there is a problem that it is impossible to keep an eye on the keyboard. Further, in the technique disclosed in Patent Document 2, a finger to be pressed can be guided, but there is a problem that a novice user who is unfamiliar with the keyboard operation does not know which key to press. In other words, in the techniques disclosed in Patent Documents 1 and 2, it is impossible to sensibly guide which key should be played with which finger without gazing at the keyboard.

  The present invention has been made in view of such circumstances, and a performance guidance device, a performance guidance method, and the like, which can sensuously guide which key should be played with which finger without gazing at the keyboard, It aims to provide programs and electronic musical instruments.

In order to achieve the above object, the performance guidance device of the present invention provides:
A specific means for identifying the relationship between the position of the performer's thumb or little finger on the keyboard and the position of the key to be played;
Based on the relationship specified by the specifying means, the first notification for vibrating one of the plurality of vibrating bodies or the key surface of the key to be played is shaken so as to indicate the position or direction of the key to be played. Notification means for performing second notification of dynamic displacement ;
It is characterized by comprising.

The musical sound generation method of the present invention includes:
The device
Identify the relationship between the position of the performer's thumb or little finger on the keyboard and the position of the key to be played,
Based on the relationship specified by the specifying means, the first notification for vibrating one of the plurality of vibrating bodies or the key surface of the key to be played is shaken so as to indicate the position or direction of the key to be played. Second notification for dynamic displacement is performed.
It is characterized by that.

The program of the present invention
On the computer,
A specific process for identifying the relationship between the position of the player's thumb or little finger on the keyboard and the position of the key to be played;
Based on the relationship specified by the specifying means, the first notification for vibrating one of the plurality of vibrating bodies or the key surface of the key to be played is shaken so as to indicate the position or direction of the key to be played. A notification process for performing a second notification for dynamic displacement ;
Is executed.

  In the present invention, it is possible to sensuously guide which key should be played with which finger without gazing at the keyboard.

It is an external view which shows the external appearance of the electronic musical instrument 100 provided with the performance guidance apparatus by one Embodiment of this invention. 1 is a block diagram showing a configuration of an electronic musical instrument 100. FIG. It is a block diagram which shows the structure of the vibrating bodies 16-1 to 16-4. It is a figure which shows the data structure of RAM20, and the structure of guide data. It is a flowchart which shows operation | movement of a main routine. It is a flowchart which shows the operation | movement of a switch process. It is a flowchart which shows operation | movement of a guide switch process. It is a flowchart which shows operation | movement of a guide process. It is a flowchart which shows the operation | movement of the guide process following FIG. It is a flowchart which shows the operation | movement of a position detection process. It is a flowchart which shows the operation | movement of the position detection process following FIG. It is a flowchart which shows the operation | movement of a keyboard process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
A. External Appearance and Configuration (1) External Appearance FIG. 1 is an external view showing an external appearance of an electronic musical instrument 100 including a performance guide device according to an embodiment of the present invention. The electronic musical instrument 100 shown in this figure has a rectangular casing, and a keyboard 11 is provided along the longitudinal direction of the front surface thereof. The left end position of the left hand of the user (performer) is the left end of the keyboard 11. A hand position detection sensor 13-1 for detecting the right end position of the user's right hand little finger is disposed on the right end side.

  Furthermore, on the operation panel surface provided above the keyboard 11, various operation switches constituting the operation unit 17 and a display unit 14 for displaying the setting state and operation state of the apparatus on the screen are provided. Note that vibrators 16-1 to 16-4, which will be described later, are attached to the little fingers and thumbs of the left and right hands of the user who performs the key release operation on the keyboard 11.

(2) Configuration Next, the configuration of the embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a configuration of the electronic musical instrument 100. In FIG. 2, a keyboard 11 displays performance information such as a key-on / key-off signal corresponding to a performance operation (press / release key operation), a key number of a pressed key (or a key number of a released key), and velocity. Output. Note that the performance information generated by the keyboard 11 is converted into a note-on / note-off event by the CPU 18 and then supplied to the sound source 21.

  The key drive unit 12 includes a drive electromagnet disposed for each key and an excitation driver that supplies an excitation signal to the drive electromagnet. The excitation driver supplies an excitation signal to a driving electromagnet disposed on a key designated by the CPU 18 and thereby swings and displaces the key surface of the corresponding key upward within a stroke range of, for example, 5 mm to 10 mm. The purpose of such rocking displacement of the key surface will be described later.

  The hand position detection sensors 13-1 to 13-2 detect the distance to the object in a non-contact manner using, for example, ultrasonic waves. Specifically, as described above, the hand position detection sensor 13-1 provided on the left end side of the keyboard 11 detects the left end position of the user's (performer) left hand little finger, and the hand provided on the right end side of the keyboard 11. The position detection sensor 13-2 detects the right end position of the user's right hand little finger.

  Note that the left end position of the left little finger detected by the hand position detection sensor 13-1 refers to a separation distance from the end surface of the sensor 13-1 to the left end of the user's left hand little finger. Also, the right end position of the right hand little finger detected by the hand position detection sensor 13-2 refers to a separation distance from the end surface of the sensor 13-2 to the right end of the user's right hand little finger.

  The left end position of the left hand little finger and the right end position of the right hand little finger detected by the hand position detection sensors 13-1 to 13-2 are taken into the CPU 18. As will be described later, the CPU 18 uses the left end position of the left hand little finger, the right end position of the right hand little finger, and the width data (numerical data) of the user's hand pre-registered in the RAM 20, as will be described later. / Convert which key on the keyboard 11 corresponds to the little finger.

  Based on the display control signal supplied from the CPU 18, the display unit 14 displays a setting state, an operation state, and the like of each part of the device on the screen. Under the control of the CPU 18, the transmission unit 15 gives a drive instruction to the reception unit 16 a (described later) of the vibrator 16 according to a known short-range wireless communication standard known as Bluetooth (registered trademark) or ZigBee (registered trademark). Wireless transmission.

  As shown in FIG. 1, the vibrating body 16 includes a vibrating body 16-1 attached to the user's (performer) left little finger, a vibrating body 16-2 attached to the left thumb, and a vibration attached to the right thumb. It consists of a body 16-3 and a vibrating body 16-4 attached to the little finger of the right hand. As illustrated in FIG. 3, the vibrating body 16 includes a receiving unit 16 a that receives and demodulates a driving instruction transmitted wirelessly from the transmitting unit 15, and a driving unit 16 b that generates a driving signal in accordance with the demodulated output of the receiving unit 16 a. , And a vibrator 16c that generates vibration in accordance with a drive signal supplied from the drive unit 16b.

  Although not shown in the figure, the operation unit 17 is a power switch for turning on / off the power supply, various switches for setting and selecting various parameters for modifying the generated musical sound, and start / stop of performance guidance. It has a guide switch for instructing and generates a switch event corresponding to the type of switch to be operated. The switch event generated by the operation unit 17 is captured by the CPU 18.

  The CPU 18 sets the operation state of each part of the apparatus based on various switch events supplied from the operation unit 17, and when the start of performance guidance is instructed by the operation of the guide switch, the CPU 18 can select any finger without watching the keyboard 11. The key to be played is guided to the user (performer), and note-on / note-off events corresponding to performance information generated by the user's key release operation are generated and supplied to the sound source 21. The sound source 21 is instructed to generate a musical sound. The characteristic processing operation of the CPU 18 according to the gist of the present invention will be described in detail later.

  The ROM 19 stores various programs loaded on the CPU 18. The various programs include a main routine described later, switch processing called from the main routine, guide processing, position detection processing, and keyboard processing. As illustrated in FIG. 4, the RAM 20 stores a work area WA, guide data GD, and hand width data HD. The work area WA of the RAM 20 temporarily stores various register / flag data as a work area of the CPU 18.

  The guide data GD is data for guiding a performance operation (key pressing operation) for each sound constituting the music to be practiced. This guide data GD is expressed in a data format called a so-called relative time method in which “time” and “command” are paired and stored in the order of time-series addresses corresponding to the progression of music.

  In other words, the first “time” represents the timing of the corresponding “command” by the elapsed time from the beginning of the song, and the “time” after the beginning represents the elapsed time from the previous “command” execution time and the timing of the next “command” Represents. The “command” is composed of either an on command representing key press or an off command representing key release. The on-command representing the key press includes a key number that specifies the key to be played and a fingering number that specifies the finger to be pressed. On the other hand, the off command indicating the key release includes a key number for designating a key to be released.

  The hand width data HD includes left hand width data LHW and right hand width data RHW. The left hand width data LHW is a width obtained by actually measuring the left end of the left hand little finger up to the right end of the left hand thumb when the user places both left and right hands on the keyboard 11. The right hand width data RHW is a measured width up to the left end of the right thumb with reference to the right end of the right hand little finger in the same state.

  The sound source 21 includes a plurality of tone generation channels (MIDI channels) configured by a well-known waveform memory reading method, and generates musical sound waveform data W according to a note-on / note-off event supplied from the CPU 18. The sound system 22 converts the musical sound waveform data W output from the sound source 21 into an analog musical sound signal, performs filtering such as removing unnecessary noise from the musical sound signal, and then amplifies it and releases it from the speaker. Let it sound.

C. Operations Next, with reference to FIGS. 5 to 12, operations of the main routine, switch processing, guide processing, position detection processing, and keyboard processing executed by the CPU 18 of the electronic musical instrument 100 having the above-described configuration will be described. The subject of the operation described below is the CPU 18 unless otherwise specified.

(1) Operation of Main Routine FIG. 5 is a flowchart showing the operation of the main routine. When the apparatus power supply is powered on, the CPU 18 starts this routine, proceeds to step SA1 shown in FIG. 5, and executes an initialization process for initializing each section of the apparatus. When the initialization process is completed, the process proceeds to step SA2, and various switch processes are executed based on the switch event corresponding to the switch type operated by the user on the operation unit 17.

  For example, when the guide switch process is executed in accordance with the guide switch, the leading guide data GD (time) stored in the RAM 20 is set when the guide flag GF inverted according to the ON operation of the guide switch becomes “1”. , The timer interrupt prohibition is canceled, the command timing is started, and the hand position detection sensors 13-1 and 13-2 are instructed to start the operation. On the other hand, when the guide flag GF inverted according to the ON operation of the guide switch becomes “0”, the timer interrupt is prohibited and the timing of the command timing is stopped, and the operation of the hand position detection sensors 13-1 and 13-2 is stopped. Instruct.

  Next, in step SA3, a guide process is executed. In the guide process, at the command timing (timing when the timer value of the register T becomes “0” or less), the “command” as the guide data GD is read, and if it is “on command”, the key number NOTE and the operation are read. The finger number FINGER is extracted and the ON flag ONF is set to “1”.

On the other hand, if the read “command” is an “off command” and the driving flag DF is “1”, the key surface of the key corresponding to the key number NOTE is displaced by swinging downward. The drive is instructed to return to the position. If the guide data GD read in accordance with the read address ADG further advanced is the “time” of the next command, it is stored in the register T, and the process ends.

  Subsequently, when the process proceeds to step SA4, a position detection process is executed. In the position detection process, based on the detection results of the hand position detection sensors 13-1 and 13-2 and the user hand width data HD (left hand width data LHW and right hand width data RHW) stored in the RAM 20, as will be described later. It is obtained by converting which key on the keyboard 11 each position of the left hand little finger / thumb and right thumb / little finger of the user (performer) corresponds to.

  Then, depending on the relationship between the acquired positions of the left little finger / thumb and right thumb / little finger of the user and the position of the key to be played (the position of the key corresponding to the key number NOTE), The position of the key to be played by vibrating any one of the vibrating bodies 16-1 to 16-4 attached to the right thumb / little finger is “left from the left hand little finger”, “right from the right hand little finger”, “right hand” Between the left hand and the left hand.

  The user moves the right hand (or left hand) on the keyboard 11 according to this guide, and the position of the key to be played (the position of the key corresponding to the key number NOTE) is “between the little finger of the left hand (or right hand) and the thumb. When it fits in (in the hand), the key surface of the key corresponding to the key number NOTE is rocked upward. Then, as a result of any finger from the little finger of the left hand (or right hand) of the user senses the rocking displacement of the key surface by tactile sense and sensuously guides the key depression of the key to be played with the sensed finger, It is possible to sensuously guide which key should be played with which finger without gazing at the keyboard.

  Next, in step SA5, keyboard processing is executed. In the keyboard process, as will be described later, when a key-on event occurs in response to a key depression, a note-on event is created based on performance information generated by the keyboard 11 in response to a key depression operation and sent to the sound source 21. When the key to be played during the guide is pressed, the timer interrupt prohibition is canceled. On the other hand, when a key-off event occurs in response to a key release, a note-off event is created based on performance information generated by the keyboard 11 in response to a key release operation and sent to the sound source 21.

  Thereafter, the process proceeds to step SA6, and other processes such as, for example, applying the type of effect designated by the user operation to the generated musical tone are executed, and the process returns to step SA2. Thereafter, the above-described steps SA2 to SA6 are repeatedly executed until the electronic musical instrument 100 is powered off.

(2) Operation of Switch Processing Next, the operation of switch processing will be described with reference to FIGS. FIG. 6 is a flowchart showing the operation of the switch process, and FIG. 7 is a flowchart showing the operation of the guide switch process. When the switch process is executed via step SA2 (see FIG. 5) of the main routine described above, the CPU 18 executes the guide switch process via step SB1 shown in FIG. 5, and then proceeds to step SB2. Perform other switch processing, such as selecting a tone color.

  When the guide switch process is executed through step SB1, the CPU 18 proceeds to step SC1 shown in FIG. 6 and determines whether or not the guide switch is turned on. If the guide switch is not turned on, the determination result in step SC1 is “NO”, and this process is finished. However, when the guide switch is turned on, the determination result in step SC1 is “YES”. Proceed to step SC2.

  In step SC2, the guide flag GF is inverted. The guide flag GF represents a guide stop when “0”, and represents a guide execution when “1”. Next, in step SC3, it is determined whether or not the inverted guide flag GF is “1”, that is, whether or not guide execution is indicated.

  If the guide flag GF inverted in response to the ON operation of the guide switch is “1”, that is, indicates guide execution, the determination result in step SC3 is “YES”, and the process proceeds to step SC4. In step SC4, the initial address (head address) of the guide data GD stored in the RAM 20 is stored in the register ADG.

  Subsequently, in step SC5, the guide data GD in the RAM 20 is read according to the initial address (first address) stored in the register ADG. In this case, the time of the initial address (first address) is read out. In step SC6, the read time is stored in the register T. In step SC7, the prohibition of the timer interrupt is canceled, and in the subsequent step SC8, the hand position detection sensors 13-1 and 13-2 are instructed to start the operation, and this process is finished.

  When the prohibition of the timer interrupt is canceled in step SC7, a timer interrupt process (not shown) is executed. In the timer interrupt process, the command timing is measured by subtracting the timer clock from the timer value of the register T at every timer interrupt period.

  On the other hand, when the guide flag GF inverted according to the ON operation of the guide switch is “0”, that is, indicates that the guide is stopped, the determination result of the above-mentioned step SC3 becomes “NO”, the process proceeds to step SC9, and the timer interrupt Is prohibited. As a result, the timing of the command timing is stopped. Next, in step SC10, the hand position detection sensors 13-1 and 13-2 are instructed to stop the operation, and the process is finished.

  Thus, in the guide switch processing, when the guide flag GF inverted according to the ON operation of the guide switch becomes “1”, the leading guide data GD (time) stored in the RAM 20 is read and the timer interrupt prohibition is prohibited. The timing of the command is started and the timing of the command is started. Further, the hand position detection sensors 13-1 and 13-2 are instructed to start the operation. On the other hand, when the guide flag GF inverted according to the ON operation of the guide switch becomes “0”, the timer interrupt is prohibited and the timing of the command timing is stopped, and the operation of the hand position detection sensors 13-1 and 13-2 is stopped. Instruct.

(3) Guide Processing Operation Next, the guide processing operation will be described with reference to FIGS. 8 to 9 are flowcharts showing the operation of the guide process. When this processing is executed via step SA3 (see FIG. 5) of the main routine described above, the CPU 18 proceeds to step SD1 shown in FIG. 8, and whether the guide flag GF indicates “1”, that is, indicates guide execution. Judge whether or not. If the guide flag GF is “0”, that is, indicates that the guide is stopped, the determination result is “NO”, and the present process ends.

  On the other hand, if the guide flag GF is “1” (guide execution), the determination result in step SD1 is “YES”, and the process proceeds to step SD2. In step SD2, it is determined whether or not the timer value of the register T subtracted by a timer interrupt process (not shown) is equal to or smaller than “0”, that is, the command timing has been reached. If the timer value of the register T is greater than “0” and the command timing has not been reached, the determination result is “NO”, and the present process ends.

  On the other hand, when the timer value of the register T becomes equal to or less than “0” and the command timing is reached, the determination result in step SD2 is “YES”, and the process proceeds to step SD3 to increment the read address ADG of the guide data GD and Advance. Subsequently, in step SD4, it is determined whether or not the stepped read address ADG is equal to or lower than the END address that specifies the end of the guide data GD. Hereinafter, the operation will be described separately for the case where the stepped read address ADG does not reach the END address and the case where it reaches.

<Increased read address ADG does not reach END address>
If the incremented read address ADG has not reached the END address, the judgment result at Step SD4 is “YES”, and the CPU 4 proceeds to Step SD5. In step SD5, the guide data GD in the RAM 20 is read according to the read address ADG that has been advanced. Then, the process proceeds to step SD6 shown in FIG. 9, and the data type of the guide data GD read in step SD5 is determined.

  If the guide data GD read in step SD5 is “command”, the process proceeds to step SD7 to determine whether it is “on command”. Hereinafter, the operation description will be divided into a case where the read guide data GD is an “on command” and a case where it is an “off command”.

a. When the read guide data GD is “on command” If the read guide data GD is “on command”, the process proceeds to step SD8 via step SD7, and the key number included in the “on command” is stored in the register NOTE. At the same time, the fingering number included in the “on command” is stored in the register FINGER. Hereinafter, the value of the register NOTE is referred to as a key number NOTE, and the value of the register FINGER is referred to as a fingering number FINGER.

  Next, in step SD9, the ON flag ONF is set to “1”. In the subsequent step SD10, after the timer interrupt is prohibited, the process returns to the above-described step SD3 (see FIG. 8). The ON flag ONF is a flag that is set to “1” when guiding the position of the key to be pressed and is set to “0” when not guiding.

b. When the read guide data GD is an “off command” If the read guide data GD is an “off command”, the process proceeds to step SD12 via step SD7, and the on flag ONF is reset to zero. Then, in step SD13, it is determined whether or not the drive flag DF is “1”, that is, whether or not the key drive unit 12 has been given a drive instruction to swing and displace the key surface of the key corresponding to the key number NOTE. To do.

  If the key drive unit 12 is given a drive instruction to swing and displace the key surface of the key corresponding to the key number NOTE (DF = 1), the determination result is “YES”, and the process proceeds to step SD14. The key drive unit 12 is given a drive instruction to swing the key surface of the key corresponding to the key number NOTE downward, that is, to return the key surface to its original position.

  Next, in step SD15, the drive flag DF is reset to zero in response to returning the key surface of the key corresponding to the key number NOTE that has been rocked upward to the original position. Thereafter, the process returns to step SD3 (see FIG. 8). On the other hand, if the drive flag DF is “0”, the determination result in step SD13 is “NO”, and the process returns to step SD3 (see FIG. 8).

  On the other hand, if the guide data GD read in step SD5 shown in FIG. 8 is “time”, the process proceeds to step SD11 via step SD6, and the read “time”, that is, the next command timing is set in the register T. And this processing is finished.

<When the incremented read address ADG reaches the END address>
When the incremented read address ADG reaches the END address, the determination result in step SD4 shown in FIG. 8 becomes “NO”, the process proceeds to step SD16, and the timer interrupt is prohibited. Subsequently, in step SD17, the guide flag GF is reset to zero to indicate the guide stop, and then the process proceeds to step SD18 to instruct the hand position detection sensors 13-1 and 13-2 to stop the operation and the process ends.

  As described above, in the guide process, when the command timing (timing when the timer value of the register T becomes “0” or less) is reached, the “command” that is the guide data GD is read. The number NOTE and fingering number FINGER are extracted and the ON flag ONF is set to “1”. On the other hand, if the read “command” is an “off command” and the driving flag DF is “1”, the key surface of the key corresponding to the key number NOTE is displaced by swinging downward. The drive is instructed to return to the position. If the guide data GD read in accordance with the read address ADG further advanced is the “time” of the next command, it is stored in the register T, and the process ends.

(4) Operation of Position Detection Process Next, the operation of the position detection process will be described with reference to FIGS. 10 to 11 are flowcharts showing the operation of the position detection process. When this processing is executed via step SA4 (see FIG. 5) of the main routine described above, the CPU 18 proceeds to step SE1 shown in FIG. 10, and the guide flag GF is “1”, that is, guide execution is indicated. Judge whether or not.

  If the guide is stopped (the guide flag GF is “0”), the determination result is “NO”, and the present process ends. If the guide is executed (the guide flag GF is “1”), the determination result is “YES”. The process proceeds to step SE2. In step SE2, it is determined whether or not the ON flag ONF is “1”, that is, whether or not the key position to be pressed is guided.

  If the ON flag ONF is “0”, the determination result is “NO”, and the present process is finished. However, if the key position to be pressed is guided (ON flag ONF is “1”), the above step SE2 The determination result is “YES”, and the flow proceeds to step SE3.

  In step SE3, the left end position of the left little finger of the user (player) detected by the hand position detection sensor 13-1 and the right end position of the right hand little finger of the user detected by the hand position detection sensor 13-2 are captured. Based on the captured left end position of the left hand little finger, right end position of the right hand little finger, and user hand width data HD (left hand width data LHW and right hand width data RHW) stored in the RAM 20, the user's left hand little finger / thumb, right thumb / It is obtained by converting which position on the keyboard 11 each position of the little finger corresponds to.

  Next, in step SE4, the key position corresponding to the key number NOTE is acquired on the keyboard 11. In steps SE5, SE7, SE9, and SE17, the position of the key (key to be played) corresponding to the key number NOTE is “left from the left little finger”, “right from the right little finger”, or “right hand” Between the left hand and the left hand or whether it is within the left hand (or right hand) little finger and thumb (in the hand).

  First, in step SE5, it is determined whether or not the key position corresponding to the key number NOTE is “left of the left hand little finger”. If “left from little left finger”, the determination result is “YES”, and the flow proceeds to step SE6. In step SE6, the transmission unit 15 is instructed to drive the vibrating body 16-1 (see FIG. 1) attached to the left hand little finger, and the process ends.

  The transmission unit 15 wirelessly transmits a driving instruction to the vibrating body 16-1 attached to the left hand little finger according to an instruction from the CPU 18, and the vibrating body 16-1 receives the driving instruction and generates vibration in response thereto. As the vibrating body 16-1 vibrates in this way, it is sensibly guided that the key to be played to the user (performer) is located on the left side (bass side) of the left hand little finger. As a result, the user moves his left hand to the left toward the key to be played.

  On the other hand, if the position of the key corresponding to the key number NOTE is not “left from the left little finger”, the determination result in step SE5 is “NO”, the process proceeds to step SE7, and whether or not “right from the right hand little finger” is determined. Is determined. If “right than little right finger”, the determination result is “YES”, and the flow proceeds to step SE8. In step SE8, the transmission unit 15 is instructed to drive the vibrating body 16-4 (see FIG. 1) attached to the little finger of the right hand, and the process is completed.

  The transmission unit 15 wirelessly transmits a driving instruction to the vibrating body 16-4 attached to the right hand little finger according to an instruction from the CPU 18, and the vibrating body 16-4 receives the driving instruction and generates vibration in response thereto. As the vibrating body 16-4 vibrates in this way, it is sensibly guided that the key to be played to the user (performer) is located on the right side (high range side) of the right hand little finger. As a result, the user moves the right hand to the right toward the key to be played.

  If the position of the key corresponding to the key number NOTE is not “right from the right little finger”, the determination result in step SE7 is “NO”, and the process proceeds to step SE9 shown in FIG. 11 to correspond to the key number NOTE. It is determined whether or not the position of the key to be performed is “between right hand and left hand”. If “between right hand and left hand”, the determination result is “YES”, and the flow proceeds to step SE10. In step SE10, it is determined whether or not the ON command (guide data GD) for guiding the key number NOTE has a fingering number.

  If it has a fingering number, the determination result is “YES”, and the flow proceeds to step SE11. In step SE11, it is determined whether or not the fingering number is that of the right hand. If the fingering number is that of the right hand, the determination result is “YES”, and the process proceeds to step SE12 to instruct the transmission unit 15 to drive the vibrator 16-3 (see FIG. 1) attached to the right thumb. And this processing is finished.

  The transmission unit 15 wirelessly transmits a driving instruction to the vibrating body 16-3 attached to the right thumb according to an instruction from the CPU 18, and the vibrating body 16-3 receives the driving instruction and generates vibration in response thereto. As the vibrating body 16-3 vibrates in this manner, the user (performer) is guided sensuously that the key to be played is located on the left side (lower range) than the right thumb. As a result, the user moves the right hand to the left toward the key to be played.

  On the other hand, if the fingering number is that of the left hand, the determination result in step SE11 is “NO”, and the flow proceeds to step SE13. In step SE13, the transmission unit 15 is instructed to drive the vibrating body 16-2 (see FIG. 1) attached to the left thumb, and the process is terminated.

  The transmission unit 15 wirelessly transmits a drive instruction to the vibrating body 16-2 attached to the left thumb in accordance with an instruction from the CPU 18, and in response thereto, the vibrating body 16-2 receives the driving instruction and generates vibration. As the vibrating body 16-2 vibrates in this way, it is sensibly guided that the key to be played to the user (performer) is located on the right side (higher sound range side) than the left thumb. As a result, the user moves the left hand to the right toward the key to be played.

  On the other hand, if the ON command (guide data GD) for guiding the key number NOTE does not have a fingering number, the determination result in step SE10 is “NO”, and the process proceeds to step SE14. In step SE14, it is determined whether or not the key position corresponding to the key number NOTE is “close to the right hand”. If it is “close to the right hand”, the determination result is “YES”, the process proceeds to step SE15, and the transmission unit 15 is instructed to drive the vibrating body 16-3 attached to the thumb of the right hand, and the process ends.

  The transmission unit 15 wirelessly transmits a driving instruction to the vibrating body 16-3 attached to the right thumb according to an instruction from the CPU 18, and the vibrating body 16-3 receives the driving instruction and generates vibration in response thereto. As the vibrating body 16-3 vibrates in this manner, the user (performer) is guided sensuously that the key to be played is located on the left side (lower range) than the right thumb. As a result, the user moves the right hand to the left toward the key to be played.

  On the other hand, when the position of the key corresponding to the key number NOTE is “close to the left hand”, the determination result in step SE14 is “NO”, the process proceeds to step SE16, and the vibrator 16-2 attached to the left thumb. The driving instruction is instructed to the transmission unit 15 and the present process ends.

  The transmission unit 15 wirelessly transmits a drive instruction to the vibrating body 16-2 attached to the left thumb in accordance with an instruction from the CPU 18, and in response thereto, the vibrating body 16-2 receives the driving instruction and generates vibration. As the vibrating body 16-2 vibrates in this way, it is sensibly guided that the key to be played to the user (performer) is located on the right side (higher sound range side) than the left thumb. As a result, the user moves the left hand to the right toward the key to be played.

  If the position of the key corresponding to the key number NOTE is not “between the right hand and the left hand”, the determination result in step SE9 is “NO”, the process proceeds to step SE17, and the “left hand (or right hand) little finger and It is determined whether or not it is in between the thumbs (in the hand). If it does not fit between the left finger (or right hand) little finger and thumb (in the hand), the determination result is “NO”, and the process ends, but “the left hand (or right hand) little finger and thumb (hand) The determination result is “YES”, and the process proceeds to step SE18.

  In step SE18, after giving a drive instruction to the key drive unit 12 so as to swing and displace the key surface of the key corresponding to the key number NOTE, the drive flag DF is set to “1”, and this process ends. As a result, the key driving unit 12 swings and displaces the key surface of the key corresponding to the key number NOTE in the stroke range of 5 mm to 10 mm, for example, in accordance with an instruction from the CPU 18. Then, any finger from the little finger of the left hand (or right hand) of the user senses the rocking displacement of the key surface by tactile sense, and sensuously guides the key depression of the key to be played with the sensed finger. In other words, it is possible to sensuously guide which key should be played with which finger without gazing at the keyboard.

  As described above, in the position detection processing, the left end position of the left hand little finger of the user (player) detected by the hand position detection sensor 13-1, and the right hand little finger of the user detected by the hand position detection sensor 13-2. Based on the right end position and the user's hand width data HD (left hand width data LHW and right hand width data RHW) stored in the RAM 20, the positions of the user's left hand little finger / thumb and right thumb / little finger on the keyboard 11 Acquire or convert to correspond to the key.

  The left little finger / thumb and right thumb of the user according to the relationship between the obtained positions of the left little finger / thumb and right thumb / little finger of the user and the position of the key to be played (the position of the key corresponding to the key number NOTE). / Vibrates any of the vibrating bodies 16-1 to 16-4 attached to each of the little fingers, so that the position of the key to be played is "left from the left hand little finger", "right from the right hand little finger", "right hand and Guiding sensibly between left hand and right hand or left hand.

  According to such a guide, the user moves the right hand (or left hand) on the keyboard 11, and as a result, the position of the key to be played (the position of the key corresponding to the key number NOTE) is “the left hand (or right hand) little finger and thumb. The key face of the key corresponding to the key number “NOTE” is swung upwardly within a stroke range of 5 mm to 10 mm, for example. Then, as a result of any finger from the little finger of the left hand (or right hand) of the user senses the rocking displacement of the key surface by tactile sense and sensuously guides the key depression of the key to be played with the sensed finger, It is possible to sensuously guide which key should be played with which finger without gazing at the keyboard.

(5) Keyboard Processing Operation Next, the keyboard processing operation will be described with reference to FIG. FIG. 12 is a flowchart showing the operation of keyboard processing. When this processing is executed via step SA5 (see FIG. 5) of the main routine described above, the CPU 18 proceeds to step SF1 shown in FIG. 12 to perform key scanning for detecting a key change for each key on the keyboard 11. I do. Subsequently, in step SF2, it is determined whether or not there is a key change based on the key scanning result in step SF1.

  If there is no key change, the process is terminated. If a key-on event occurs in response to a key press, steps SF3 to SF9 described later are executed. On the other hand, if a key-off event occurs in response to a key release Executes steps SF10 to SF12 described later. Hereinafter, the description of the operation will be divided into “when a key-on event occurs in response to a key press” and “when a key-off event occurs in response to a key release”.

<When a key-on event occurs in response to a key press>
When a key-on event occurs in response to the key depression, the process proceeds to step SF3 via step SF2 and stores the key number of the depressed key in the register KEY. In step SF4, a note-on event including the key number stored in the register KEY and the velocity extracted from the performance information generated by the keyboard 11 in response to the key depression is created. In the subsequent step SF5, the created note-on event is created. The event is sent to the sound source 21. As a result, the tone generator 21 generates a musical tone having a pitch specified by the key number of the pressed key at a volume corresponding to the velocity.

  Next, in step SF6, it is determined whether the guide flag GF is “1”, that is, whether the guide process is being executed. If the guide flag GF is “0” (stopping the guide process), the determination result is “NO”, and the present process ends. If the guide flag GF is “1” (execution of the guide process), The determination result is “YES”, and the flow proceeds to next Step SF7.

  In step SF7, it is determined whether or not the ON flag ONF is “1”, that is, whether or not the key position to be played is guided. If the ON flag ONF is “0” (not guided), the determination result is “NO”, and this processing is terminated. If the ON flag ONF is “1”, the determination result is “YES”, and the next Proceed to step SF8.

  In step SF8, it is determined whether or not the key numbers of the register KEY and the register NOTE match, that is, whether or not the key to be played has been pressed. If the key to be played is not pressed, the determination result is “NO”, and this process is terminated. However, if the key to be played is pressed, the determination result is “YES”, and the process proceeds to step SF9, where the timer Cancel the interrupt prohibition and finish this process.

<When a key-off event occurs in response to a key release>
When a key-off event occurs in response to the release of the key, the process proceeds to step SF10 via step SF2, and the key number of the key that has been released is stored in the register KEY. In step SF4, a note-off event including the key number stored in the register KEY is created, and in the subsequent step SF5, the created note-off event is sent to the sound source 21 and the process is terminated. As a result, the tone generator 21 mutes the musical tone having the pitch specified by the key number of the released key.

  In this way, in the keyboard process, when a key-on event occurs in response to a key depression, a note-on event is created based on performance information generated by the keyboard 11 in response to a key depression operation and sent to the sound source 21 and a guide. When a key to be played is pressed, the timer interrupt prohibition is canceled. On the other hand, when a key-off event occurs in response to a key release, a note-off event is created based on performance information generated by the keyboard 11 in response to a key release operation and sent to the sound source 21.

  As described above, in the present embodiment, vibrators 16-1 to 16-4 are attached to at least the left little finger / thumb and right thumb / little finger of the performer and played for each sound of the music to be played. When the power key and the timing of sounding are instructed, the key positions corresponding to the left little finger / thumb and the right thumb / little finger of the performer on the keyboard 11 are acquired, and the obtained left left finger / thumb and right thumb / little finger of the performer are obtained. Depending on the relationship between each key position and the position of the key to be played, any of the vibrating bodies 16-1 to 16-4 is vibrated, and the position of the key to be played is "left from the left little finger" or "from the right hand little finger. “Right” and “Right or left hand between right hand and left hand” are guided to the performer. Then, according to the movement of the player's hand according to this guide, it is determined whether or not the position of the key to be played fits between “the left finger (or right hand) little finger and thumb (in the hand)”. In this case, the key to be played is instructed to swing upward and guide the key to be pressed by the performer at the timing of the instructed sounding. As a result, it is possible to sensuously guide which key should be played with which finger without gazing at the keyboard.

  In the above-described embodiment, the position of the key to be played by vibrating any one of the vibrating bodies 16-1 to 16-4 attached to the performer's left hand little thumb / thumb and right hand thumb / little finger is “left hand little finger”. "Left more", "Right than little right finger" and "Between right hand and left hand, close to right hand or close to left hand". For example, there is a separation between 5 key separations for strong levels, 3 key separations for medium levels, and 1 key separations for small levels. ) May be guided.

  Further, in the present embodiment, when the position of the key to be played falls within “between the left finger (or right hand) little finger and thumb (in the hand)”, the key surface of the key to be played is rocked upward. However, in addition to this, it is possible to vibrate with the key surface being oscillated and displaced upward, and this makes it easier to recognize the position of the key to be played.

  As mentioned above, although one Embodiment of this invention was described, this invention is not limited to it, It is included in the invention described in the claim of this-application, and its equivalent range.

Hereinafter, each invention described in the scope of claims at the beginning of the present application will be additionally described.
(Appendix)
[Claim 1]
Key position acquisition means for sequentially acquiring the position of the key on the keyboard to be played for each sound constituting the music;
Finger position acquisition means for acquiring the position of the left little finger and thumb of the performer on the keyboard, and the position of the right thumb and little finger;
A guide means for guiding the relationship between the position of the performer's finger acquired by the finger position acquiring means and the position of the key to be played acquired by the key position acquiring means;
A performance guidance device comprising:

[Claim 2]
In the guide means, the position of the key to be played acquired by the key position acquisition means is “left from the left hand little finger”, “right from the right hand little finger”, and “right hand or left hand is close to the right hand or close to the left hand” The performance guidance device according to claim 1, wherein the performance guide device guides the performer to the performer.

[Claim 3]
The finger position acquisition means includes vibrators attached to at least the left little finger and thumb and the right thumb and little finger of the performer, respectively, and vibrates one of the plurality of vibrators to perform the performance. 3. The guide according to claim 1, wherein the power key positions are “left from the left hand little finger”, “right from the right hand little finger” and “right hand or left hand between the right hand and the left hand”. Performance guidance device.

[Claim 4]
The guide means includes
When the position of the key to be played is to the left of the obtained player's left hand little finger position, the vibrating body attached to the player's left hand little finger is vibrated so that the key to be played is left hand little finger. Guide it to the left of the position,
When the position of the key to be played is to the right of the obtained player's right hand little finger position, the vibrating body attached to the player's right hand little finger is vibrated so that the key to be played is the right hand little finger. Guide it to the right of the position,
When the position of the key to be played is between the obtained right and left thumb positions of the performer, it is further determined whether or not the position of the key to be played is close to the right hand, and the left hand If it is close to the right hand, it vibrates the vibrating body attached to the player's left thumb and guides that the key to be played is located on the right side of the left thumb position. 4. The performance guidance device according to claim 3, wherein a vibration body mounted on a player's right thumb is vibrated to guide that the key to be played is located on the left side of the right thumb position.

[Claim 5]
The key position acquisition means further sequentially acquires the performance timing of the keys to be played,
The guide means further determines whether or not the position of the key to be played is “between the left finger or the right little finger and the thumb”, and the position of the key to be played is “the left finger or the right little finger”. The performance guidance device according to any one of claims 1 to 4, wherein when it is determined that it falls within a "between thumbs", the key to be performed by the performer is guided at the timing of the acquired performance.

[Claim 6]
When it is determined that the position of the key to be played is “between the left finger or the little finger of the right hand and the thumb”, the guide means swings the key to be played at the acquired performance timing. The performance guidance device according to claim 5, wherein the performance guide device guides a key to be pressed to the performer by moving the displacement.

[Claim 7]
The finger position acquisition means
First position detecting means provided on the left end side of the keyboard and detecting a left end position of a performer's left little finger placed on the keyboard;
Second position detecting means provided on the right end side of the keyboard for detecting the right end position of the performer's right hand little finger placed on the keyboard;
The left end position of the performer's left little finger detected by the first position detecting means, the right end position of the performer's right hand little finger detected by the second position detecting means, and the left and right hands of the performer stored in advance Conversion means for converting which position on the keyboard each position of the left little finger and thumb, right thumb and little finger of the performer corresponds to according to the width, and the converted key on each keyboard The performance guidance device according to claim 1, wherein the position is acquired as each finger position.

[Claim 8]
The performance guidance device
For each sound that composes a song, obtain the key position on the keyboard to be played in sequence,
Obtaining the position of the left little finger and thumb of the performer on the keyboard, and the position of the right thumb and little finger;
A performance guidance method for guiding a relationship between the acquired position of the finger of the performer and the position of the acquired key of the key to be played to the performer.

[Claim 9]
In a computer used as a performance guidance device,
Sequentially acquiring the position of the key on the keyboard to be played for each sound constituting the music;
Obtaining the positions of the left little finger and thumb, the right thumb and little finger of the performer on the keyboard;
Guiding the relationship between the acquired position of the player's finger and the acquired position of the key to be played;
A program that executes

[Claim 10]
A performance guidance device according to any one of claims 1 to 7,
An electronic musical instrument comprising: a sound source that generates a musical sound according to a performance operation in accordance with a guide of the performance guide device.

DESCRIPTION OF SYMBOLS 11 Keyboard 12 Key drive part 13-1, 13-2 Hand position detection sensor 14 Display part 15 Transmission part 16-1 to 16-4 Vibrator 16a Receiving part 16b Drive part 16c Vibrator 17 Operation part 18 CPU
19 ROM
20 RAM
21 sound source 22 sound system 100 electronic musical instrument

Claims (14)

A specific means for identifying the relationship between the position of the performer's thumb or little finger on the keyboard and the position of the key to be played;
Based on the relationship specified by the specifying means, the first notification for vibrating one of the plurality of vibrating bodies or the key surface of the key to be played is shaken so as to indicate the position or direction of the key to be played. Notification means for performing second notification of dynamic displacement ;
A performance guidance device comprising: The specifying means specifies the direction of the position of the key to be played with respect to the position of the performer's thumb or little finger on the keyboard,
2. The performance guidance device according to claim 1, wherein the notification unit performs the first notification by vibrating a vibrating body corresponding to a direction specified by the specifying unit among the plurality of vibrating bodies. . The informing means vibrates one of a plurality of vibrators that can be attached to the performer's finger with the direction of the key position on the keyboard to be played with respect to the position of the thumb or little finger specified by the specifying means. The performance guidance device according to claim 2, wherein the first notification is performed as described above. The informing means attaches the direction of the key position on the keyboard to be played to the position of the thumb or little finger specified by the specifying means to each of the player's left little finger / thumb and right thumb / little finger. The performance guidance device according to claim 3, wherein the first notification is performed by vibrating a body. When the position of the key to be played falls between the little finger and thumb in the left hand or the right hand, the notification means swings and displaces the key surface of the key to be played at the instructed timing of sounding. The performance guidance device according to any one of claims 1 to 4, wherein the performance guidance device performs the following notification. Key position acquisition means for sequentially acquiring the positions of the keys on the keyboard to be pressed based on the music data;
Finger position acquisition means for sequentially acquiring the position of the performer's thumb or little finger on the keyboard;
With
The specifying means sequentially specifies the direction in which the finger should be moved for the next key depression,
The notification means, of the plurality of vibrators, so as to sequentially vibrate the vibrating body corresponding to the direction to move the finger for the next key depression performs the first notification, to claim 1 5. The performance guidance device according to any one of 4 . The finger position acquisition means acquires the position of the performer's thumb and little finger on the keyboard,
The specifying means specifies the direction of the key position with respect to each of the thumb and little finger positions;
The notification means performs said plurality of vibrating bodies is vibrated by the first notification so as to recognize the position of the keys for each position of the identified thumb and the little finger to the performer, claim 6 The performance guidance device described in 1. The finger position obtaining means obtains at least the position of the left hand little finger and the position of the right hand little finger of the performer,
The informing means includes at least the position of the key to the left of the position of the left hand little finger, the position of the key to the right of the position of the right hand little finger, or the key at a position other than that. The performance guidance device according to claim 7 , wherein the first notification is performed by vibrating the plurality of vibrating bodies so as to make a player recognize whether or not there is a position. The informing means causes the player to recognize the direction of the position of the key with respect to the thumb or the little finger by vibrating a vibrating body closer to the direction to be notified among the plurality of vibrating bodies. The performance guidance device according to any one of claims 6 to 8 , wherein the performance guidance device performs one notification. The finger position acquisition means acquires at least the position of the left hand little finger and thumb, the position of the right thumb and little finger of the performer,
The informing means is configured such that the position of the key is “left from the left little finger”, “right from the right hand little finger”, “right to left hand” and “right hand to left hand” in a state where each of the plurality of vibrators is attached to different fingers of the performer. The performance guidance device according to claim 9 , wherein the first notification is performed by vibrating the plurality of vibrators so that a player can recognize whether the hand is close to the right hand or the left hand. A left sensor arranged on the left end side of the keyboard, and a right sensor arranged on the right end side of the keyboard,
The finger position acquisition means includes a left end position of the performer's left hand little finger detected by the left sensor, a right end position of the performer's right hand little finger detected by the right sensor, and a stored player's hand. The performance guidance device according to claim 10 , wherein the position of the left little finger and thumb and the position of the right thumb and little finger of the performer are acquired based on the width data. A keyboard having a plurality of keys;
A sound source that generates a musical sound in response to a key pressing operation on the keyboard;
A specifying means for specifying the relationship between the position of the performer's thumb or little finger on the keyboard and the position of the key to be played;
Based on the relationship specified by the specifying means, the first notification for vibrating one of the plurality of vibrating bodies or the key surface of the key to be played is shaken so as to indicate the position or direction of the key to be played. Notification means for performing second notification of dynamic displacement;
An electronic musical instrument comprising: The device
Identify the relationship between the position of the performer's thumb or little finger on the keyboard and the position of the key to be played,
Based on the identified relationship, a first notification for vibrating any one of the plurality of vibrating bodies or a first displacement for oscillating and displacing the key surface of the key to be played is made to indicate the position or direction of the key to be played. 2 notifications,
Performance guidance method. On the computer,
A specific process for identifying the relationship between the position of the player's thumb or little finger on the keyboard and the position of the key to be played;
Based on the identified relationship, a first notification for vibrating any one of the plurality of vibrating bodies or a first displacement for oscillating and displacing the key surface of the key to be played is made to indicate the position or direction of the key to be played. Notification processing for performing notification of 2;
A program that executes

Images