WO2014203870A1 - 演奏システム、演奏方法及び演奏プログラム - Google Patents
演奏システム、演奏方法及び演奏プログラム Download PDFInfo
- Publication number
- WO2014203870A1 WO2014203870A1 PCT/JP2014/065945 JP2014065945W WO2014203870A1 WO 2014203870 A1 WO2014203870 A1 WO 2014203870A1 JP 2014065945 W JP2014065945 W JP 2014065945W WO 2014203870 A1 WO2014203870 A1 WO 2014203870A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- performance
- data
- image
- date
- time
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
- G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
- G10H1/0058—Transmission between separate instruments or between individual components of a musical system
- G10H1/0066—Transmission between separate instruments or between individual components of a musical system using a MIDI interface
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
- G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/121—Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
- G10H2240/131—Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/325—Synchronizing two or more audio tracks or files according to musical features or musical timings
Definitions
- the present invention relates to a technique for recording information related to a performance and reproducing the performance.
- a performance recording device disclosed in Patent Document 1 as a device for recording performance data representing the operation content of a keyboard.
- this performance recording device stores performance data generated in a time series based on keyboard operations and time information in a temporary storage area as a set, and collects a plurality of performance data together.
- the recorded performance recording file is stored in an external storage device.
- this performance recording device searches for a performance recording file corresponding to the time selected by the user, and plays back the searched performance recording file.
- an object of the present invention is to make it possible to visually easily identify performance data to be reproduced by a user.
- first storage means for storing performance data indicating a performance and performance date / time data related to the date / time at which the performance was performed, image data indicating an image
- Second storage means for storing image date and time data indicating the date and time related to imaging or recording in association with each other, and image data selected by the user among the image data stored in the second storage means Transmitting means for specifying the image date / time data and transmitting performance data associated with the performance date / time data having a predetermined relationship with the specified image date / time data in the first storage means to the performance device.
- a performance recording apparatus is provided.
- Another aspect of the present invention includes an imaging device that captures an image, a performance device that performs a performance based on performance data, and a performance recording device that records performance data indicating a performance performed by the performer.
- the performance recording device uses first storage means for storing performance data indicating a performance and performance date / time data related to the date / time when the performance was performed, image data indicating an image, and the imaging device.
- the associated image date / time data is identified, and the performance data associated with the performance date / time data having a predetermined relationship with the identified image date / time data in the first storage means. It has a transmission means for transmitting to the playing device to provide a play recording and reproducing system according to claim.
- a plurality of performance data indicating a performance and a plurality of performance date / time data associated with each of the plurality of performance data and associated with the respective dates / times at which the plurality of performances were performed are provided.
- a plurality of performances based on the image date / time data and the plurality of performance date / time data associated with the image data selected by the user from among the plurality of image data.
- a plurality of performance data indicating a performance and a plurality of performance date / time data associated with each of the plurality of performance data and associated with the respective dates / times at which the plurality of performances were performed are provided.
- one performance data is specified from the plurality of performance data,
- the performance method is characterized in that the specified one piece of performance data is transmitted.
- a plurality of performance data indicating a performance and a plurality of performance date / time data associated with each of the plurality of performance data and associated with the respective dates / times at which the plurality of performances were performed are provided.
- one performance data is specified from the plurality of performance data,
- a performance program comprising a command for transmitting the specified one performance data.
- the specification when the user specifies performance data to be reproduced, the specification can be easily performed visually.
- FIG. 6 is a diagram illustrating an example of displaying image data during performance playback in the imaging apparatus.
- FIG. 10 is a diagram illustrating another example when image data is displayed during performance playback in the imaging apparatus.
- FIG. 10 is a diagram illustrating another example when image data is displayed during performance playback in the imaging apparatus.
- FIG. 10 is a diagram illustrating another example when image data is displayed during performance playback in the imaging apparatus.
- FIG. 10 is a diagram illustrating another example when image data is displayed during performance playback in the imaging apparatus.
- FIG. 10 is a diagram illustrating another example when image data is displayed during performance playback in the imaging apparatus.
- FIG. 1 is a diagram showing an overall configuration of a performance recording / reproducing system 1 according to an embodiment of the present invention.
- the performance recording / reproducing system 1 includes a performance device 100, an imaging device 200, an image recording server device 300, a performance recording server device 400, a mobile communication network 500, and the Internet 600.
- the image recording server device 300 and the performance recording server device 400 constitute a performance recording device according to the present invention.
- the imaging device 200 captures an image of the performance.
- the performance data indicating the performance is recorded in the performance recording server device 400 together with the performance date and time at that time.
- image data indicating an image is recorded in the image recording server device 300 together with the imaging date and time at that time.
- the user visually selects a desired performance image from the images recorded in the image recording server device 300.
- performance data having a performance date and time close to the image capturing date and time of the selected image is specified by the performance recording server device 400, and the performance is reproduced by the performance device 100 based on the performance data.
- the performance recording / playback system 1 may include a plurality of performance devices 100, imaging devices 200, image recording server devices 300, and performance recording server devices 400. However, in FIG. Only one device is shown for prevention.
- the performance device 100 is a device that performs in response to user operations.
- the performance device 100 is an acoustic piano having an automatic performance function for performing performance based on performance data.
- the imaging device 200 is a device that captures an image.
- the imaging device 200 is a portable imaging device such as a mobile phone, a smartphone, or a tablet PC.
- the image capturing apparatus 200 includes a first communication function for exchanging information with the performance apparatus 100, and the image recording server apparatus 300 via the mobile communication network 500 and the Internet 600 (hereinafter abbreviated as a communication network). And a second communication function for communicating with the performance recording server device 400.
- the imaging apparatus 200 may communicate with the image recording server apparatus 300 and the performance recording server apparatus 400 via only the Internet 600 instead of the mobile communication network 500.
- the image recording server device 300 has a function of storing data received from the imaging device 200 via a communication network and transmitting the stored data in response to a request from the imaging device 200.
- the performance recording server device 400 has a function of storing data received from the performance device 100 via a communication network and transmitting the stored data in response to a request from the performance device 100 or the imaging device 200.
- the performance device 100 includes the same mechanism as that of a general acoustic piano, such as an action mechanism for striking a string according to the movement of a key on the keyboard and a damper for stopping vibration of the string, as shown in FIG. It has a simple electrical hardware configuration.
- the storage unit 102 is, for example, a nonvolatile storage unit such as a hard disk, and stores a performance device ID that uniquely identifies the performance device 100, and various information and files generated by the control unit 101.
- the first communication unit 105 communicates with the first communication unit 208 of the imaging apparatus 200 in accordance with a wireless communication standard such as infrared or Bluetooth (registered trademark) or a predetermined wired communication standard (for example, LAN).
- a wireless communication standard such as infrared or Bluetooth (registered trademark) or a predetermined wired communication standard (for example, LAN).
- the second communication unit 106 communicates with the image recording server device 300 and the performance recording server device 400 via a communication network using, for example, a LAN.
- the touch panel 103 is a user interface that displays a screen for operating the performance device 100 and receives an operation from the user.
- the user interface is not limited to the touch panel 103 and may be configured by a display and an operation unit.
- the sensor unit 107 has a sensor for detecting the movement of the keys on the keyboard.
- a sensor is provided for each key.
- the drive unit 108 has an actuator (for example, a solenoid) that drives a key of the keyboard.
- An actuator is provided for each key of the keyboard.
- the control unit 101 is a microcontroller provided with a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory).
- CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- FIG. 3 is a hardware configuration diagram of the imaging apparatus 200.
- the imaging apparatus 200 includes a display unit 201, an input unit 202, a sound collection unit 204, an imaging unit 205, a second communication unit 206, a sound emission unit 207, a first communication unit 208, a storage unit 209, and a control unit 210.
- the display unit 201 is a display device such as a liquid crystal display.
- the input unit 202 is realized by a numeric keypad, a touch panel, or the like, and accepts user operations.
- the sound collection unit 204 includes a microphone and a sound processing circuit and collects sound.
- the imaging unit 205 includes a lens, an image sensor, and a video signal processing circuit, and performs imaging.
- the second communication unit 206 is realized by an antenna or a radio signal processing circuit, and in accordance with a radio communication standard such as so-called 3G, LTE (Long Term Evolution), or wireless LAN (Local Area Network), the image recording server apparatus 300 via the communication network. And it communicates with the performance recording server apparatus 400.
- the first communication unit 208 communicates with the first communication unit 105 of the performance device 100 in accordance with a wireless communication standard such as infrared or Bluetooth (registered trademark) or a predetermined wired communication standard (for example, LAN).
- the sound emitting unit 207 is a speaker, which is used for voice communication and notifies the user of various information by voice.
- the storage unit 209 is a storage unit such as an EEPROM (Electronically Erasable and Programmable ROM) or a flash memory, and stores a program executed by the control unit 210. These programs may be provided and stored in the storage unit 209 via a storage medium or downloaded via the Internet or the like.
- the control unit 210 is a microcontroller that includes a CPU, a ROM, and a RAM, and controls the operation of each unit of the imaging apparatus 200. When the CPU executes a program stored in the ROM, for example, a time measuring function for measuring the date and time is realized.
- FIG. 4 is a block diagram illustrating a hardware configuration of the image recording server apparatus 300.
- the image recording server device 300 is a computer that includes a control unit 301, an input / output unit 302, a storage unit 303, and a communication unit 304.
- the control unit 301 includes an arithmetic device such as a CPU and a storage device such as a ROM and a RAM.
- the CPU controls the operation of each unit of the image recording server device 300 by executing a program stored in the ROM or the storage unit 303 using the RAM as a work area.
- the input / output unit 302 is an input device such as a keyboard and a mouse and a display device.
- the communication unit 304 is connected to a communication network and performs communication via the communication network.
- the storage unit 303 is a large-capacity nonvolatile storage unit such as a hard disk.
- the storage unit 303 stores a data group and a program group used by the control unit 301, for example, an image database.
- the storage unit 303 uses the image data indicating the image, the image date / time data indicating the date / time related to the imaging or recording of the image, the performance device ID that is identification information for identifying the performance device 100, and the performance recording / reproducing system 1. It functions as a second storage means for storing a service identification tag, which is tag information for identifying that the service is provided, in association with each other.
- FIG. 5 is a diagram showing an example of an image database.
- image date / time data image date / time data
- performance device ID image data
- image data image data indicating a service indicating a service provided by the performance recording / playback system 1.
- FIG. 6 is a block diagram showing a hardware configuration of the performance recording server device 400.
- the performance recording server apparatus 400 is a computer that includes a control unit 401, an input / output unit 402, a storage unit 403, and a communication unit 404.
- the control unit 401 includes an arithmetic device such as a CPU and a storage device such as a ROM and a RAM.
- the CPU controls the operation of each unit of the performance recording server device 400 by executing a program stored in the ROM or the storage unit 403 using the RAM as a work area.
- the input / output unit 402 is an input device such as a keyboard and a mouse and a display device.
- the communication unit 404 is connected to a communication network and performs communication via the communication network.
- the storage unit 403 is a large-capacity nonvolatile storage unit such as a hard disk.
- the storage unit 403 stores a data group and a program group used by the control unit 401, for example, a performance database.
- the storage unit 403 functions as a first storage unit that stores performance data indicating a performance and performance date data related to the date and time when the performance was performed in association with each other.
- FIG. 7 is a diagram showing an example of a performance database.
- a performance ID In the performance database, a performance ID, performance date / time data, performance device ID, and MIDI data are associated with each other.
- the performance ID is an identifier for identifying each performance.
- MIDI data is performance data indicating a performance in the performance device 100.
- the performance date / time data is data related to the date / time when the performance was performed, and here is data indicating the date / time when the recording of the performance was started.
- the performance device ID is a performance device ID that identifies the performance device 100.
- the control unit 301 of the image recording server device 300 and the control unit 401 of the performance recording server device 400 select the image selected by the user from the image data stored in the storage unit 303 (second storage unit) of the image recording server device 300.
- the image date / time data associated with the data is identified, and in the storage unit 403 (first storage means) of the performance recording server device 400, the image date / time data associated with the identified image date / time data is associated with the performance date / time data. It functions as a transmission means for transmitting performance data (MIDI data) to the performance device 100.
- FIG. 8 is a sequence diagram for explaining the operation of the entire system when recording a performance.
- the control unit 101 of the performance device 100 When a performer starts a performance using the performance device 100 (step S1), the control unit 101 of the performance device 100 generates MIDI data generated according to the performance result and date / time information indicating the date and time of the performance start. Then, performance information including the performance device ID of the performance device 100 is transmitted to the performance recording server device 400 (step S2).
- the control unit 401 of the performance recording server device 400 assigns a new performance ID to these performance information and starts recording in the storage unit 403 (step S3).
- a third party who listens to the performance of the performer images the state of the performance by the performer using the imaging device 200 (step S4).
- the control unit 210 of the imaging apparatus 200 records image information including image data indicating the captured image, date / time information indicating the date and time when the image is captured, a performance apparatus ID of the performance apparatus 100, and a service identification tag. It transmits to the server apparatus 300 (step S5).
- the performance device ID may be input to the imaging device 200 by the user, or may be set in the imaging device 200 in advance and stored in the storage unit 209.
- the control unit 301 of the image recording server device 300 records this image information in the storage unit 303 (step S6). Note that the performance device 100 may transmit the performance device ID to the imaging device 200 via the first communication function before step S5, and the imaging device 200 may store the performance device ID in the storage unit 209.
- step S7 When the performer finishes the performance using the performance device 100 (step S7), the control unit 101 of the performance device 100 notifies the performance recording server device 400 that the performance is finished (step S8). In response to this notification, the control unit 401 of the performance recording server device 400 ends the recording of the performance information in the storage unit 403 (step S9).
- FIG. 9 is a sequence diagram for explaining the operation of the entire system when playing a performance.
- the control unit 210 of the imaging apparatus 200 requests the image recording server apparatus 300 for a list of recorded image data (step S11).
- This request includes a service identification tag.
- the control unit 301 of the image recording server device 300 generates an image list in which the image data associated with the service identification tag is thumbnailed and transmits the image list to the imaging device 200 (step S12).
- This image list includes each image data, date / time data and performance device ID associated with the image data.
- the request for the image list may include a performance device ID as well as a service identification tag.
- control unit 301 of the image recording server device 300 in response to this request, the control unit 301 of the image recording server device 300 generates an image list in which the image data in which the service identification tag and the performance device ID are associated with each other is generated as a thumbnail, and transmits the image list to the imaging device 200. Send.
- the control unit 210 transmits a performance ID request including date / time data corresponding to the selected image data and a performance device ID to the performance recording server device 400 (step S14).
- the control unit 401 of the performance recording server device 400 specifies a performance ID in performance information including performance date / time data having a predetermined relationship with the image date / time data, among performance information including the same as the received performance device ID. (Step S15).
- performance date / time data indicating a date / time close to the date / time indicated by the image date / time data
- a performance ID in performance information including performance date / time data whose difference from the image date / time data is within a threshold value (for example, 5 minutes).
- the control unit 401 transmits the performance ID to the imaging device 200 (step S16).
- the control unit 210 of the imaging device 200 transmits the received performance ID to the performance device 100 (step S17).
- the control unit 101 of the performance device 100 transmits the received performance ID to the performance recording server device 400 (step S18).
- the control unit 401 of the performance recording server device 400 specifies MIDI data corresponding to the received performance ID (step S19) and transmits it to the performance device 100 (step S20).
- the control unit 101 of the performance device 100 performs automatic performance based on the received MIDI data (step S21).
- the imaging device 200 images the state of the performance.
- the performance data indicating the performance is recorded in the performance recording server device 400 together with the performance date and time at that time.
- image data indicating an image is recorded in the image recording server device 300 together with the imaging date and time at that time.
- the user wants to reproduce the performance, the user visually selects a desired performance image from the images recorded in the image recording server device 300.
- the performance recording server device 400 identifies performance data having a performance date and time close to the selected image capturing date and time, and the performance device 100 reproduces the performance based on the performance data. Therefore, when the user specifies performance data to be reproduced, the specification can be easily performed visually.
- the performance device 100 is an automatic performance piano provided with an acoustic piano mechanism, but the performance device 100 is not limited to this automatic performance piano.
- an electronic piano without an acoustic piano mechanism or an electronic keyboard may be used.
- the performance device 100 is not limited to a keyboard instrument, and may be another performance device as long as it can output MIDI data according to the performance of the performer.
- MIDI data is stored as performance data, but is not limited to MIDI data.
- MIDI data may be converted into audio data and stored, or a performance sound may be collected by a microphone, and the collected sound may be digitized and stored.
- the performance date / time data may be performance date / time data related to the date / time when the performance was performed.
- the performance date / time data represents the date and time, but is not limited to this configuration, and may be only the date or only the time.
- the performance date / time data may not be the date / time at which the performance recording is started, but may be the date / time at which the performance recording ends, the date / time during the performance recording period, or the date / time before / after the performance recording. In short, it may be a date and time that can specify a performance.
- the image date / time data may be image date / time data indicating the date / time related to image capturing or recording.
- the image date and time data represents the date and time, but is not limited to this configuration, and may be only the date or only the time. Also, it may be the date and time when the image was captured before the performance start or after the performance ended, instead of the date and time when the image was captured during the performance period. Further, it may be the date and time when it is recorded in the image recording server device 300 instead of the timing of imaging. In short, any date and time can be used as long as the correspondence between the image data and the performance data can be specified based on the performance date and time data and the image date and time data.
- the image data may be not only one for one performance but also plural.
- the image may be a still image or a moving image.
- the image data is not limited to the captured image data, and may be image data obtained by the user by some method such as downloading.
- the imaging device 200 captures a musical score
- the image recording server device 300 performs pattern matching between the captured image of the musical score and a musical score image that is read and stored in advance by a scanner.
- Image information of a musical score that is determined to be the same as or close to the captured image of the musical score may be included in the performance information.
- the music name of the music score determined to be the same as or close to the captured image of the music score by this pattern matching may be specified, and information indicating the specified music name may be included in the performance information.
- not only the image of the musical score but also the text name may be identified by recognizing the text by a well-known character recognition technique from the image of the character string (for example, the character string of the music name described in the booklet). .
- the music name included in the performance information may be displayed on the touch panel 103.
- the text recognized by the character recognition technology together with the captured image may be displayed on the touch panel 103.
- information other than the information described in the embodiment for example, user's voice may be included in the image information or performance information and stored.
- the image recording server device 300 and the performance recording server device 400 are separate devices, but they may be integrated performance recording devices.
- the date / time data and performance device ID corresponding to the selected image data are displayed.
- a performance ID request including the performance ID is transmitted to the performance recording device.
- the performance recording device specifies a performance ID in performance information including performance date / time data having a predetermined relationship with the image date / time data, among performance information including the same as the received performance device ID.
- the performance recording apparatus can specify the MIDI data corresponding to the performance ID, it may be transmitted to the performance apparatus 100.
- the image date / time data associated with the image data selected by the user among the image data stored in the storage unit 303 (second storage unit) of the image recording server device 300 is specified, and the performance recording server device 400
- the storage unit 403 (first storage means) there is one transmission means for transmitting performance data (MIDI data) associated with the specified image date / time data and performance date / time data having a predetermined relationship to the performance device 100. This is realized by a performance recording device.
- the “predetermined relationship” when specifying performance date / time data that has a predetermined relationship with image date / time data is not limited to the case where the difference in date / time is within a threshold, as exemplified in the embodiment. Any relationship may be used as long as the correspondence between the image data and the performance data can be specified based on the data.
- the performance data is specified as performance data having a predetermined relationship with the image date / time data
- the image date / time data does not represent the date / time between the performance start date / time and the performance end date / time of the performance data
- the performance data whose performance start date / time is later than the date / time represented by the image date / time data and the performance end date / time are The performance data that is earlier than the date and time represented by the image date and time data may be compared, and the closer performance data may be specified as the performance data having a predetermined relationship with the image date and time data.
- step S5 when the performance device 100 and the imaging device 200 hold position information, the imaging device 200 does not depend on the user input, and the performance device of the performance device 100 closest to the imaging device 200 is used.
- the ID may be included in the image information and transmitted to the image recording server device 300.
- control unit 210 may request the image recording server apparatus 300 to transmit image data including the performance apparatus ID corresponding to the selected image data to the imaging apparatus 200. Good. Thereafter, the control unit 210 may realize the slide show function by displaying the received plurality of image data on the display unit 201 at predetermined intervals in order from the oldest date and time information.
- the configuration in which the performance device 100 performs an automatic performance mainly in response to the user's selection of image data has been described.
- the performance data is reproduced on a terminal such as the imaging device 200. It may be configured.
- the performance recording server 400 transmits performance data specified according to the user's selection of image data to the imaging device 200, and the imaging device 200 reproduces the performance data.
- the terminal such as the imaging apparatus 200 may be configured to display image data related to the performance data while the performance data is being reproduced.
- the performance recording server device 400 identifies at least one image data from among a plurality of image data based on performance date / time data associated with the identified performance data, and causes the imaging device 200 to perform at least the image data.
- One image data is transmitted together with image date / time data associated with the at least one image data. Then, the imaging apparatus 200 displays the at least one image data when reproducing the performance data.
- FIG. 10 when image data (image A) representing image date / time data representing the date / time between the performance start date / time and performance end date / time of the performance data is selected, FIG. As shown below, the image data may be displayed from the start to the end of the performance of the performance data.
- the time position of the performance data and the image data is shown in the upper part, and the lower part of the figure shows the time position of the display of the performance data and the image data in the display. That is, in FIG. 10, the movement from the left direction to the right direction corresponds to the passage of time.
- the relationship between the upper diagram and the lower diagram is the same in FIGS. 11 to 15 described later.
- image data representing image date / time data representing the date / time between the performance start date / time and performance end date / time of certain performance data
- image data representing image date / time data representing the date / time between the performance start date / time and performance end date / time of certain performance data
- the 1 The image data (image B) may be displayed. Note that during the performance data reproduction, the display of the one image data and the other image data may be continuously displayed until the next image is displayed. In this case, as shown in FIGS.
- image data representing image date / time data representing the date / time between the performance start date / time and performance end date / time of certain performance data.
- image data image C
- image C image data that is closer in time than other performance data exists before or after the performance start date and time of the performance
- image C is selected, as shown in FIG.
- the image A and the image B may be displayed at the timing of displaying the image A and the image B, respectively. Note that the timings for displaying the images A and B are the same as those described above, and a description thereof will be omitted.
- image data representing image date / time data representing the date / time between the performance start date / time and performance end date / time of certain performance data.
- image data images C and D
- image D when image D is selected, as shown in FIG. You may comprise so that the image A and the image B may be displayed at the timing which displays the image A and the image B after displaying D. Note that the timings for displaying the images A and B are the same as those described above, and a description thereof will be omitted.
- image data representing image date / time data representing the date / time between the performance start date / time and the performance end date / time of certain performance data.
- image data images C and D
- image data may be displayed at substantially equal intervals in time. Note that the order in this case may be, for example, an order corresponding to the date and time represented by the image date and time data of the image data.
- the selected image data may be displayed as the image data displayed at the start of performance of performance data or during standby of performance data.
- the lower part of FIG. 15 shows a case where the selected image data is image A.
- the selected image data may be displayed during performance standby.
- the examples shown in FIGS. 10 to 15 may be used in combination as long as they do not contradict each other.
- the present invention can also be implemented in the form of an information processing method performed by each device or a program for causing a computer to function as each device.
- a program may be provided in a form recorded on a recording medium such as an optical disc, or may be provided in a form such that the program is downloaded to a computer via a network such as the Internet, and the program can be installed and used.
- the performance data in the claims includes other data related to sound such as sound data representing sound in addition to music performance data.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Television Signal Processing For Recording (AREA)
- Electrophonic Musical Instruments (AREA)
Abstract
Description
[演奏記録再生システム1の全体構成]
図1は、本発明の一実施形態に係る演奏記録再生システム1の全体構成を示した図である。演奏記録再生システム1は、演奏装置100と、撮像装置200と、画像記録サーバ装置300と、演奏記録サーバ装置400と、移動通信網500と、インターネット600とを備えている。画像記録サーバ装置300及び演奏記録サーバ装置400は、本発明に係る演奏記録装置を構成する。この演奏記録再生システム1において、演奏者が演奏装置100を用いて演奏するときに、撮像装置200がその演奏の様子を撮像する。演奏を示す演奏データは、そのときに演奏日時とともに、演奏記録サーバ装置400に記録される。また、画像を示す画像データは、そのときの撮像日時とともに、画像記録サーバ装置300に記録される。演奏を再生したい場合、ユーザは、画像記録サーバ装置300に記録されている画像の中から所望する演奏時の画像を視覚的に選択する。そうすると、選択された画像の撮像日時に近い演奏日時の演奏データが演奏記録サーバ装置400にて特定され、その演奏データに基づいて演奏装置100にて演奏が再生されるようになっている。なお、演奏記録再生システム1には、演奏装置100、撮像装置200、画像記録サーバ装置300及び演奏記録サーバ装置400を複数備えていてもよいが、図1においては、図面が繁雑になるのを防ぐため、それぞれ一つの装置のみを示している。
演奏装置100は、鍵盤の鍵の動きに応じて弦を打弦するアクション機構や、弦の振動を止めるダンパなど、一般的なアコースティックピアノが有する機構と同じ機構を備えるほか、図2に示すような電気的なハードウェア構成を備えている。記憶部102は、例えばハードディスクなどの不揮発性記憶手段であり、演奏装置100を一意に識別する演奏装置IDや、制御部101が生成する各種情報やファイルを記憶する。第1通信部105は、例えば赤外線やブルートゥース(登録商標)などの無線通信規格又は所定の有線通信規格(例えばLAN)に従って、撮像装置200の第1通信部208と通信を行う。第2通信部106は、例えばLANにより通信網を介して画像記録サーバ装置300や演奏記録サーバ装置400と通信を行う。タッチパネル103は、演奏装置100を操作するための画面などを表示してユーザからの操作を受け付けるユーザインタフェースである。なお、ユーザインタフェースはタッチパネル103に限らずディスプレイと操作部によって構成してもよい。
図3は撮像装置200のハードウェア構成図である。撮像装置200は、表示部201、入力部202、収音部204、撮像部205、第2通信部206、放音部207、第1通信部208、記憶部209及び制御部210を備えている。表示部201は、液晶ディスプレイ等の表示装置である。入力部202は、テンキーやタッチパネルなどによって実現され、ユーザによる操作を受け付ける。収音部204は、マイクロフォンや音声処理回路からなり、収音する。撮像部205は、レンズやイメージセンサや映像信号処理回路からなり、撮像を行う。第2通信部206は、アンテナや無線信号処理回路によって実現され、いわゆる3GやLTE(Long Term Evolution)、無線LAN(Local Area Network)といった無線通信規格に従って、通信網を介して画像記録サーバ装置300及び演奏記録サーバ装置400と通信を行う。第1通信部208は、例えば赤外線やブルートゥース(登録商標)などの無線通信規格又は所定の有線通信規格(例えばLAN)に従って、演奏装置100の第1通信部105と通信を行う。放音部207はスピーカであり、音声通信に用いられるほか、各種情報を音声でユーザに報知する。記憶部209は、例えばEEPROM(Electronically Erasable and Programmable ROM)やフラッシュメモリなどの記憶手段であり、制御部210によって実行されるプログラムが記憶される。これらのプログラムは、記憶媒体によりあるいはインターネット等を介したダウンロードにより、記憶部209に提供されて記憶されてもよい。制御部210は、CPU、ROM及びRAMを備えたマイクロコントローラであり、撮像装置200の各部の動作を制御する。CPUがROMに記憶されているプログラムを実行することにより、例えば日時を計る計時機能が実現される。
図4は、画像記録サーバ装置300のハードウェア構成を示すブロック図である。画像記録サーバ装置300は、制御部301と、入出力部302と、記憶部303と、通信部304とを備えたコンピュータである。制御部301は、CPU等の演算装置と、ROM及びRAMなどの記憶装置とを備えている。CPUは、RAMをワークエリアとして用いてROMや記憶部303に記憶されたプログラムを実行することによって、画像記録サーバ装置300の各部の動作を制御する。入出力部302は、キーボードやマウス等の入力装置と表示装置である。通信部304は通信網に接続されており、通信網を介して通信を行う。記憶部303は、例えばハードディスク等の大容量で不揮発性の記憶手段である。記憶部303は、制御部301が用いるデータ群やプログラム群を記憶しており、例えば画像データベースを記憶している。記憶部303は、画像を示す画像データと、当該画像の撮像または記録に関連する日時を示す画像日時データと、演奏装置100を識別する識別情報である演奏装置IDと、演奏記録再生システム1によって提供されるサービスの対象であることを識別するためのタグ情報であるサービス識別タグとを対応付けて記憶する第2記憶手段として機能する。
図6は、演奏記録サーバ装置400のハードウェア構成を示すブロック図である。演奏記録サーバ装置400は、画像記録サーバ装置300と同様に、制御部401と、入出力部402と、記憶部403と、通信部404とを備えたコンピュータである。制御部401は、CPU等の演算装置と、ROM及びRAMなどの記憶装置とを備えている。CPUは、RAMをワークエリアとして用いてROMや記憶部403に記憶されたプログラムを実行することによって、演奏記録サーバ装置400の各部の動作を制御する。入出力部402は、キーボードやマウス等の入力装置と表示装置である。通信部404は通信網に接続されており、通信網を介して通信を行う。記憶部403は、例えばハードディスク等の大容量で不揮発性の記憶手段である。記憶部403は、制御部401が用いるデータ群やプログラム群を記憶しており、例えば演奏データベースを記憶している。記憶部403は、演奏を示す演奏データと、当該演奏がなされた日時に関連する演奏日時データとを対応付けて記憶する第1記憶手段として機能する。
図8は、演奏を記録するときのシステム全体の動作を説明するシーケンス図である。まず、演奏者が演奏装置100を用いた演奏を開始すると(ステップS1)、演奏装置100の制御部101は、演奏結果に応じて生成したMIDIデータと、その演奏開始の日時を示す日時情報と、その演奏装置100の演奏装置IDとを含む演奏情報を演奏記録サーバ装置400に送信する(ステップS2)。演奏記録サーバ装置400の制御部401は、これらの演奏情報に新規の演奏IDを割り当てて、記憶部403への記録を開始する(ステップS3)。
図9は、演奏を再生するときのシステム全体の動作を説明するシーケンス図である。まず、ユーザが撮像装置200において所定の操作を行うと、撮像装置200の制御部210は画像記録サーバ装置300に対して、記録している画像データのリストを要求する(ステップS11)。この要求には、サービス識別タグが含まれている。画像記録サーバ装置300の制御部301は、この要求に応じて、上記サービス識別タグが対応付けられている画像データをサムネイル化した画像リストを生成して撮像装置200に送信する(ステップS12)。この画像リストには、それぞれの画像データと、これに対応付けられた日時データ及び演奏装置IDが含まれている。なお、この画像リストの要求には、サービス識別タグだけでなく演奏装置IDを含んでいてもよい。その場合、画像記録サーバ装置300の制御部301は、この要求に応じて、上記サービス識別タグ及び演奏装置IDが対応付けられている画像データをサムネイル化した画像リストを生成して撮像装置200に送信する。
上述の実施形態を以下のように変形して本発明を実施してもよい。なお、上述した実施形態及び以下の変形例は、各々を組み合わせてもよい。
Claims (13)
- 複数の演奏データと、該複数の演奏データにそれぞれ関連付けられるとともに、前記複数の演奏がなされたそれぞれの日時に関連する複数の演奏日時データとを取得する第1の取得手段と、
画像を示す複数の画像データと、該複数の画像データにそれぞれ関連付けられるとともに、該複数の画像の撮像または記録に関連するそれぞれの日時を示す複数の画像日時データと、を取得する第2の取得手段と、
前記複数の画像データのうちユーザによって選択された前記画像データに関連付けられた前記画像日時データ及び前記複数の演奏日時データに基づいて、前記複数の演奏データのうちから1の演奏データを特定する特定手段と、
前記特定された1の演奏データを送信する送信手段と、
を含むことを特徴とする演奏システム。 - 前記演奏システムは、更に、演奏を行う演奏手段を有する演奏装置を含み、
前記複数の演奏データのうちの少なくとも1の演奏データは、前記演奏手段による演奏に基づいて生成される、
ことを特徴とする請求項1記載の演奏システム。 - 前記演奏手段は、前記送信された1の演奏データに基づいて演奏することを特徴とする請求項2記載の演奏システム。
- 前記演奏システムは、撮像手段と、該撮像手段の撮像に応じて画像データを生成する画像データ生成手段と、を含む撮像装置を含み、
前記生成された画像データは、前記複数の画像データのうち少なくとも1の画像データに含まれる、
ことを特徴とする請求項1記載の演奏システム。 - 前記撮像装置は、更に、前記送信された1の演奏データを再生する再生手段を含む、
ことを特徴とする請求項4記載の演奏システム。 - 前記特定手段は、更に、前記特定された1の演奏データに関連付けられた演奏日時データに基づいて、前記複数の画像データのうち少なくとも1の画像データを特定し、
前記送信手段は、更に、前記特定された少なくとも1の画像データを送信する、
ことを特徴とする請求項5記載の演奏システム。 - 前記撮像装置は、更に、前記送信された演奏データの再生中に、前記特定された少なくとも1の画像データに応じた画像情報を表示する表示手段を含む、
ことを特徴とする請求項6記載の演奏システム。 - 前記表示手段は、前記ユーザによって選択された前記画像データに応じた画像情報を表示した後、前記画像データに関連付けられた画像日時データの表す日時に応じた順序で前記少なくとも1の画像データに応じた画像情報を表示することを特徴とする請求項7記載の演奏システム。
- 前記表示手段は、更に、ユーザによって選択された前記画像データに応じた画像情報及び前記少なくとも1の画像データに応じた画像情報を、前記送信された演奏データの再生中、時間的に略等間隔で表示することを特徴とする請求項8記載の演奏システム。
- 前記各演奏日時データは、それぞれ前記各演奏の開始日時と前記演奏の終了日時とを表し、
前記特定手段は、前記選択された前記画像データに関連付けられた前記画像日時データが表す日時と前記各演奏日時データの開始日時と終了日時に基づいて、前記演奏データを特定する、
ことを特徴とする請求項1記載の演奏システム。 - 複数の演奏データと、該複数の演奏データにそれぞれ関連付けられるとともに、前記複数の演奏がなされたそれぞれの日時に関連する複数の演奏日時データとを取得し、
画像を示す複数の画像データと、該複数の画像データにそれぞれ関連付けられるとともに、該複数の画像の撮像または記録に関連するそれぞれの日時を示す複数の画像日時データと、を取得し、
前記複数の画像データのうちユーザによって選択された前記画像データに関連付けられた前記画像日時データ及び前記複数の演奏日時データに基づいて、前記複数の演奏データのうちから1の演奏データを特定し、
前記特定された1の演奏データを送信する、
ことを特徴とする演奏方法。 - 複数の演奏データと、該複数の演奏データにそれぞれ関連付けられるとともに、前記複数の演奏がなされたそれぞれの日時に関連する複数の演奏日時データとを取得し、
画像を示す複数の画像データと、該複数の画像データにそれぞれ関連付けられるとともに、該複数の画像の撮像または記録に関連するそれぞれの日時を示す複数の画像日時データと、を取得し、
前記複数の画像データのうちユーザによって選択された前記画像データに関連付けられた前記画像日時データ及び前記複数の演奏日時データに基づいて、前記複数の演奏データのうちから1の演奏データを特定し、
前記特定された1の演奏データを送信する、
命令を含むことを特徴とする演奏プログラム。 - 請求項12に記載された演奏プログラムを記録したコンピュータ読み取り可能な記録媒体。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015522919A JPWO2014203870A1 (ja) | 2013-06-17 | 2014-06-16 | 演奏システム、演奏方法及び演奏プログラム |
US14/898,588 US20160133243A1 (en) | 2013-06-17 | 2014-06-16 | Musical performance system, musical performance method and musical performance program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013-127008 | 2013-06-17 | ||
JP2013127008 | 2013-06-17 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014203870A1 true WO2014203870A1 (ja) | 2014-12-24 |
Family
ID=52104602
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/065945 WO2014203870A1 (ja) | 2013-06-17 | 2014-06-16 | 演奏システム、演奏方法及び演奏プログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US20160133243A1 (ja) |
JP (1) | JPWO2014203870A1 (ja) |
WO (1) | WO2014203870A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017057318A1 (ja) * | 2015-09-30 | 2017-04-06 | ヤマハ株式会社 | 再生制御方法及び再生制御システム |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6801225B2 (ja) * | 2016-05-18 | 2020-12-16 | ヤマハ株式会社 | 自動演奏システムおよび自動演奏方法 |
US10872115B2 (en) * | 2018-03-19 | 2020-12-22 | Motorola Mobility Llc | Automatically associating an image with an audio track |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03196192A (ja) * | 1989-12-26 | 1991-08-27 | Brother Ind Ltd | 演奏記録装置 |
JP2005020070A (ja) * | 2003-06-23 | 2005-01-20 | Sony Corp | 情報処理装置、撮像装置およびコンテンツ選択方法 |
JP2005026927A (ja) * | 2003-06-30 | 2005-01-27 | Casio Comput Co Ltd | シーケンス制御データ生成装置、演奏撮影装置、及びプログラム |
JP2008233574A (ja) * | 2007-03-21 | 2008-10-02 | Yamaha Corp | 演奏記録装置及びプログラム |
JP2009117973A (ja) * | 2007-11-02 | 2009-05-28 | Fujifilm Corp | 再生装置および再生方法 |
JP2010054686A (ja) * | 2008-08-27 | 2010-03-11 | Yamaha Corp | 電子音楽装置 |
JP2012103726A (ja) * | 2012-01-26 | 2012-05-31 | Yamaha Corp | 演奏記録装置及びプログラム |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7288712B2 (en) * | 2004-01-09 | 2007-10-30 | Yamaha Corporation | Music station for producing visual images synchronously with music data codes |
US20060075034A1 (en) * | 2004-09-24 | 2006-04-06 | Harri Lakkala | Method and apparatus for creating and storing personal information relating to earth shaking events |
US7802205B2 (en) * | 2005-01-07 | 2010-09-21 | At&T Intellectual Property I, L.P. | Graphical chronological path presentation |
US8145034B2 (en) * | 2005-03-02 | 2012-03-27 | Sony Corporation | Contents replay apparatus and contents replay method |
JP2007265341A (ja) * | 2006-03-30 | 2007-10-11 | Sony Corp | コンテンツ利用方法、コンテンツ利用装置、コンテンツ記録方法、コンテンツ記録装置、コンテンツ提供システム、コンテンツ受信方法、コンテンツ受信装置およびコンテンツデータフォーマット |
US7982909B2 (en) * | 2006-04-21 | 2011-07-19 | Eastman Kodak Company | Method for automatically generating a dynamic digital metadata record from digitized hardcopy media |
US8170239B2 (en) * | 2007-02-14 | 2012-05-01 | Ubiquity Holdings Inc. | Virtual recording studio |
US8026436B2 (en) * | 2009-04-13 | 2011-09-27 | Smartsound Software, Inc. | Method and apparatus for producing audio tracks |
WO2012093497A1 (ja) * | 2011-01-07 | 2012-07-12 | ヤマハ株式会社 | 自動演奏装置 |
JP5779938B2 (ja) * | 2011-03-29 | 2015-09-16 | ソニー株式会社 | プレイリスト作成装置、プレイリスト作成方法及びプレイリスト作成プログラム |
JP2014228750A (ja) * | 2013-05-23 | 2014-12-08 | ヤマハ株式会社 | 演奏記録システム、演奏記録方法および楽器 |
-
2014
- 2014-06-16 WO PCT/JP2014/065945 patent/WO2014203870A1/ja active Application Filing
- 2014-06-16 JP JP2015522919A patent/JPWO2014203870A1/ja active Pending
- 2014-06-16 US US14/898,588 patent/US20160133243A1/en not_active Abandoned
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03196192A (ja) * | 1989-12-26 | 1991-08-27 | Brother Ind Ltd | 演奏記録装置 |
JP2005020070A (ja) * | 2003-06-23 | 2005-01-20 | Sony Corp | 情報処理装置、撮像装置およびコンテンツ選択方法 |
JP2005026927A (ja) * | 2003-06-30 | 2005-01-27 | Casio Comput Co Ltd | シーケンス制御データ生成装置、演奏撮影装置、及びプログラム |
JP2008233574A (ja) * | 2007-03-21 | 2008-10-02 | Yamaha Corp | 演奏記録装置及びプログラム |
JP2009117973A (ja) * | 2007-11-02 | 2009-05-28 | Fujifilm Corp | 再生装置および再生方法 |
JP2010054686A (ja) * | 2008-08-27 | 2010-03-11 | Yamaha Corp | 電子音楽装置 |
JP2012103726A (ja) * | 2012-01-26 | 2012-05-31 | Yamaha Corp | 演奏記録装置及びプログラム |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017057318A1 (ja) * | 2015-09-30 | 2017-04-06 | ヤマハ株式会社 | 再生制御方法及び再生制御システム |
JPWO2017057318A1 (ja) * | 2015-09-30 | 2018-04-19 | ヤマハ株式会社 | 再生制御方法及び再生制御システム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2014203870A1 (ja) | 2017-02-23 |
US20160133243A1 (en) | 2016-05-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9691429B2 (en) | Systems and methods for creating music videos synchronized with an audio track | |
JP5055901B2 (ja) | 携帯型再生装置、関連情報通知方法および関連情報通知プログラム | |
US9576564B2 (en) | Performance recording apparatus | |
JP2010288015A (ja) | 情報処理装置、情報処理方法及び情報処理プログラム | |
JP2017129720A (ja) | 情報処理システム、情報処理装置、情報処理方法および情報処理プログラム | |
WO2014203870A1 (ja) | 演奏システム、演奏方法及び演奏プログラム | |
JP5169239B2 (ja) | 情報処理装置および方法、並びにプログラム | |
KR20100065577A (ko) | 녹음 기능을 수행하는 단말기 및 그 단말기의 이미지 처리 방법 | |
JP4941524B2 (ja) | 投稿データ作成装置、及び、その投稿データ作成装置と投稿サーバとから構成される投稿システム | |
JP2013054334A (ja) | 電子機器 | |
JP5963200B2 (ja) | プレイリスト生成装置及びプレイリスト生成用プログラム | |
JP6110731B2 (ja) | ジェスチャーによるコマンド入力識別システム | |
JP5949823B2 (ja) | 情報処理装置、プログラム | |
JP7226709B2 (ja) | 映像制御システム、及び映像制御方法 | |
JP6117621B2 (ja) | 情報処理装置、情報処理方法及び情報処理プログラム | |
JP2010008893A (ja) | 電子音楽装置 | |
JP5338312B2 (ja) | 自動演奏同期装置、自動演奏鍵盤楽器およびプログラム | |
JP2016071235A (ja) | カラオケ管理システム、プログラム、及び、カラオケシステム | |
JP2015191160A (ja) | カラオケ用プログラム、情報処理装置及びホスト装置 | |
JP5738664B2 (ja) | コンテンツ再生制御装置、コンテンツ再生制御方法、およびプログラム | |
US20080279526A1 (en) | Record/playback apparatus and control method therefor | |
JP5615115B2 (ja) | カラオケ装置及びカラオケシステム | |
JP2008042455A (ja) | 記録装置及び記録方法 | |
JP6642215B2 (ja) | 楽曲選曲装置、カラオケシステム及び楽曲選曲用プログラム | |
JP6699137B2 (ja) | データ管理装置、コンテンツ再生装置、コンテンツ再生方法、及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14812908 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015522919 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14898588 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14812908 Country of ref document: EP Kind code of ref document: A1 |