JP2020166911A - Sound story generation system, and program - Google Patents

Abstract

To provide a sound story generation system and a program capable of generating a sound story with enhanced originality by a user in comparison with a simple after-recording function.SOLUTION: A sound story generation system includes: collected sound storage means for storing sounds acquired by a user; and guide means for guiding the user so that an original sound story can be generated by combining multiple sounds stored in the collected sound storage means.SELECTED DRAWING: Figure 4

Description

The present invention relates to a sound story generation system and a program.

Conventionally, there is an after-recording (so-called dubbing) technology that records lines and music according to the screen of a story such as a movie.
For example, Patent Document 1 describes an example of a device for purely experiencing a voice actor while enjoying a sense of unity with a story. This device is provided with a function of playing a voice other than the cast selected by the player and a function of displaying only the telop corresponding to the dialogue of the cast selected by the player at the timing when the cast selected by the player is uttered. ing. Therefore, the player can experience dubbing simply by speaking according to the telop. Since moving images such as animations and dramas are displayed on the display screen, the player can enjoy a sense of unity with the story.

Japanese Unexamined Patent Publication No. 2006-346284

The above-mentioned device distinguishes between the cast selected by the player and the cast not selected by the player, and controls the reproduction of the dialogue and the output of the telop for each of them. Therefore, if the player does not utter the dialogue of the cast selected by the player, the dialogue of the corresponding portion will be in a missing state.
Currently, as an educational material, there is an audiobook that records old stories. Audiobooks can be enjoyed in various ways depending on the age of the child. For example, it is funny to see a small child uttering a line or sound of interest in time with the reproduced sound, which is a fun memory for parents and children. Also, if the child is a little older, he may intentionally change the dialogue and utter. This recording of the child's voice is both a family memory and a record of the child's growth.

By the way, children's interest in dialogue and sound is often irrelevant to casting. For example, they often utter only the lines of interest and the sounds of animals of interest. For example, the lines spoken by a child may be only a part of a certain cast or a part of a plurality of casts.
Also, even when targeting the same story, children's interests vary from day to day and from age to age.
In this way, even in a story with a fixed synopsis, the impression of the completed story will differ depending on the curiosity and imagination of the child, and the difference in the child who utters.

An object of the present invention is to generate a sound story with enhanced originality by the user as compared with a simple after-recording function.

The invention according to claim 1 makes it possible to generate a sound story file in which a collected sound storage means for storing a plurality of sounds collected by a user and a plurality of sounds stored in the collected sound storage means are combined. , A sound story generation system characterized by being provided with a guiding means for guiding the user.
According to the second aspect of the present invention, the collected sound storage means stores a plurality of sounds collected by the user in an identifiable state, and the guiding means collects the sounds as a part of a preformed sound story. A part of a sound story or a preformed sound story in which a specific sound is selected and inserted from a plurality of sounds stored in a state identifiable by the sound storage means is stored in a state identifiable by the collected sound storage means. The sound story generation system according to claim 1, wherein the user is prompted to generate a sound story in which a specific sound is selected and replaced from a plurality of sounds.
The invention according to claim 3 is the sound story generation system according to claim 1, wherein the guidance means outputs a region into which a sound can be inserted by the user so that the user can identify the area.
The invention according to claim 4 stores a sound story in which the recorded sound is inserted into the area when the sound is recorded by the user's operation during the reproduction of the area in which the sound collected by the user can be inserted. , The sound story generation system according to claim 3.
The invention according to claim 5 further includes a processing means that enables the user to process the sound stored in the collected sound storage means, and the guiding means inserts the sound processed by the processing means. The sound story generation system according to claim 1, wherein the user is prompted to generate the sound story.
The invention according to claim 6 further includes a sound story storage means for storing the generated sound story, and the plurality of sound stories stored in the sound story storage means are stored in a state in which the user can identify them. The sound story generation system according to claim 1, wherein the sound story is generated.
The invention according to claim 7 is such that a computer can generate a sound story file in which a function of storing a sound acquired by a user in a storage medium and a plurality of sounds stored in the storage medium are combined. , A program that executes a function to guide the user.

According to the invention of claim 1, it is possible to generate a sound story with enhanced originality by the user as compared with a simple after-recording function.
According to the invention of claim 2, the sound story generated by selectively inserting a sound into a part of a preformed story or selectively replacing a part of the preformed story. The originality can be enhanced.
According to the invention of claim 3, since the area where the sound can be inserted is known, the image of the sound to be collected becomes easy.
According to the invention of claim 4, it is possible to promote the generation of a highly original sound story.
According to the invention of claim 5, since the existing sound can be processed and utilized, the originality of the generated sound story can be enhanced.
According to the invention of claim 6, the generated sound story can be utilized as a memory.
According to the invention of claim 7, it is possible to generate a sound story with enhanced originality by the user as compared with a simple after-recording function.

It is a figure explaining the outline of the network system assumed in Embodiment 1. FIG. It is a figure which shows the configuration example of the terminal used in Embodiment 1. FIG. It is a figure which shows the configuration example of the sound collecting apparatus used in Embodiment 1. FIG. It is a figure explaining the functional configuration of the control unit which constitutes a terminal. It is a flowchart which shows an example of the processing operation which is executed when collecting a sound material. It is a figure explaining the example of the screen which guides the collection of a sound material. It is a flowchart which shows an example of the processing operation executed when editing a downloaded audiobook. It is a figure explaining the example of the screen of the time point T1 which selects an audiobook, and the time point T2 which receives an instruction to play an audiobook. It is a figure explaining the example of the screen of the time point T3 at which the area which cannot be replaced is reproduced, and the time point T4 where the area where replacement is possible is reproduced. It is a figure explaining the example of the screen which is displayed when the replacement instruction is received. It is a figure explaining another example of the screen displayed when the replacement instruction is received. It is a figure explaining the example of the screen displayed in the region part where sound can be added. It is a figure explaining the example of the screen which is displayed when the instruction to add a sound is received. It is a figure explaining the relationship between the area which can be replaced and the area which the user actually instructed the replacement. (A) shows a predetermined arrangement of a replaceable area in the audiobook, and (B) shows an area in which the user actually instructed the replacement or the like. It is a figure which shows the example of the selection screen of the audio book to play. It is a figure explaining the case where there is a sound material replaced by a user in the area which can be replaced, and the case where there is not. (A) shows the case where there is no sound material replaced by the user, and (B) shows the case where there is sound material replaced by the user. It is a figure explaining the case where there is a sound material inserted by a user in the region which can be inserted, and the case where there is not. (A) shows the case where there is no sound material inserted by the user, and (B) shows the case where there is sound material inserted by the user.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Embodiment 1>
<Overall system configuration>
FIG. 1 is a diagram for explaining an outline of the network system 1 assumed in the first embodiment.
The network system 1 shown in FIG. 1 is composed of an audio file management server 20 connected to the Internet 10, a terminal 30 operated by a user, and a sound collecting device 40 operated by a child of the user.
The audio file management server 20 in the present embodiment is a server that manages a file (hereinafter referred to as an "audio file") in which a voice for reading a book or the like is recorded as data for distribution. The audio file management server 20, which is a server, has a computer as a basic configuration. In the case of FIG. 1, the audio file management server 20 is one, but a plurality of devices may cooperate to operate as the audio file management server 20.

In the present embodiment, audio files that are units of transactions with users are also collectively referred to as audio books. An audiobook may be composed of one audio file or a plurality of audio files.
In the present embodiment, a kind of audiobook in which the story is developed by the dialogue of the characters is called a sound story. Sound stories include, for example, old stories and fairy tales.
Further, the audio book distributed by the audio file management server 20 is provided with information indicating an area portion in which the user can freely insert a sound or an area portion in which the original sound can be replaced. It shall be. The audio book here is an example of an audio information file.

An audiobook in which an insertable area portion or a replaceable area portion is defined is an example of an editable sound story file. In the following, the voice recorded in the file before the user inserts the sound or replaces the sound is referred to as the original voice or the original voice.
The side that distributes the audiobook determines in advance which area portion should be an insertable region portion or a replaceable region portion. Most of the area part here is dialogue. However, the area where the user can insert or replace the sound does not have to be all the lines appearing in the audio book, and does not have to be limited to the lines of a specific character. For example, it may be a part of narration.

The terminal 30 in the present embodiment is a smartphone, a tablet terminal, an audio player, or the like that is mainly operated by a user who downloads an audio book as an educational teaching material. The terminal 30 is provided with a function capable of accessing the audio file management server 20 via the Internet 10 and downloading the above-mentioned audio book. However, the connection with the audio file management server 20 may be realized via another device.
The sound collecting device 40 in the present embodiment is a device mainly used by a child for recording sound, and is provided with a function of transmitting an audio file corresponding to the recorded sound to the terminal 30.
The sound collecting device 40 takes various forms according to the age, sex, and the like of the child to be used. For example, the sound collecting device 40 includes a pistol-type sound collector whose trigger is a recording switch, a sound collector composed of a microphone and a recording switch arranged at the focal point of a parabolic sound collecting plate, and a part of the body. It may take the form of a stuffed sound collector that starts recording when you press.
In the case of FIG. 1, Bluetooth (registered trademark), which is one of the wireless communication standards, is used for communication between the terminal 30 and the sound collecting device 40.
The sound collecting device 40 is not essential, and the sound may be collected using only the terminal 30. The terminal 30 and the sound collecting device 40 in this embodiment are examples of a sound story generation system.

<Configuration of terminal 30 and sound collecting device 40>
FIG. 2 is a diagram showing a configuration example of the terminal 30 used in the first embodiment.
The terminal 30 in the present embodiment includes a control unit 301 that controls the operation of the entire device, a non-volatile storage unit 302 that stores data, a display unit 303 that is used for displaying a user interface screen, and a user operation. It has an operation reception unit 304 that receives an electric signal, a speaker 305 that reproduces an electric signal as sound, a microphone 306 that converts the sound into an electric signal, and a communication interface (= communication IF) 307.

The control unit 301 in the present embodiment is used as a work area, a CPU (= Central Processing Unit) 311 and a ROM (= Read Only Memory) 312 in which firmware, a BIOS (= Basic Input Output System), and the like are stored. It has a RAM (= Random Access Memory) 313. The control unit 301 functions as a so-called computer. The ROM 312 is a non-volatile, rewritable semiconductor memory.
The storage unit 302 is composed of a non-volatile rewritable semiconductor memory or the like. For example, audiobook data, sound data recorded by the microphone 306, and the like are stored in the storage unit 302. The storage unit 302 here is an example of the collected sound storage means and also an example of the sound story storage means. The storage unit 302 is also an example of the post-replacement voice storage means.

The display unit 303 is composed of, for example, a liquid crystal display or an organic EL display. Information that supports the operation by the user is displayed on the display unit 303.
The operation reception unit 304 is composed of, for example, a touch sensor arranged on the surface of the display unit 303, a switch arranged on the housing, and a button.
The communication interface 307 is, for example, a wireless device compliant with a wireless LAN (= Local Area Network), Bluetooth (registered trademark), or a mobile communication standard.
Incidentally, the control unit 301 and each unit or the like are connected to each other through a bus 308 or a signal line (not shown).
Although not shown, the terminal 30 is equipped with a GPS (= Global Positioning System) sensor for acquiring position information, a geomagnetic sensor, an acceleration sensor, a camera for capturing a moving image or a still image, and the like. The position information here is also used for recording the place where the sound was recorded.

FIG. 3 is a diagram showing a configuration example of the sound collecting device 40 used in the first embodiment.
The sound collecting device 40 according to the present embodiment has a microphone 401 that converts sound into an electric signal, a speaker 402 that reproduces the electric signal as sound, and an audio file that converts the electric signal output from the microphone 401 into an audio file. A sound processing unit 403 that converts the sound into an electric signal, a recording switch 404 that is used to instruct the start and end of recording, a guidance confirmation button 405 that is used to confirm guidance given from the terminal 30, and a storage unit that stores audio files. It has 406 and a communication interface (= communication IF) 407.

The recording switch 404 outputs either an on state or an off state. In the case of the present embodiment, while the recording switch 404 is on, the sound processing unit 403 converts (that is, encodes) the electric signal input from the microphone 401 into an audio file. On the other hand, while the recording switch 404 is in the off state, the sound processing unit 403 does not convert the electric signal input from the microphone 401 into an audio file. The recording switch 404 in this embodiment also functions as a power switch.
When the sound collecting device 40 and the terminal 30 are in a communicable state, the sound collected by the microphone 401 is transmitted to the terminal 30 through the communication interface 407 while the recording switch 404 is pressed.
When the sound collecting device 40 and the terminal 30 cannot communicate with each other, the sound collected by the microphone 401 is stored in the storage unit 406 as an audio file while the recording switch 404 is pressed. The storage of the audio file in the storage unit 406 may be irrelevant to the state of communication with the terminal 30. The storage unit 406 is an example of the collected sound storage means.

The guidance confirmation button 405 is pressed when the child wants to confirm the guidance given from the terminal 30 (hereinafter, may be referred to as "mission"). When the guidance confirmation button 405 is pressed, the voice obtained by decoding the guidance is reproduced from the speaker 402. The guidance here may be notified from the terminal 30 in conjunction with the operation of the guidance confirmation button 405. However, when the guidance is stored in the storage unit 406, the guidance stored in the storage unit 406 may be reproduced each time the guidance confirmation button 405 is operated. The guidance here is presented so that the child is interested in various sounds as if playing a game. For example, it is output as a shout such as "Let's collect animal calls today".
When a display unit (not shown) is provided in the sound collecting device 40, the guide may be displayed as characters on the display unit.
The storage unit 406 is composed of a non-volatile rewritable semiconductor memory or the like. In the storage unit 406, for example, an audio file corresponding to the recorded sound, the above-mentioned guidance data, and the like are stored.

<Functional configuration of terminal 30>
FIG. 4 is a diagram illustrating a functional configuration of the control unit 301 constituting the terminal 30.
The functional module shown in FIG. 4 is realized through the execution of a program by the CPU 311 (see FIG. 2). The functional module shown in FIG. 4 is an example of a program executed by the control unit 301.

One of the programs shown in FIG. 4 includes a sound material collection guide module 321 that presents a guide for prompting the collection of sound as a material (hereinafter referred to as “sound material”) to a user or a child.
This module provides a function to assist children so that they can collect familiar sounds with a playful feeling, for example. In the present embodiment, familiar sounds include mama's voice, dad's voice, animal's bark, vehicle sound, park sound, wind sound, station platform sound, and the like. The guidance may be presented not only as voice but also as text or images. For example, a voice saying "Let's collect the sounds of animals today" is output from the terminal 30 and the sound collecting device 40. Further, for example, an image of a dog or a cat is displayed on the terminal 30 or the sound collecting device 40. In this way, by presenting the content of the sound recorded in the mission format to the child, the child's interest can be guided to a specific sound. Also, if you guide the collection of sounds in the manner of a stamp rally, you can expand your child's curiosity and interest. In addition, if parents and children listen to the recorded sound material, not only the conversation will be lively, but also the growth of the child can be confirmed.

The guidance by the sound material collection guidance module 321 may be presented regardless of the contents of the downloaded audiobook, and is in the area portion that can be inserted or replaced in the downloaded audiobook. It may be presented according to the specified type of sound.
When the child is young, it is desirable for the user to be able to preselect the content of the guidance presented to the child. It is also desirable that the user can specify the timing at which the guidance is presented.
Since the guidance by the sound material collection guidance module 321 is merely a trigger for encouraging the child's behavior, it does not prevent the child from recording a sound different from the guidance.
In the case of the present embodiment, the sound material also includes the voice of the dialogue recorded for the purpose of replacing the original voice, if it is a sound recorded as an inserted sound or a sound to be replaced.
The sound material collection guidance module 321 is an example of guidance means.

One of the programs shown in FIG. 4 includes a sound material storage module 322 that stores sound material in a storage unit 302 (see FIG. 2) in a state where it can be identified.
In the case of this embodiment, the identifiable state means not only that the difference in sound material can be identified as a file, but also the content of the recorded sound, the date and time of recording, the recording location, the device used for recording, and the like. I say what I can do. However, these pieces of information are exemplary, and the identifiable state does not mean that all of this information is identifiable. The content of the recorded sound may be input after the fact by the user, or the content of the sound presented by the above-mentioned guidance may be automatically recorded.
It is desirable that the sound material is stored in a folder created for each sound content. If the sound material is stored in the folder created for each sound content, it is possible to efficiently find the sound material to be applied to the insertable area part or the replaceable area part. In addition, folders may be created by the name and age of the child and the title of the audiobook.
By the way, recording of sound material by a child is assumed not only when accompanied by a user but also when only a child is recorded, depending on the age of the child. When the sound material is recorded only by the child using the sound collecting device 40 (see FIG. 1), the recorded sound material file is temporarily stored in the storage area of the sound collecting device 40. In this case, the function of the sound material storage module 322 is also executed by the sound collecting device 40.

One of the programs shown in FIG. 4 includes a sound material processing module 323 that processes a sound material.
The processing here means, for example, changing the frequency of the sound material, changing the reproduction speed, changing the volume, reducing noise, adding an echo, and the like. The sound material processing module 323 corresponds to, for example, the function of a voice changer. The sound material processing module 323 is an example of processing means.
One of the programs shown in FIG. 4 includes an audiobook acquisition module 324 that acquires an audiobook from the audio file management server 20 (see FIG. 1). The audiobook to be acquired is designated by the user through the operation screen of the terminal 30 (see FIG. 1). The audiobook acquisition module 324 is an example of acquisition means.

One of the programs shown in FIG. 4 includes an audiobook reproduction module 325 that reproduces an audiobook.
In the case of the present embodiment, there are two types of audiobook playback by the audiobook playback module 325: playback of the original audio and playback of the edited audiobook, and a button corresponding to each playback is displayed in the display unit 303 (FIG. FIG. 2) is displayed. The audiobook playback module 325 is an example of playback means.

One of the programs shown in FIG. 4 includes a replaceable area and the like presentation module 326 that presents to the user a part of the audiobook that can be replaced or inserted by the sound collected by the user.
The replaceable area presentation module 326 here distinguishes the display mode of the dialogue or the like displayed on the display unit 303 (see FIG. 2) between the dialogue and the like that can be held and the dialogue and the like that cannot be replaced.
For example, lines that cannot be replaced are displayed in the standard thickness and size, while lines that can be replaced are displayed in bold. For example, lines that cannot be replaced are displayed in black characters, whereas lines that can be replaced are displayed in red characters. In addition, for example, lines that cannot be replaced are not marked, whereas lines that can be replaced are additionally displayed with characteristic marks.

Further, the replaceable area or the like presentation module 326 displays a mark or the like indicating to that effect on the display unit 303 in the area portion where the sound collected by the user can be inserted.
It should be noted that there is no sound to be replaced in the area where the sound can be inserted. Therefore, in the present embodiment, the insertion of sound and the replacement of sound are distinguished.
Further, the replaceable region portion and the insertable region portion may be presented by a predetermined specific sound output. For example, the corresponding position may be notified by a buzzer or the like.
The replaceable area and the like presentation module 326 is an example of the guide means and also an example of the replaceable means.

One of the programs shown in FIG. 4 includes a replacement instruction receiving module 327 that receives a replacement instruction by the user.
In the case of this embodiment, the operation of the record button is used for the replacement instruction. When the replacement instruction is received, the output of the original sound is stopped, and it becomes possible to record the sound and select the sound material recorded in advance.
In addition, you may prepare separate buttons for recording voice etc. on the spot and for selectively specifying the sound material, or you can operate by tapping the record button once or twice. It may be possible to switch. When the sound material is selectively specified, the playback of the audiobook is also stopped until the selection instruction is accepted.
The replacement instruction receiving module 327 here is also an example of the guidance means and an example of the replacement means.

One of the programs shown in FIG. 4 includes a sound material insertion receiving module 328 that receives a user's instruction to insert a sound material.
In the case of this embodiment, the operation of the recording button is also used for the instruction to insert the sound material. Even when the instruction to insert the sound material is accepted, it becomes possible to record the sound or the like and select the sound material recorded in advance. Regarding the insertion of sound material, there are cases where voice and the like are recorded on the spot and cases where the sound material is selectively instructed. The operation method is the same as in the case of the replacement instruction.

One of the programs shown in FIG. 4 is an edited audio that stores an audio book (hereinafter referred to as “edited audio book”) that has been edited by replacing or inserting sound material in the storage unit 302 (see FIG. 2). There is a book storage module 329.
The edited audiobook is created separately from the unedited audiobook. Therefore, the audiobook before editing is saved in the state before editing. In the case of this embodiment, the date and time of saving and the like are automatically inserted into the file name of the edited audiobook. Multiple edited audiobooks saved in this way can be recorded as a history of the child's growth. However, the file name may be edited after the fact.

<Example of processing operation>
<Collection of sound materials>
In the following, we will explain how to generate an original sound story using an audiobook.
FIG. 5 is a flowchart showing an example of a processing operation executed when collecting sound material.
In addition, S in the figure means a step.
When the control unit 301 (see FIG. 2) detects a specific operation by the user, the control unit 301 presents the user with a list of sound material candidates to be collected (step 1).
In the present embodiment, as a specific operation, it is assumed that the operation of the icon assigned to the display of the screen that accepts the designation of the candidate sound material to be collected by the child is assumed.
A list of sound material candidates is displayed on the display unit 303 (see FIG. 2). For example, the display unit 303 displays mama's voice, dad's voice, animal's bark, vehicle's sound, park sound, wind sound, station platform sound, etc. together with a selection button as candidates for sound materials to be collected by children. Will be done.

When the user operates any of the selection buttons, the control unit 301 accepts the selection of the sound material candidates to be collected (step 2).
After that, the control unit 301 transmits the guidance of the sound material to be collected to the sound collecting device 40 (see FIG. 1) (step 3).
FIG. 6 is a diagram illustrating an example of a screen for guiding the collection of sound materials.
In the example shown in FIG. 6, a list of sound material candidates to be collected is selectably displayed on the display screen of the terminal 30 operated by the user.

In the case of FIG. 6, the display screen displays mama's voice, dad's voice, animal bark, vehicle sound, and park sound as selectable candidates, and a selection button is displayed adjacent to each of them. There is. In FIG. 6, a check mark is attached to the animal bark selection button. When the decision button 331 is operated in this state, the guidance is transmitted from the terminal 30 to the sound collecting device 40.
In this example, the voice "Let's collect the sounds of animals" is reproduced from the speaker 402 (see FIG. 3) (not shown) of the sound collecting device 40. This voice is also reproduced when a child operating the sound collecting device 40 operates the guidance confirmation button 405 (see FIG. 3).
The audio file corresponding to the sound material collected by the sound collecting device 40 is transmitted from the sound collecting device 40 to the terminal 30 each time or collectively.

<Edit audiobook>
FIG. 7 is a flowchart showing an example of a processing operation executed when editing a downloaded audiobook.
In addition, S in the figure means a step.
When the control unit 301 (see FIG. 2) detects a specific operation by the user, the control unit 301 accepts the selection of the audiobook (step 11).
An example of a particular operation is a selection instruction on the screen where downloaded audiobooks are listed.
The control unit 301 that has received the selection instruction determines whether or not the selected audiobook has an area that can be replaced (step 12). The presence or absence of a replaceable area can be identified from the information attached to the audiobook.

If a negative result is obtained in step 12, the control unit 301 accepts an instruction to play the audiobook and starts playing the audiobook (step 13).
When the playback of the audiobook is started, the control unit 301 determines whether or not the playback is finished (step 14).
The control unit 301 continues playing the audiobook while the negative result is obtained in step 14. In this case, since there is no area that can be replaced, the audio of the audiobook is reproduced as it is.
If a positive result is obtained in step 14, the playback of the audiobook ends.

On the other hand, if an affirmative result is obtained in step 12, the control unit 301 accepts an instruction to play the audiobook and starts playing the audiobook (step 15).
After that, the control unit 301 determines whether or not the position during reproduction is an area that can be replaced (step 16).
While the negative result is obtained in step 16, the control unit 301 repeats the determination.
When an affirmative result is obtained in step 16, the control unit 301 presents to the user that the area can be replaced (step 17).

Subsequently, the control unit 301 (see FIG. 2) determines whether or not an instruction such as replacement has been received (step 18).
In the case of the present embodiment, the control unit 301 determines whether or not the operation of the recording button is detected.
If a negative result is obtained in step 18, the control unit 301 returns to step 16 and continues playing the audiobook.
On the other hand, if a positive result is obtained in step 18, the control unit 301 accepts the sound material (step 19).
After that, the control unit 301 determines whether or not the reproduction is completed (step 20).
While the negative result is obtained in step 20, the control unit 301 returns to step 16 and continues playing the audiobook.

Examples of display screens corresponding to steps 11 to 20 are shown in FIGS. 8 to 14.
FIG. 8 is a diagram illustrating an example of a screen at a time point T1 for selecting an audiobook and a time point T2 for receiving an instruction to play an audiobook.
The time point T1 corresponds to step 11, and the time point T2 corresponds to step 15.
On the screen of the time point T1, "old tale 1", "old tale 2", and "old tale 3" are displayed as examples of selectable audio books, and selection buttons are displayed adjacent to each. In FIG. 8, a check mark is attached to the selection button of "Fairy Tale 1". The screen after the enter button 332 is operated in this state is the screen at the time point T2.

In the case of FIG. 8, the title 333, the time axis 334, and the slider 335 indicating the reproduction position are displayed in the upper part of the screen at the time point T2. At the time point T2, since the reproduction has not started, the slider 335 is located at the left end which is the origin. The slider 335 can also be used to move the reproduction position.
At the bottom of the screen at the time point T2, three types of buttons are arranged. Button 336 is a play button for the original voice or the like. The button 337 is a button used for instructing the user to replace the sound material collected. In the case of FIG. 8, the button 337 is a record button. Button 338 is a button used to instruct playback of the edited audiobook. In the case of FIG. 8, the button 338 is a repeat playback button.
In FIG. 8, the user is operating the leftmost button 336.

FIG. 9 is a diagram illustrating an example of a screen of a time point T3 in which a non-replaceable area is being reproduced and a time point T4 in which a replaceable area is being reproduced.
The time point T3 corresponds to the case where a negative result is obtained in step 16, and the time point T4 corresponds to step 17.
In the case of FIG. 9, "old story 1" is a fairy tale "Little Red Riding Hood".
On the screen at the time point T3, since time has already passed since the reproduction started, the slider 335 has moved to the vicinity of the center of the time axis 334. At the time point T3, there is a line 339 of the character Little Red Riding Hood, and the corresponding voice is output from the terminal 30. The line 339 here is "Oh, grandmother, what a big deal".
In the case of the present embodiment, the dialogue 339 at the time point T3 is registered as a dialogue that cannot be replaced. Therefore, on the display screen of the terminal 30, a character string representing the content of the dialogue 339 is displayed with a reference thickness and size.

The time point T4 is immediately after the time point T3. On the screen at the time point T4, there is a line 340 of the character Okami, and the corresponding voice is output. The line 340 here is "so that you can grasp it well." In the case of the present embodiment, the dialogue 340 at the time point T4 is registered as a dialogue that can be replaced, but the dialogue 340 is output as it is unless the user gives an instruction such as replacement. In fact, in FIG. 9, the voice corresponding to the dialogue 340 is output from the terminal 30.
On the display screen of the terminal 30, the dialogue 340 is displayed in a manner of notifying the user that the replacement or the like is possible. In the case of FIG. 9, the dialogue 340 is changed to a thick character, and at the same time, an elliptical mark 341 is added behind the dialogue 340. The presence of the mark 341 and the like allows the user to know that the dialogue can be replaced.

FIG. 10 is a diagram illustrating an example of a screen displayed when a replacement instruction is received. In FIG. 10, a reference numeral corresponding to a portion corresponding to the screen of the time point T4 in FIG. 9 is attached.
Here, the user is operating the button 337. By operating the button 337 by the user, the terminal 30 is put into a state of waiting for the input of the sound material. In FIG. 10, it is assumed that the microphone 306 (see FIG. 2) of the terminal 30 records the voice of a child. Therefore, the output of the voice corresponding to the dialogue 340 is stopped. The reason for stopping the output of the voice from the terminal 30 is to prevent the voice output from the terminal 30 from being recorded together with the voice of the child.
The audio output from the terminal 30 is stopped after the button 337 is operated. In other words, until the button 337 is operated, as shown in FIG. 9, the voice corresponding to the replaceable dialogue 340 is output from the terminal 30.
In the example of FIG. 10, the child is uttering the wolf's line 340, and this voice is stored in the terminal 30. Incidentally, the sound collecting device 40 (see FIG. 1) may be used to acquire the voice of the child.

FIG. 11 is a diagram illustrating another example of a screen displayed when a replacement instruction is received. In FIG. 11, a reference numeral corresponding to a portion corresponding to FIG. 10 is attached.
The screen shown in FIG. 11 is also common to FIG. 10 in that it replaces the dialogue 340 at the time point T4, but differs from FIG. 10 in that the time point of acquisition of the sound material and the time point of replacement editing are different.
In the case of FIG. 11, it is indicated by the character string 341A instead of the mark 341 (see FIG. 10) that the replacement is possible.
Further, in the lower middle of the screen, a list 342 of sound material candidates recorded in the past using a terminal 30, a sound collecting device 40 (see FIG. 1) (see FIG. 1), or the like (see FIG. In the case of FIG. 11, there are three candidates. In the list 342, a file name corresponding to each candidate, a selection button, and a playback button used for confirming the contents are arranged.
The candidate here may be a sound material processed by the sound material processing module 323 (see FIG. 4).

The candidate file name shown in FIG. 11 includes recording date and time and cast information, and can identify the content of the sound. A serial number is also added to the end of the file name to distinguish the lines of the same cast recorded on the same day. For example, the first candidate is the sound material recorded at 19:06 on March 7, 2019, and it can be seen that it is the first line of the wolf. The serial number may mean the order of recording on the recording date.
When the file name includes the cast information as in the example of FIG. 11, the terminal 30 selectively displays the sound material related to the cast corresponding to the dialogue 340 of the area portion instructed by the user to replace. Is also possible.
Further, when the serial number represents a replaceable area portion, the terminal 30 can selectively display the related sound material pinpointly.

The file name shown in FIG. 11 includes cast information, but may include information indicating the recording location of the sound material in place of or together with the cast. For example, home, park, etc. may be included in the file name. In addition, the file name may include information indicating who the voice is and the age of the child at the time of recording. However, this information may be included only in the information attached to the file.
In the example of FIG. 11, a check mark is attached to the selection button of the second candidate.
When the enter button 344 is operated in this state, the replacement of the region portion to be edited is completed. When the back button 343 is operated, the screen returns to the screen before editing, for example.

FIG. 12 is a diagram illustrating an example of a screen displayed in a region portion where sound can be added. In FIG. 12, a reference numeral corresponding to a portion corresponding to the screen of the time point T2 in FIG. 8 is attached.
The screen of FIG. 12 corresponds to a time point T5 different from any of the above.
The time point T5 in the present embodiment is a region portion where sound can be inserted (that is, sound is added). Therefore, there is no dialogue or the like.
In FIG. 12, it is expressed by the explanatory text 345 and the characteristic mark 346 that the sound can be added.
At this point, at T5, a user or child who wants to add sound is operating button 337.

FIG. 13 is a diagram illustrating an example of a screen displayed when an instruction to add a sound is received. In FIG. 13, a reference numeral corresponding to a portion corresponding to that in FIG. 11 is added.
In the case of FIG. 13, it is indicated by the character string 341B that the sound can be inserted.
Further, in the lower middle of the screen, a list of sound material candidates 347 recorded in the past using a terminal 30, a sound collecting device 40 (see FIG. 1) (see FIG. 1), or the like (see FIG. In the case of FIG. 13, there are three candidates. In the list 347, a file name corresponding to each candidate, a selection button, and a playback button used for confirming the contents are arranged.
The file name of FIG. 13 includes information on the recording date and time and the recording location. For example, the first candidate can be seen to be the sound material recorded in the park at 14:23 on March 7, 2019.
In the example of FIG. 13, a check mark is attached to the selection button of the first candidate.
When the enter button 344 is operated in this state, the insertion of the sound material into the region portion to be edited is completed. When the back button 343 is operated, the screen returns to the screen before editing, for example.
As in the case of FIG. 10, when the button 337 is operated, the sound on the spot is recorded, and the sound recorded in the corresponding area may be inserted. The audiobook into which the sound is inserted is stored in the storage unit 302 (see FIG. 2) as an edited audiobook.

FIG. 14 is a diagram for explaining the relationship between the area where replacement or the like is possible and the area where the user actually instructed replacement or the like. (A) shows a predetermined arrangement of a replaceable area or the like in the audio book, and (B) shows an area in which the user actually instructed the replacement or the like.
In the case of FIG. 14, there are 10 replaceable areas, of which one area is instructed by the user to insert the sound material and two areas are instructed by the user to replace the sound material. The original voice or the like remains as it is in the remaining area among the areas that can be replaced.

The area that can be replaced can be defined regardless of the dialogue of a specific cast. Therefore, the child can selectively replace only the lines or the like that he / she is interested in. This feature allows the audiobook of the present embodiment to generate a number of edited audiobooks in the process of child growth. For example, you can record and keep an edited audiobook in which only animal calls are replaced when the child is young, but gradually longer lines are replaced as the child grows. In other words, it becomes possible to record the process of growth. In addition, it becomes possible to record the change of interest with growth as the difference in the area where replacement or the like is instructed.
Incidentally, in the case of the audio book in the present embodiment, since the area portion that can be replaced is predetermined, the user and the child can concentrate on the sound to be collected.

Returning to the description of FIG.
When the playback of the audiobook is completed (that is, when a positive result is obtained in step 20), the control unit 301 (see FIG. 2) determines whether or not there is replacement or the like during playback (step 21).
If a negative result is obtained in step 21, the control unit 301 ends the process as it is. This is because it is the same as playing an audiobook that has no area that can be replaced.

On the other hand, when an affirmative result is obtained in step 21, the control unit 301 assigns a file name to the edited audiobook reflecting the result of editing such as replacement and saves it (step 22). In the case of the present embodiment, the file name of the edited audiobook is composed of the original file name and the editing work date.
In the case of the present embodiment, when the saving of the edited audiobook is completed, the edited audiobook just saved is automatically played once. This reproduction is for confirming the saved contents. When the button 338 for repeated playback (see FIG. 12) is operated, the playback of the edited audiobook is repeated.

<Playing audiobooks>
The following is an example of a screen displayed when playing an edited audiobook.
FIG. 15 is a diagram showing an example of a selection screen of an audio book to be reproduced.
FIG. 15 is shown with reference numerals corresponding to the portions corresponding to those in FIG.
In the case of FIG. 15, on the screen of the terminal 30, as examples of audio books that can be selected, "Fairy tale 1", "Fairy tale 1 2019-03-07", "Fairy tale 1 2018-12-25", "Fairy tale 1 2016" -05-11 "is displayed. Of these, "Fairy Tale 1" is an audiobook before editing, and the other three are edited audiobooks with different dates when "Fairy Tale 1" was edited.
In FIG. 15, a check mark is attached to the selection button of "Fairy Tale 1 2019-03-07".

FIG. 16 is a diagram illustrating a case where there is a sound material replaced by the user in the replaceable area and a case where there is no sound material replaced. (A) shows the case where there is no sound material replaced by the user, and (B) shows the case where there is sound material replaced by the user.
The screen shown in FIG. 16 corresponds to time point T4. The screen shown in (A) corresponds to the screen displayed during playback of the audiobook before editing (see T4 at the time of FIG. 9).

The difference between the screen shown in (A) and T4 at the time of FIG. 9 is the file name of the title 333A. The file name of the audiobook before editing is "Fairy Tale 1", but in the case of Fig. 16, it is the audiobook after editing, so the file name is "Fairy Tale 1 2019-03-07" with the editing date added. is there.
When playing back the edited audiobook, it is indicated by the mark 341 and the display in bold characters that the replacement is possible at the position of the line 340 that can be replaced, as in the case of FIG.
On the other hand, when there is a sound material replaced by the user (screen (B)), the face icon 351 representing the recorder and the child who uttered the recorded voice and the file name 352 of the sound material being played are reproduced. Is added to the screen.

The face icon 351 and the file name 352 here are displays that do not appear when there is no sound material replaced by the user (screen of (A)).
Therefore, the user who has confirmed the display of the face icon 351 or the like can visually confirm the content of the sound material to be replaced.
Of course, the terminal 30 outputs the reproduced sound of the replaced sound material instead of the original sound. Here, the line "You should be able to grasp it well" is uttered in the voice of a child.

FIG. 17 is a diagram illustrating a case where there is a sound material inserted by the user in the insertable area and a case where there is no sound material inserted. (A) shows the case where there is no sound material inserted by the user, and (B) shows the case where there is sound material inserted by the user.
The screen shown in FIG. 17 corresponds to the time point T5. The screen shown in (A) corresponds to the screen (see FIG. 12) displayed during playback of the audiobook before editing.
Also in the case of FIG. 17, the difference between the screen shown in FIG. 12 and FIG. 12 is the file name of the title 333A. The file name of the audiobook before editing is "Fairy Tale 1", but in the case of Fig. 17, since it is the audiobook after editing, the file name is "Fairy Tale 1 2019-03-07" with the editing date added. is there.

When playing back the edited audiobook, it is indicated by the explanation 345 and the characteristic mark 346 that the edited audiobook can be inserted at the position where it can be inserted, as in the case of FIG.
By the way, when there is a sound material replaced by the user (screen (B)), the face icon 351 representing the recorder and the child who uttered the recorded voice and the sound being played are displayed on the screen. The file name 352 of the material is additionally displayed.
In the example of FIG. 17, the sound of stepping on the fallen leaves, which is the sound of stepping on the fallen leaves, is output from the terminal 30.

Even when the sound material is already inserted, it is possible to display the explanation text 345 of the same text as when the sound material is not inserted (screen of (A)).
However, in FIG. 17, another explanatory text 353 indicating that the sound can be replaced is displayed on the screen.
The user who sees this display can recognize that the sound can be replaced with a sound different from the sound being played.

<Other embodiments>
Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope described in the above-described embodiments. It is clear from the description of the scope of claims that the above-described embodiment with various modifications or improvements is also included in the technical scope of the present invention.

For example, in the above-described embodiment, the terminal 30 (see FIG. 1) or the combination of the terminal 30 and the sound collecting device 40 (see FIG. 1) has been described as an example of the sound story generation system, but the audio file management It is also possible to make the server 20 (see FIG. 1) function as an example of a sound story generation system. In this case, the terminal 30 and the sound collecting device 40 function as simple input / output devices. It is also possible to execute a part of the above-mentioned module on the audio file management server 20 and execute the rest on the terminal 30. In this case, the audio file management server 20 and the terminal 30 are examples of the sound story generation system.

In the above-described embodiment, the edited audiobook is stored in the storage unit 302 (see FIG. 2), but on the audio file management server 20 (see FIG. 1) and other Internet 10 (see FIG. 9). You may save it on your server.
In the above-described embodiment, the case where the replaceable area portion is a dialogue is illustrated, but the replaceable region is not limited to the dialogue portion.

1 ... Network system, 10 ... Internet, 20 ... Audio file management server, 30 ... Terminal, 40 ... Sound collection device, 321 ... Sound material collection guidance module, 322 ... Sound material storage module, 323 ... Sound material processing module, 324 ... Audio book acquisition module, 325 ... Audio book playback module, 326 ... Replaceable area presentation module, 327 ... Replacement instruction reception module, 328 ... Sound material insertion reception module, 329 ... Edited audio book storage module

The present invention is family memories at the time replacement of sound, or, in comparison with the case where the candidate of the sound material ready to identify the growth of children is not guided, enabling the production of sound story with enhanced originality With the goal.

The invention according to claim 1 is a case of supporting the generation of a sound story file in which a collected sound recording means for recording a plurality of sounds collected by a user and a plurality of sounds recorded in the collected sound recording means are combined. In addition, it is a sound story generation system provided with a guide means for guiding a candidate sound material to a user in a state where the memory of the family at the time of sound replacement or the growth of a child can be identified .
The invention according to claim 2, wherein collecting sound recording means records a plurality of sound that the user has collected in identifiable state, the guide means, a part of the sound story preformed, the collection some of the sound story or preformed sound story from the recorded plurality of sound was inserted by selecting a specific sound distinguishable states to the sound recording means, recording at identifiable state to the collection sound recording means The sound story generation system according to claim 1, wherein the user is prompted to generate a sound story in which a specific sound is selected and replaced from a plurality of sounds.
The invention according to claim 3 is the sound story generation system according to claim 1, wherein the guidance means outputs a region into which a sound can be inserted by the user so that the user can identify the area.
The invention according to claim 4 records a sound story in which the recorded sound is inserted into the area when the sound is recorded by the user's operation during the reproduction of the area where the sound collected by the user can be inserted. , The sound story generation system according to claim 3.
The invention according to claim 5 further includes a processing means that enables the user to process the sound recorded in the collected sound recording means, and the guiding means inserts the sound processed by the processing means. The sound story generation system according to claim 1, wherein the user is prompted to generate the sound story.
The invention according to claim 6, further comprising a sound story recording means for recording the sound story generated, a plurality of sound story recorded in the sound story recording means are recorded in a possible identification by the user state The sound story generation system according to claim 1, wherein the sound story is generated.
The invention according to claim 7, wherein the guidance means guides the content of the collected sound in a mission format or in the manner of a stamp rally when assisting the user in collecting the sound. It is a generation system.
The invention according to claim 8, the computer, to assist the function of recording sound obtained by the user on a recording medium, the generation of a file of sound story that combines a plurality of sounds recorded on the recording medium It is a program that executes a function of guiding a candidate sound material to a user in a state where the memory of the family at the time of sound replacement or the growth of a child can be identified .

According to the invention of claim 1, the sound story with enhanced originality is produced as compared with the case where the family memory at the time of sound replacement or the sound material candidate is not guided in a state where the growth of the child can be identified. Can be generated.
According to the invention of claim 2, the sound story generated by selectively inserting a sound into a part of a preformed story or selectively replacing a part of the preformed story. The originality can be enhanced.
According to the invention of claim 3, since the area where the sound can be inserted is known, the image of the sound to be collected becomes easy.
According to the invention of claim 4, it is possible to promote the generation of a highly original sound story.
According to the invention of claim 5, since the existing sound can be processed and utilized, the originality of the generated sound story can be enhanced.
According to the invention of claim 6, the generated sound story can be utilized as a memory.
According to the invention of claim 7, the curiosity and interest of the child can be expanded through the collection of sounds.
According to the invention of claim 8, the sound story with enhanced originality is produced as compared with the case where the family memory at the time of sound replacement or the sound material candidate is not guided in a state where the growth of the child can be identified. Can be generated.

<Configuration of terminal 30 and sound collecting device 40>
FIG. 2 is a diagram showing a configuration example of the terminal 30 used in the first embodiment.
The terminal 30 in the present embodiment includes a control unit 301 that controls the operation of the entire device, a non-volatile storage unit 302 that records data, a display unit 303 that is used for displaying a user interface screen, and a user operation. It has an operation reception unit 304 that receives an electric signal, a speaker 305 that reproduces an electric signal as sound, a microphone 306 that converts the sound into an electric signal, and a communication interface (= communication IF) 307.

The control unit 301 in the present embodiment is used as a work area, a CPU (= Central Processing Unit) 311 and a ROM (= Read Only Memory) 312 in which firmware, a BIOS (= Basic Input Output System), and the like are recorded. It has a RAM (= Random Access Memory) 313. The control unit 301 functions as a so-called computer. The ROM 312 is a non-volatile, rewritable semiconductor memory.
The storage unit 302 is composed of a non-volatile rewritable semiconductor memory or the like. For example, audiobook data, sound data recorded by the microphone 306, and the like are stored in the storage unit 302. The storage unit 302 here is an example of the collected sound recording means and also an example of the sound story recording means. The storage unit 302 is also an example of the post-replacement voice recording means.

FIG. 3 is a diagram showing a configuration example of the sound collecting device 40 used in the first embodiment.
The sound collecting device 40 according to the present embodiment has a microphone 401 that converts sound into an electric signal, a speaker 402 that reproduces the electric signal as sound, and an audio file that converts the electric signal output from the microphone 401 into an audio file. A sound processing unit 403 that converts the sound into an electric signal, a recording switch 404 that is used to instruct the start and end of recording, a guidance confirmation button 405 that is used to confirm guidance given from the terminal 30, and a storage unit that records an audio file. It has 406 and a communication interface (= communication IF) 407.

The recording switch 404 outputs either an on state or an off state. In the case of the present embodiment, while the recording switch 404 is on, the sound processing unit 403 converts (that is, encodes) the electric signal input from the microphone 401 into an audio file. On the other hand, while the recording switch 404 is in the off state, the sound processing unit 403 does not convert the electric signal input from the microphone 401 into an audio file. The recording switch 404 in this embodiment also functions as a power switch.
When the sound collecting device 40 and the terminal 30 are in a communicable state, the sound collected by the microphone 401 is transmitted to the terminal 30 through the communication interface 407 while the recording switch 404 is pressed.
When the sound collecting device 40 and the terminal 30 cannot communicate with each other, the sound collected by the microphone 401 is recorded in the storage unit 406 as an audio file while the recording switch 404 is pressed. The recording of the audio file in the storage unit 406 may be irrelevant to the state of communication with the terminal 30. The storage unit 406 is an example of the collected sound recording means.

The guidance confirmation button 405 is pressed when the child wants to confirm the guidance given from the terminal 30 (hereinafter, may be referred to as "mission"). When the guidance confirmation button 405 is pressed, the voice obtained by decoding the guidance is reproduced from the speaker 402. The guidance here may be notified from the terminal 30 in conjunction with the operation of the guidance confirmation button 405. However, when guided by the storage unit 406 is recorded each time the operation of the guide confirmation button 405 may play back the guide stored in the storage unit 406. The guidance here is presented so that the child is interested in various sounds as if playing a game. For example, it is output as a shout such as "Let's collect animal calls today".
When a display unit (not shown) is provided in the sound collecting device 40, the guide may be displayed as characters on the display unit.
The storage unit 406 is composed of a non-volatile rewritable semiconductor memory or the like. In the storage unit 406, for example, an audio file corresponding to the recorded sound, the above-mentioned guidance data, and the like are stored.

One of the programs shown in FIG. 4 includes a sound material storage module 322 that records sound material in a storage unit 302 (see FIG. 2) in an identifiable state.
In the case of this embodiment, the identifiable state means not only that the difference in sound material can be identified as a file, but also the content of the recorded sound, the date and time of recording, the recording location, the device used for recording, and the like. I say what I can do. However, these pieces of information are exemplary, and the identifiable state does not mean that all of this information is identifiable. The content of the recorded sound may be input after the fact by the user, or the content of the sound presented by the above-mentioned guidance may be automatically recorded.
It is desirable that the sound material is recorded in a folder created for each sound content. If the sound material is recorded in the folder created for each sound content, it is possible to efficiently find the sound material to be applied to the area part that can be inserted or the area part that can be replaced. In addition, folders may be created by the name and age of the child and the title of the audiobook.
By the way, recording of sound material by a child is assumed not only when accompanied by a user but also when only a child is recorded, depending on the age of the child. When recording a sound material only children with a sound collection device 40 (see FIG. 1) From the sounds material files are temporarily recorded in the recording area of the sound collection device 40. In this case, the function of the sound material storage module 322 is also executed by the sound collecting device 40.

One of the programs shown in FIG. 4 is an edited audio that records an audio book (hereinafter referred to as “edited audio book”) edited by replacing or inserting sound material in the storage unit 302 (see FIG. 2). There is a book storage module 329.
The edited audiobook is created separately from the unedited audiobook. Therefore, the audiobook before editing is saved in the state before editing. In the case of this embodiment, the date and time of saving and the like are automatically inserted into the file name of the edited audiobook. Multiple edited audiobooks saved in this way can be recorded as a history of the child's growth. However, the file name may be edited after the fact.

FIG. 10 is a diagram illustrating an example of a screen displayed when a replacement instruction is received. In FIG. 10, a reference numeral corresponding to a portion corresponding to the screen of the time point T4 in FIG. 9 is attached.
Here, the user is operating the button 337. By operating the button 337 by the user, the terminal 30 is put into a state of waiting for the input of the sound material. In FIG. 10, it is assumed that the microphone 306 (see FIG. 2) of the terminal 30 records the voice of a child. Therefore, the output of the voice corresponding to the dialogue 340 is stopped. The reason for stopping the output of the voice from the terminal 30 is to prevent the voice output from the terminal 30 from being recorded together with the voice of the child.
The audio output from the terminal 30 is stopped after the button 337 is operated. In other words, until the button 337 is operated, as shown in FIG. 9, the voice corresponding to the replaceable dialogue 340 is output from the terminal 30.
In the example of FIG. 10, the child is uttering the wolf's line 340, and this voice is recorded on the terminal 30. Incidentally, the sound collecting device 40 (see FIG. 1) may be used to acquire the voice of the child.

FIG. 13 is a diagram illustrating an example of a screen displayed when an instruction to add a sound is received. In FIG. 13, a reference numeral corresponding to a portion corresponding to that in FIG. 11 is added.
In the case of FIG. 13, it is indicated by the character string 341B that the sound can be inserted.
Further, in the lower middle of the screen, a list 347 of sound material candidates recorded in the past using a terminal 30, a sound collecting device 40 (see FIG. 1) (see FIG. 1), or the like (not shown) is displayed. In the case of FIG. 13, there are three candidates. In the list 347, a file name corresponding to each candidate, a selection button, and a playback button used for confirming the contents are arranged.
The file name of FIG. 13 includes information on the recording date and time and the recording location. For example, the first candidate can be seen to be the sound material recorded in the park at 14:23 on March 7, 2019.
In the example of FIG. 13, a check mark is attached to the selection button of the first candidate.
When the enter button 344 is operated in this state, the insertion of the sound material into the region portion to be edited is completed. When the back button 343 is operated, the screen returns to the screen before editing, for example.
As in the case of FIG. 10, when the button 337 is operated, the sound on the spot is recorded, and the sound recorded in the corresponding area may be inserted. The audiobook into which the sound is inserted is recorded in the storage unit 302 (see FIG. 2) as an edited audiobook.

In the above-described embodiment, the edited audiobook is recorded in the storage unit 302 (see FIG. 2), but on the audio file management server 20 (see FIG. 1) and other Internet 10 (see FIG. 9). You may save it on your server.
In the above-described embodiment, the case where the replaceable area portion is a dialogue is illustrated, but the replaceable region is not limited to the dialogue portion.

An object of the present invention is to generate a sound story with enhanced originality by the user as compared with a simple after-recording function .

According to one aspect of the present invention, a collection sound recording means for recording a plurality of sound that the user has collected, as sound story file that combines the recorded plurality of sounds to the collection sound recording means capable of generating , A guidance means for guiding the user , and the guidance means is a sound story generation system characterized by providing guidance for encouraging the collection of sound as a material .
According to the second aspect of the present invention, the collected sound recording means records a plurality of sounds collected by the user in an identifiable state, and the guiding means collects the sound as a part of a preformed sound story. A part of a sound story or a preformed sound story in which a specific sound is selected and inserted from a plurality of sounds recorded in a state identifiable by the sound recording means is recorded in a state identifiable by the collected sound recording means. The sound story generation system according to claim 1, wherein the user is prompted to generate a sound story in which a specific sound is selected and replaced from a plurality of sounds.
The invention according to claim 3 is the sound story generation system according to claim 1, wherein the guidance means outputs a region into which a sound can be inserted by the user so that the user can identify the area.
The invention according to claim 4 records a sound story in which the recorded sound is inserted into the area when the sound is recorded by the user's operation during the reproduction of the area where the sound collected by the user can be inserted. , The sound story generation system according to claim 3.
The invention according to claim 5 further includes a sound story recording means for recording the generated sound story, and the plurality of sound stories recorded in the sound story recording means are recorded in a state in which the user can identify them. The sound story generation system according to claim 1, wherein the sound story is generated.
The invention according to claim 6, a computer to function to record the sound acquired by the user on a recording medium, as the recording medium to a recorded plurality of sounds story that combines the sound file can be generated , A program that guides the user and executes a function that guides the user to collect the sound as the material .

According to the invention of claim 1, it is possible to generate a sound story with enhanced originality by the user as compared with a simple after-recording function .
According to the invention of claim 2, the sound story generated by selectively inserting a sound into a part of a preformed story or selectively replacing a part of the preformed story. The originality can be enhanced.
According to the invention of claim 3, since the area where the sound can be inserted is known, the image of the sound to be collected becomes easy.
According to the invention of claim 4, it is possible to promote the generation of a highly original sound story .
According to the invention of claim 5 , the generated sound story can be utilized as a memory.
According to the invention of claim 6 , it is possible to generate a sound story with enhanced originality by the user as compared with a simple after-recording function .

The invention according to claim 1 makes it possible to generate a sound story file in which a collection sound recording means for recording a plurality of sounds collected by a user and a plurality of sounds recorded in the collection sound recording means are combined. , comprising a guide means for guiding the user, wherein the guide means, in the manner of stamp rally, a sound story generation system characterized by guiding the collection of sounds as the material.
According to the second aspect of the present invention, the collected sound recording means records a plurality of sounds collected by the user in an identifiable state, and the guiding means collects the sound as a part of a preformed sound story. A part of a sound story or a preformed sound story in which a specific sound is selected and inserted from a plurality of sounds recorded in a state identifiable by the sound recording means is recorded in a state identifiable by the collected sound recording means. The sound story generation system according to claim 1, wherein the user is prompted to generate a sound story in which a specific sound is selected and replaced from a plurality of sounds.
The invention according to claim 3 is the sound story generation system according to claim 1, wherein the guidance means outputs a region into which a sound can be inserted by the user so that the user can identify the area.
The invention according to claim 4 records a sound story in which the recorded sound is inserted into the area when the sound is recorded by the user's operation during the reproduction of the area where the sound collected by the user can be inserted. , The sound story generation system according to claim 3.
The invention according to claim 5 further includes a sound story recording means for recording the generated sound story, and the plurality of sound stories recorded in the sound story recording means are recorded in a state in which the user can identify them. The sound story generation system according to claim 1, wherein the sound story is generated.
The invention according to claim 6 allows a computer to generate a sound story file in which a function of recording a sound acquired by a user on a recording medium and a plurality of sounds recorded on the recording medium are combined. , It is a program that guides the user and realizes the function of guiding the collection of the sound that is the material in the manner of a stamp rally .

Claims (7)

Collected sound storage means for storing multiple sounds collected by the user,
A guide means for guiding the user so that a sound story file combining a plurality of sounds stored in the collected sound storage means can be generated.
A sound story generation system characterized by being equipped with. The collected sound storage means stores a plurality of sounds collected by the user in an identifiable state.
The guiding means is a sound story or a pre-formed sound in which a specific sound is selected and inserted into a part of a pre-formed sound story from a plurality of sounds stored in a state identifiable by the collected sound storage means. The first aspect of claim 1, wherein a user is prompted to generate a sound story in which a part of the story is replaced by selecting a specific sound from a plurality of sounds stored in a state identifiable by the collected sound storage means. Sound story generation system. The sound story generation system according to claim 1, wherein the guidance means outputs a region into which a sound can be inserted by the user so that the user can identify the area. The sound story according to claim 3, wherein when the sound is recorded by the user's operation during the reproduction of the area where the sound collected by the user can be inserted, the sound story in which the recorded sound is inserted into the area is stored. Generation system. Further provided with a processing means that enables the user to process the sound stored in the collected sound storage means.
The sound story generation system according to claim 1, wherein the guidance means prompts a user to generate a sound story in which a sound processed by the processing means is inserted. Further equipped with a sound story storage means to memorize the generated sound story,
The sound story generation system according to claim 1, wherein the plurality of sound stories stored in the sound story storage means are stored in a state in which the user can identify them. On the computer
A function to store the sound acquired by the user in the storage medium,
A program that executes a function of guiding the user so that a sound story file that combines a plurality of sounds stored in the storage medium can be generated.