KR101964438B1 - Method and apparatus for providing content service - Google Patents

Abstract

Provided are a method for providing a content service to a user by obtaining a reaction of the user for a current situation, determining an effect to the current situation based on the obtained reaction of the user, and applying the determined effect to the current situation and an apparatus thereof.

Description

[0001] METHOD AND APPARATUS FOR PROVIDING CONTENT SERVICE [0002]

The following embodiments are directed to a method and apparatus for providing a content service, and more particularly, to a method and apparatus for providing a content service to a user by reflecting a user's reaction to the current situation of the content service to the content service will be.

The content service is provided to the user based on information input by the user through the user interface. For example, a user transmits a key input to a content service providing device (e.g., a server) through a keyboard and a mouse, and the content service providing device reflects the received input to provide a content service to the user.

Korean Patent No. 10-1585830 (Announcement Date January 08, 2016) discloses a story development system and method for story development such as movies, audio story books, and the like. The present invention discloses a method for reproducing a story having at least two scenarios having different contents according to an emotion at a story selection point where a change of emotion may occur and tracking the movement of a pupil's eye The present invention relates to a story development system and a method according to a viewer's emotions, which determine a feeling of a viewer according to a motion of a pupil and select a scenario corresponding to the emotion of the viewer at a story selection point to develop a story.

One embodiment may provide an apparatus and method for providing a content service.

Another embodiment may provide a content service providing apparatus and method for determining a type and degree of a user's emotion with respect to a current situation based on user information, and applying the type and degree of the determined emotion to a current situation.

According to one aspect of the present invention, a content service providing apparatus includes a memory in which a program for providing content is recorded, and a processor for executing the program, wherein the program is a program for determining whether a current status of a content service provided to a user is a preset status Determining whether the current status is the preset status, receiving user information on the current status from the user if the current status is the preset status, determining a type of the user's emotional state based on the user information determining a type of emotion and a level of emotion of the emotion, determining an effect on the current situation based on the determined emotion type and the degree of emotion, The step of providing the content service to the user The.

The content service may be a game service.

The predetermined condition may be a situation in which the user makes a selection within the game service.

The predetermined condition may be a situation in which a specific character appears in the game service.

The predetermined condition may be a situation for determining a new item for the game service provided to the user.

The step of receiving the user information for the current situation from the user may include receiving the user's voice through the microphone as the user information.

The receiving of the user information on the current situation from the user may include receiving the user's face image through the camera as the user information and receiving the user's biometric signal as the user information through the biosensor Step < RTI ID = 0.0 > and / or < / RTI >

Wherein the step of determining the kind of the user's emotion and the degree of the emotion includes determining whether the user's emotion is a target emotion based on the user information and determining the degree of the target emotion based on the user information .

The target emotion may be eagerness.

Wherein the step of determining whether the emotion of the user is a target emotion comprises extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the voice when the user information is the voice of the user, Determining whether the user's emotions correspond to the target emotions based on at least one of an acoustic characteristic of the voice, a prosodic characteristic, and a linguistic characteristic.

The step of extracting at least one of the acoustic features, the prosodic features and the linguistic features of the speech comprises the steps of: extracting an acoustic characteristic, a rhythm characteristic, and a linguistic characteristic of the speech based on a data set for other users having the same profile as the profile of the user And extracting at least one of the characteristic feature and the linguistic feature.

Wherein the step of extracting at least one of an acoustic feature, a prosodic feature, and a linguistic feature of the speech comprises at least one of an acoustic feature, a prosodic feature and a linguistic feature of the speech based on a data set generated for the user And extracting one of them.

Wherein determining whether the user's emotions correspond to the target emotions based on at least one of an acoustic feature, a prosodic feature, and a linguistic feature of the voice comprises: determining an acoustic characteristic, a prosodic feature, Determining whether at least one of the at least one feature corresponds to at least one feature that is predetermined for the target emotion.

At least one feature preset for the target emotion may be set according to the profile of the user.

At least one of the features preset for the target emotion may be arbitrarily set among the plurality of features.

If the current situation is a situation where the user makes a selection in the game service, the determined effect may be an opportunity for further selection.

If the current situation is a situation in which a specific character appears in the game service, the determined effect may be an effect of increasing the ability of the user's character.

If the current situation is a situation for determining a new item for a game service provided to the user, the determined effect may be an effect of dispensing an additional item in addition to the determined new item.

According to another aspect of the present invention, there is provided a method of providing a content service to a user, the method comprising: determining whether a current status of a content service provided to a user is a preset status; Determining a type of emotion and a level of emotion of the user for the current situation based on the user information, Determining an effect on the current situation based on the type of emotion determined and the degree of emotion, and providing the content service to the user by applying the determined effect to the current situation.

Wherein the step of determining the type of emotion of the user and the degree of emotion comprises the steps of: determining whether the emotion of the user is eagerness, which is the target emotion, based on the user information; And determining the degree of freedom.

Wherein the step of determining whether the emotion of the user is a target emotion comprises extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the voice when the user information is the voice of the user, Determining whether the user's emotions correspond to the target emotions based on at least one of an acoustic characteristic of the voice, a prosodic characteristic, and a linguistic characteristic.

If the current situation is a situation where the user makes a selection in the game service, the determined effect may be an opportunity for further selection.

If the current situation is a situation in which a specific character appears in the game service, the determined effect may be an effect of increasing the ability of the user's character.

If the current situation is a situation for determining a new item for a game service provided to the user, the determined effect may be an effect of dispensing an additional item in addition to the determined new item.

A content service providing apparatus and method can be provided.

A content service providing apparatus and method for determining a type and degree of a user's emotion with respect to a current situation based on user information and applying the type and degree of the determined emotion to a current situation can be provided.

1 is a block diagram of a content service providing system according to an exemplary embodiment of the present invention.
2 is a configuration diagram of a content service providing apparatus according to an embodiment.
3 is a flowchart of a content service providing method according to an exemplary embodiment of the present invention.
4 is a flow diagram of a method for receiving information of a user according to an example.
5 is a flow diagram of a method for determining the type of emotion and degree of emotion of a user according to an example.
6 is a flowchart of a method for determining whether a user's emotion is a target emotion based on user information according to an example.
FIG. 7 is a flowchart of a method of extracting an acoustic characteristic, a prosodic characteristic, and a linguistic characteristic of a voice when the user information according to an example is speech.
8 is a flow chart of a method for determining an effect on a current situation according to an example.
9 is a flowchart of a method of providing a content service to a user by applying a determined effect according to an example to a current situation.

In the following, embodiments will be described in detail with reference to the accompanying drawings. However, various modifications may be made in the embodiments, and the scope of the patent application is not limited or limited by these embodiments. It is to be understood that all changes, equivalents, and alternatives to the embodiments are included in the scope of the right.

The terms used in the examples are used for descriptive purposes only and are not to be construed as limiting. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

Although the embodiments have been described with reference to the drawings, various technical modifications and variations may be applied to those skilled in the art. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

In the following, embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the patent application is not limited or limited by these embodiments. Like reference symbols in the drawings denote like elements.

Various modifications may be made to the embodiments described below. It is to be understood that the embodiments described below are not intended to limit the embodiments, but include all modifications, equivalents, and alternatives to them.

The terms used in the examples are used only to illustrate specific embodiments and are not intended to limit the embodiments. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

1 is a block diagram of a content service providing system according to an exemplary embodiment of the present invention.

The content service providing system includes a server 110 and a user terminal 120. The server 110 may provide the content service to the user terminal 120. For example, the content service may be a game service, and is not limited to the described embodiment. The user terminal 120 may receive a program for content service from the server 110 in advance and install the program in the user terminal 120. [ The user terminal 120 may include a personal computer (PC) and a mobile device, and is not limited to the described embodiment.

The user terminal 120 can use the content service through the program. The user terminal 120 transmits the user data generated while using the content service to the server 110 and the server 110 can provide the content service reflecting the user data to the user terminal 120.

The user of the user terminal 120 desires to have a desired result while using the content service. For example, if the content service is a game service, the user desires to improve the ability of the user character or acquire a high-grade item. Such a user desire may appear as a reaction of the user during use of the content service. For example, a user's reaction may appear as a voice, an action, and a body reaction. The user reaction can be measured using the user information obtained through the sensor. The meaning of the user reaction can be determined based on the characteristics of the user information. For example, what the user reaction means is the user's emotions.

The additional effect of the content service on the user's emotions is determined, and the determined additional effect can be provided to the user. If the additional effect is provided to the user, the user can feel the unexpected fun in the existing contents service.

Hereinafter, a method of providing a content service to a user based on user information will be described in detail with reference to FIG. 2 to FIG.

2 is a configuration diagram of a content service providing apparatus according to an embodiment.

The content service providing apparatus 200 includes a communication unit 210, a processor 220, and a memory 230. The content service provision apparatus 200 may be the server 110 or the user terminal 120 described above with reference to FIG. That is, the description of the content service providing apparatus 200 according to the embodiment can be understood as a description of the server 110 or the user terminal 120.

The communication unit 210 is connected to the processor 220 and the memory 230 to transmit and receive data. The communication unit 210 may be connected to another external device to transmit / receive data.

The communication unit 210 may be implemented as a circuitry in the content service providing apparatus 200. For example, the communication unit 210 may include an internal bus and an external bus. As another example, the communication unit 210 may be an element for connecting the content service providing apparatus 200 with an external apparatus. The communication unit 210 may be an interface. The communication unit 210 can receive data from an external device and transmit data to the processor 220 and the memory 230. [

The processor 220 processes the data received by the communication unit 210 and the data stored in the memory 230. "Processor" may be a data processing device embodied in hardware having circuitry having a physical structure for performing desired operations. For example, the desired actions may include code or instructions included in the program. For example, a data processing apparatus embodied in hardware may be a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, , An application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA).

The processor 220 executes computer readable code (e.g., software) stored in a memory (e.g., memory 230) and instructions triggered by the processor 220.

The memory 230 stores data received by the communication unit 210 and data processed by the processor 220. [ For example, the memory 230 may store a program. The stored program may be a set of syntaxes executable by the processor 220 that are coded to provide a content service to a user.

According to an aspect, the memory 230 may include one or more volatile memory, non-volatile memory and random access memory (RAM), flash memory, hard disk drive, and optical disk drive.

The memory 230 stores a set of instructions (e.g., software) for operating the content service providing apparatus 200. [ The instruction set that operates the content service providing apparatus 200 is executed by the processor 220. [

The communication unit 210, the processor 220, and the memory 230 will be described in detail with reference to Figs. 3 to 9 below.

3 is a flowchart of a content service providing method according to an exemplary embodiment of the present invention.

The following steps 310 to 350 are performed by the content service provision apparatus 200 described above with reference to Fig.

Before the step 310 is performed, a content service may be provided to the user via the user terminal. For example, when the content service is a game service, the user can play the game through the program installed in the user terminal.

In step 310, the content service providing apparatus 200 determines whether the current status of the content service is a preset status. It can be determined whether a label is attached in advance to an important situation in the content service and whether the current situation corresponds to a situation in which the label is attached. For example, a preset situation may be a situation where the user makes a selection within the game service. As another example, a preset situation may be a situation in which a specific character (e.g., boss character) appears in the game service. As another example, a preset situation may be a situation in which a new item for a game service is provided to the user. A new item may be determined based on a probability among a plurality of items.

When the content service providing apparatus 200 is the server 110, it is possible to receive the user data generated by using the content service from the user terminal, and to determine whether the current situation of the content service is a preset situation have.

According to one aspect, if the current situation is a preset situation, the user can input the result that he / she wants to occur in the current situation through the user terminal 120. For example, if the current situation is a situation where a die is being thrown, the user can enter the number that he wants to appear. As another example, if the current situation is a situation where a new item is determined, the user may enter a new item of interest.

In step 320, if the current situation is a preset state, the content service providing apparatus 200 receives user information on the current situation from the user. The user information may be a user's reaction to the current situation. User information may be generated via one or more sensors. The sensor may be included in a user terminal or may be connected to a user terminal.

For example, the content service providing apparatus 200 may receive user's voice generated through a microphone as user information. As another example, the content service providing apparatus 200 may receive the face image of the user generated through the camera as user information. As another example, the content service providing apparatus 200 may receive the user's biometric signal generated through the biosensor as user information. The biological signal may include an EMG signal, an EEG signal, and the like, and is not limited to the described embodiments.

In step 330, the content service providing apparatus 200 determines a type of emotion and a level of emotion of the user based on the user information. For example, if the content service is game content, the user desires to be in a good situation for the user to proceed in favor of the game content. That is, the user may have an emotion of eagerness. Since the emotion can be revealed by the user information, the content service providing apparatus 200 can generate the characteristics of the user information and determine what kind of emotion the user information represents based on the generated characteristics. The degree of emotion can be determined based on the intensity of the generated feature. Referring to FIG. 5 below, a method for determining the type of the user's emotion and the degree of emotion for the current situation based on the user information will be described in detail.

In step 340, the content service providing apparatus 200 determines an effect on the current situation. For example, if the current situation is a situation where the user makes a choice within the game service, the determined effect may be an opportunity for further selection. As another example, if the current situation is a situation in which a specific character (e.g., boss character) appears within the game service, the determined effect may be the effect of increasing the user's character's ability. As another example, if the current situation is a situation where a new item for a game service is presented to the user, the determined effect may be the effect of paying additional items in addition to the determined new item. Various effects other than the effects disclosed can be considered and are not limited to the disclosed embodiments.

In step 350, the content service providing apparatus 200 provides the content service to the user by applying the determined effect to the current situation.

When the content service providing apparatus 200 is the server 110, the information about the determined effect is transmitted to the user terminal 120, and the user terminal 120 can apply the determined effect to the content service.

A method of providing the content service to the user by applying the determined effect to the current situation will be described in detail below with reference to FIG.

4 is a flow diagram of a method for receiving information of a user according to an example.

Step 320 described above with reference to FIG. 3 may include the following steps 410 - 430. Steps 410 through 430 may be performed in parallel and independently.

At step 410, the microphone of the user terminal 120 receives voice from the user. The user can express the expression indicating the eagerness or expectation of the present situation by voice. For example, a user may cite the words "please" and "one time only" indicating words of desire.

In step 420, the camera of the user terminal 120 generates a face image that includes the user's face. The user can express the expressions representing the eagerness or expectation of the present situation with the expression of the face.

In step 430, the biosensor of the user terminal 120 generates a user's biosignal. The user's biomedical signal may appear differently depending on the user's emotions. For example, if the user is tense, the muscles can contract.

According to an aspect, when the content service providing apparatus 200 is the server 110, the content service providing apparatus 200 receives the user information from the user terminal 120. [

5 is a flow diagram of a method for determining the type of emotion and degree of emotion of a user according to an example.

The above-described step 330 with reference to FIG. 3 may include the following steps 510 to 520.

In step 510, the content service providing apparatus 200 determines whether the user's emotion is the target emotion based on the user information. According to one aspect, the content service providing apparatus 200 can extract one or more characteristics of user information using an algorithm, and can determine whether the user's emotion is a target emotion based on the extracted features. For example, the algorithm may be pre-trained and trained during the provision of content services.

A method for determining whether a user's emotion is a target emotion is described in detail below with reference to Figs. 6 and 7 below.

In step 520, the content service providing apparatus 200 determines the degree of target emotion based on the user information. For example, the degree of target emotion can be determined based on the number or size of extracted features.

6 is a flowchart of a method for determining whether a user's emotion is a target emotion based on user information according to an example.

According to an aspect, if the user information is the user's voice, step 510 described above with reference to FIG. 5 includes the following steps 610 and 620.

In step 610, the content service providing apparatus 200 extracts an acoustic characteristic, a prosodic characteristic, and a linguistic characteristic of a voice. The content service providing apparatus 200 can extract features while moving a window of a predetermined time size over the entire section of the voice.

For example, the acoustic characteristic may be a vector generated using a method such as Mel Frequency Cepstral Coefficients (MFCC), WaveNet, or the like. The prosodic feature may be a vector representing at least one of pause between words, prosody, and loudness. The linguistic feature may be a vector generated by processing the phonemes and words of the user speech obtained through STT (speech to text) through representation learning such as word2vec. A feature vector sequence can be generated using a window of a preset time size.

In step 620, the content service providing apparatus 200 determines whether the user's emotions correspond to the target emotion (e. G., Eagerness) based on the extracted acoustic characteristics, prosodic characteristics, and linguistic characteristics . For example, the content service providing apparatus 200 may be implemented by using HMM (Hidden Markov Models), CRF (Conditional Random Fields), RNN (Recurrent Neural Network), LSTM (Long Short Term Memory) The emotion classification algorithm can be used to determine whether the user's emotions correspond to the target emotions. The emotion classification algorithm may use the feature vector sequence to determine whether the emotion of the user corresponds to the target emotion.

According to an aspect, the content service provision apparatus 200 can determine whether at least one of the acoustic characteristic, the prosodic characteristic, and the linguistic characteristic of the voice corresponds to at least one characteristic preset for the target emotion. For example, at least one feature preset for the target emotion may be set according to the user's profile. That is, if the user's profile is a man in his twenties, the predetermined characteristics for the target emotion may be the characteristics of the twenties and male characteristics. As another example, at least one of the features preset for the target emotion may be set arbitrarily among the plurality of features. That is, even if the user's profile is a twenties male, the pre-set features for the target emotions can be forty features and female features.

FIG. 7 is a flowchart of a method of extracting an acoustic characteristic, a prosodic characteristic, and a linguistic characteristic of a voice when the user information according to an example is speech.

Step 610 described above with reference to FIG. 6 includes the following steps 710, 720, and 730.

In step 710, the content service providing apparatus 200 determines whether or not the algorithm for extracting features has been sufficiently trained. For example, for a preset situation, a user voice over a preset period of time may be generated, and an algorithm for extracting voice characteristics using the generated user voice may be trained. The better the training, the better the personalized characteristics of the user's voice can be extracted. For example, the voice of the generated user can be labeled and the algorithm can be trained using labels. If the accuracy of the feature generated by the algorithm is above the threshold, then the algorithm may be judged to be well trained. The trained algorithm may be a personalized algorithm.

If the algorithm is sufficiently trained, then step 720 is performed; otherwise, step 730 is performed.

In step 720, the content service providing apparatus 200 extracts an acoustic characteristic, a prosodic characteristic, and a linguistic characteristic of a voice using a personalized algorithm.

In step 730, the content service providing apparatus 200 extracts an acoustic characteristic, a prosodic characteristic, and a linguistic characteristic of a voice using a basic algorithm. According to one aspect, the acoustic, prosodic, and linguistic features of speech can be extracted using algorithms for other users having profiles that are similar (or the same) as the user's profile.

8 is a flow chart of a method for determining an effect on a current situation according to an example.

Step 340 described above with reference to FIG. 3 may include the following steps 810, 820, and 830. One of steps 810, 820 and 830 may be performed depending on the type of current situation determined in step 310. [

In step 810, the content service providing apparatus 200 gives the user an opportunity for additional selection if the current situation is a situation where the user makes a selection within the game service. For example, the current situation in which a user makes a selection may be a situation in which a user throws a die within a game. If the user is given the opportunity of further selection, the user can throw additional dice. For example, a user may select a value of a value of a die from two opportunities. As another example, the value of the dice that occurs through additional opportunities may automatically be reflected in the game.

In step 820, the content service providing apparatus 200 increases the capability of the user's character if the current situation is a situation in which a specific character appears in the game service. Users can enjoy game services more easily by using characters with increased ability.

In step 830, if the current state of the content service providing apparatus 200 determines a new item for the game service to be provided to the user, the content service providing apparatus 200 may provide the user with an additional item in addition to the determined new item.

9 is a flowchart of a method of providing a content service to a user by applying a determined effect according to an example to a current situation.

According to one aspect, step 350 described above with reference to Figure 3 may include the following steps 910 and 920. [ Steps 910 and 920 can be performed when the current situation is a situation in which the user makes a selection in the game service or when the current situation is a situation in which a new item for the game service is provided to the user.

In step 910, the content service providing apparatus 200 outputs the user's selection (e.g., the value of the die) or the determined new item to the user through the display of the user terminal. Step 910 may be performed to inform the user whether the user has made a desired result.

When the user does not generate a desired result, the content service providing apparatus 200 can determine the effect on the current situation and determine the result of the effect.

In step 920, the content service providing apparatus 200 outputs a result of a further given selection to the user if the current situation is a situation in which the user makes a selection within the game service (for example, Value). As another example, in a situation where the current situation determines a new item for the game service provided to the user, the content service providing apparatus 200 pays an additional item to the user and outputs it to the display.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

110: Server
120: User terminal
200: Content service provider
210:
220: Processor
230: Memory

Claims (25)

The content service providing apparatus comprises:
A memory in which a program for providing contents is recorded; And
The processor
Lt; / RTI >
The program includes:
Determining whether the current status of the content service provided to the user is a preset status;
Receiving user information on the current situation from the user if the current situation is the preset situation, the user information including the user's voice;
Determining a type of emotion of the user and a level of emotion of the current situation based on the user information;
Determining an effect on the current situation based on the determined type of emotion and the degree of emotion; And
Providing the content service to the user by applying the determined effect to the current situation
Lt; / RTI >
Wherein the step of determining the type of emotion and the degree of emotion of the user comprises:
Determining whether the emotion of the user is a target emotion by extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the voice using a feeling classification algorithm; And
Determining whether the at least one feature of the extracted speech corresponds to a predetermined feature for the target emotion, wherein the predetermined feature for the target emotion is one of the features for each of the plurality of user profiles Wherein the characteristics for each of the plurality of user profiles include at least one of age characteristics and gender characteristics,
/ RTI >
A content service providing apparatus.
The method according to claim 1,
The content service is a game service,
A content service providing apparatus.
3. The method of claim 2,
Wherein the predetermined condition is a situation in which the user makes a selection in the game service,
A content service providing apparatus.
3. The method of claim 2,
The predetermined condition may be a situation in which a specific character appears in the game service,
A content service providing apparatus.
3. The method of claim 2,
Wherein the predetermined condition is a situation for determining a new item for the game service provided to the user,
A content service providing apparatus.
The method according to claim 1,
Wherein the receiving the user information for the current situation from the user comprises:
Receiving the voice of the user via the microphone as the user information
/ RTI >
A content service providing apparatus.
The method according to claim 6,
Wherein the receiving the user information for the current situation from the user comprises:
Receiving the face image of the user as the user information through a camera; And
Receiving biometric signals of the user through the biosensor as the user information
≪ / RTI >
A content service providing apparatus.
delete The method according to claim 1,
The target emotion may be eagerness,
A content service providing apparatus.
delete The method according to claim 1,
The step of extracting at least one of the acoustic feature, the prosodic feature, and the linguistic feature of the speech includes:
Extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the voice based on a data set for other users having the same profile as the profile of the user
/ RTI >
A content service providing apparatus.
The method according to claim 1,
The step of extracting at least one of the acoustic feature, the prosodic feature, and the linguistic feature of the speech includes:
Extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the speech based on the data set generated for the user
/ RTI >
A content service providing apparatus.
The method according to claim 1,
The emotion classification algorithm may be pre-trained to be personalized to the user,
A content service providing apparatus. 14. The method of claim 13,
Training the emotion classification algorithm
Further comprising:
Wherein training the emotion classification algorithm comprises:
Generating a user voice over a preset time for a preset situation;
Training the emotion classification algorithm using the generated user voice; And
Terminating the training of the emotion classification algorithm if the accuracy of the feature generated by the emotion classification algorithm is greater than or equal to a threshold value
The content service providing apparatus comprising:
The method according to claim 1,
Wherein at least one feature preset for the target emotion is set arbitrarily among a plurality of features,
A content service providing apparatus.
The method according to claim 1,
Wherein if the current situation is a situation where the user makes a selection in the game service,
A content service providing apparatus.
The method according to claim 1,
Wherein when the current situation is a situation where a specific character appears in the game service, the determined effect is an effect of increasing the ability of the user's character,
A content service providing apparatus.
The method according to claim 1,
Wherein if the current situation determines a new item for a game service provided to the user, the determined effect is an effect of paying an additional item in addition to the determined new item,
A content service providing apparatus.
A content service method performed by a content service providing apparatus for providing a content service to a user,
Determining whether the current status of the content service provided to the user is a preset status;
Receiving user information on the current situation from the user if the current situation is the preset situation, the user information including the user's voice;
Determining a type of emotion of the user and a level of emotion of the current situation based on the user information;
Determining an effect on the current situation based on the determined type of emotion and the degree of emotion; And
Providing the content service to the user by applying the determined effect to the current situation
Lt; / RTI >
Wherein the step of determining the type of emotion and the degree of emotion of the user comprises:
Determining whether the emotion of the user is a target emotion by extracting at least one of an acoustic characteristic, a prosodic characteristic and a linguistic characteristic of the voice using a feeling classification algorithm; And
Determining whether the at least one feature of the extracted speech corresponds to a predetermined feature for the target emotion, wherein the predetermined feature for the target emotion is one of the features for each of the plurality of user profiles Wherein the characteristics for each of the plurality of user profiles include at least one of age characteristics and gender characteristics,
/ RTI >
A method of providing a content service.
20. The method of claim 19,
Wherein the step of determining the type of emotion and the degree of emotion of the user comprises:
Determining whether the user's emotion is a target emotion based on the user information; And
Determining the degree of skepticism based on the user information
/ RTI >
A method of providing a content service.
delete 21. The method of claim 20,
Wherein if the current situation is a situation where the user makes a selection in the game service,
A method of providing a content service.
21. The method of claim 20,
Wherein when the current situation is a situation where a specific character appears in the game service, the determined effect is an effect of increasing the ability of the user's character,
A method of providing a content service.
21. The method of claim 20,
Wherein if the current situation determines a new item for a game service provided to the user, the determined effect is an effect of paying an additional item in addition to the determined new item,
A method of providing a content service. A computer-readable recording medium embodying a program for carrying out the method of any one of claims 19, 20, 22, 23 and 24.

Images