TW201324192A - System for playing multimedia based on user's emotion and method thereof - Google Patents

Abstract

A system for playing multimedia based on user's emotion and a method thereof are provided. By determining a emotion of a user in accordance with physiology of the user, and reading a multimedia corresponding to the emotion of the user, the system and the method can play suitable multimedia according with user's emotion, and can achieve the effect of diverting user's attention for relaxing user's emotion when user feels down.

Description

System and method for playing corresponding multimedia material according to user emotion

A multimedia playing system and method thereof, in particular, a system and method for playing corresponding multimedia materials according to user emotions.

Most people have experienced negative feelings such as depression, depression, depression, and unhappiness, but after a period of adjustment, they can usually return to normal emotional state.

With the advent of the multimedia era, people can enjoy the entertainment effects brought by multimedia anytime and anywhere. For example, through a variety of sound fields to simulate sound effects to play and enjoy multimedia materials such as audio and video, in addition to bringing a lot of entertainment effects, multimedia materials can also be Entertainment effects affect people's emotions. Therefore, when most people are in a bad mood, they usually speed up their emotional response through the entertainment provided by multimedia materials.

When people are in a bad mood, in addition to manually playing multimedia materials such as audio and video, they also automatically detect the user's emotions and play appropriate multimedia materials according to the user's emotions. For example, Taiwan Patent No. 200619977 can be used. After measuring the external environment data, the user's emotional state is judged, and after the multimedia data having the user's emotion is alleviated by the context database, the relevant multimedia material is played by the output device, thereby relieving the environment and causing the user Emotional problems, in order to achieve the effect of easing the user's emotions.

However, the above-mentioned audio-visual control device judges the user's emotion through the data of the external environment, which cannot be caused when the user changes the mood due to non-environmental factors, for example, when the user has a depression or is on the phone. When the person quarrels with the person, the user's emotional changes cannot be detected correctly. Therefore, the above-mentioned video and audio control device may play the sad multimedia material when the user's mood is low, thereby causing the user's emotion to be lower.

In summary, it can be seen that in the prior art, there has been a long-standing problem that the AV control device cannot play the appropriate multimedia material according to the user's emotion. Therefore, it is necessary to propose an improved technical means to solve this problem.

In view of the prior art, there is a problem that a suitable multimedia material cannot be played according to user emotions, and the present invention discloses a system and method for playing corresponding multimedia materials according to user emotions, wherein:

The system for playing the corresponding multimedia data according to the user's emotion disclosed in the present invention includes at least: a physiological state receiving module for receiving physiological state data of the user transmitted by the physiological state detecting device; and an emotion determining module for Determining the user's emotional state based on physiological state data; a database for storing multimedia data; a multimedia reading module for reading multimedia data corresponding to the emotional state from the database; and a playing module for playing multimedia Read the multimedia data read by the module.

The method for playing the corresponding multimedia material according to the user's emotion disclosed in the present invention includes the following steps: the physiological state detecting device detects the physiological state data of the user, and the physiological state detecting device transmits the physiological state data to the digital device; The device determines the emotional state of the user according to the physiological state data; the digital device reads the multimedia material corresponding to the emotional state; and the digital device plays the multimedia data.

The system and method disclosed in the present invention are different from the prior art in that the present invention determines the emotional state of the user through the physiological state of the user, and reads the corresponding multimedia material according to the emotional state of the user, thereby solving the previous The technical problems can be achieved by shifting the user's attention when the user's mood is low to relax the user's emotional effect.

The features and embodiments of the present invention will be described in detail below with reference to the drawings and embodiments, which are sufficient to enable those skilled in the art to fully understand the technical means to which the present invention solves the technical problems, and The achievable effects of the present invention.

The invention can judge the emotional state of the user according to the physiological state of the user, and play the corresponding multimedia material according to the emotional state of the user, thereby helping the user to divert attention when the user's mood is not good. The physiological state mentioned in the present invention includes, but is not limited to, a user's body temperature, heart rate, blood pressure, respiratory rate/cycle, and the like; and the multimedia material of the present invention includes sound files, movies, or albums such as songs or music. Such as audio and video files, etc., but the invention is not limited thereto.

The system operation of the present invention will be described below with reference to the system architecture diagram of the present invention for playing the corresponding multimedia material according to the user's emotion. As shown in FIG. 1, the system of the present invention is applied to the digital device 100, and includes a physiological state receiving module 110, an emotion determining module 130, a database 140, a multimedia reading module 150, and a playing module 160.

The physiological state receiving module 110 is responsible for receiving the physiological state data of the user transmitted by the physiological state detecting device 200. In general, the physiological state receiving module 110 can receive the physiological state data transmitted by the physiological state detecting device 200 by using a wireless technology such as WiFi or RFID. The physiological state data received by the physiological state receiving module 110 may include one or more items.

The physiological state detecting device 200 can sense the physiological state of the user, and convert the physiological state obtained by the sensing into the physiological state data, and then transmit the data to the physiological state receiving module 110, and the physiological state detecting device 200 may also feel After the physiological state of the user is detected, the signal indicating the physiological state is transmitted to the physiological state receiving module 110, and the signal indicating the physiological state is converted into the physiological state data by the physiological state receiving module 110.

In addition, it is particularly worth mentioning that the appearance of the physiological condition detecting device 200 of the present invention may be a patch type, and the user can attach it to a specific part of the body, so that the user's daily life is not affected. Work and rest.

The emotion determination module 130 is responsible for determining the emotional state of the user according to the physiological state data received by the physiological state receiving module 110. For example, when the depression symptoms occur, the heart rate is usually affected, and the heart rate is increased. Therefore, the emotion determination module 130 can determine the user's heart rate when the heart rate received by the physiological state receiving module 110 increases. The emotional state is melancholy. For example, the emotion determination module 130 can determine that the emotional state of the user is nervous or angry when the blood pressure received by the physiological state receiving module 110 is increased. However, the manner in which the emotion determination module 130 determines the emotional state of the user is not limited to the above.

The database 140 is responsible for storing multimedia materials. Each of the multimedia materials stored in the database 140 corresponds to one or more emotional states of the person. Generally, the database 140 can record the correspondence between the multimedia materials and the emotional state by storing attributes or classifications of the multimedia materials. However, the invention is not limited thereto.

In addition, in some embodiments, the type of each multimedia material or the preference of the user may also be stored in the database 140.

The multimedia reading module 150 is responsible for reading the corresponding multimedia material in the database 140 according to the emotional state determined by the emotion determination module 130. The multimedia reading module 150 may need to be first and foremost before reading the multimedia data, because the multimedia data corresponding to the emotional state determined by the emotion determining module 130 may be stored in the database 140. The multimedia data corresponding to the emotional state determined by the determining module 130 is selected to select one multimedia material, and then the selected multimedia material is read out.

In addition, it is particularly worth mentioning that, in order to effectively attract the attention of the user, in some embodiments, the multimedia reading module 150 can further depend on the type of each multimedia material stored in the database 140, or The user's preference is to read multimedia materials that match the user's preferences.

In addition, the multimedia reading module 150 can also read the multimedia material only when the emotional state determined by the emotion determination module 130 does not belong to the positive emotion. In this case, the multimedia reading module 150 will determine whether the emotional state determined by the emotion determination module 130 does not belong to a positive emotion. Among them, the present invention is not an emotional state of positive emotions, such as depression, anger, sadness, depression, depression, etc., but the invention is not limited thereto.

The playing module 160 is responsible for playing the multimedia material read by the multimedia reading module 150, so as to attract the attention of the user, thereby helping the user to relieve the emotion.

In addition, the system of the present invention may further include an add-on multimedia downloading module 190, and the multimedia downloading module 190 is responsible for one or more keywords corresponding to the emotional state determined by the emotion determining module 130. The road searches for multimedia material corresponding to the emotional state determined by the emotion judgment module 130. The multimedia download module 190 can determine the multimedia data corresponding to the emotional state from one or more network data in the network according to the keyword corresponding to the emotional state determined by the emotion determining module 130. The multimedia material corresponding to the emotional state is downloaded to the repository 140 for storage.

The operation system and method of the present invention are explained in one embodiment, and the flow chart of the method for playing the corresponding multimedia material according to the user's emotion according to the present invention is described with reference to "2A". In the present embodiment, it is assumed that the digital device 100 to which the present invention is applied is a computer, and the physiological state detecting device 200 is of a patch type, but the invention is not limited thereto.

After the user attaches the physiological state detecting device 200 to the body, the physiological state detecting device 200 can start detecting the physiological state of the user (step 310). In this embodiment, it is assumed that the physiological state detected by the physiological state detecting device 200 is the heart rate.

After the physiological state detecting device 200 detects the physiological state of the user (step 310), the physiological state detecting device 200 can transmit the detected physiological state data to the digital device 100 (step 321). In the present embodiment, it is assumed that the physiological state detecting device 200 wirelessly transmits the detected heart rate of the user to the computer (digital device 100).

After the physiological state receiving module 110 of the digital device 100 receives the physiological state data transmitted by the physiological state detecting device 200, the emotion determining module 130 of the digital device 100 can receive the physiological state received by the module 110 according to the physiological state. The data determines the emotional state of the user (step 330). In this embodiment, if the heart rate received by the physiological state receiving module 110 is gradually increased in a short time, the emotion determining module 130 can determine the heart rate according to the physiological state receiving module 110. The emotional state of the user is melancholy.

After the emotion determination module 130 of the digital device 100 determines the emotional state of the user according to the physiological state data (step 330), the multimedia reading module 150 of the digital device 100 can read the emotional judgment module in the database 140. 130 the multimedia material corresponding to the determined emotional state (step 380). In this embodiment, if the database 140 stores a plurality of multimedia materials corresponding to the emotional state of depression, the multimedia reading module 150 may select one of the multimedia materials according to the user's preference, for example, selecting the user most likely to be interested. Multimedia material.

In practice, after the emotion determination module 130 of the digital device 100 determines the emotional state of the user (step 330), the multimedia reading module 150 of the digital device 100 may first determine whether the user's emotional state is not positive. Emotion (step 370), and only when the user's emotional state is not positive, the multimedia data corresponding to the emotional state determined by the emotion determination module 130 is read into the database 140 (step 380), and If the emotional judgment module 130 determines that the emotional state belongs to a positive emotion, the multimedia reading module 150 will not read the multimedia material into the database 140. In this embodiment, even if the multimedia reading module 150 of the digital device 100 reads or does not read the multimedia material according to whether the emotional state does not belong to the positive mood, the user judged by the emotion determining module 130 The emotional state is a depression that is not a positive emotion. Therefore, the multimedia reading module 150 of the digital device 100 still reads the multimedia material corresponding to the emotional state of the user in the database 140 according to the emotional state of the user.

After the multimedia data corresponding to the emotional state is read in the multimedia reading module 150 to the data library 140 of the digital device 100 (step 380), the playing module 160 of the digital device 100 can start playing the multimedia reading module 150. Reading the multimedia material (step 390), causing the screen display of the computer and/or the sound of the speaker of the computer to attract the user's attention, so that the user pays attention to the screen played by the player module 160. And / or sound, thereby relaxing the user's mood.

In the above embodiment, if the digital device 190 is further included in the digital device 100, the multimedia download module 190 can determine the emotion determination module 130 of the digital device 100 as shown in the flow of FIG. 2B. After the emotional state of the user (step 330), the multimedia download module 150 of the digital device 100 searches for the keyword search and emotion determination module 130 according to the keyword corresponding to the emotional state determined by the emotion determination module 130. After determining the multimedia material corresponding to the emotional state (step 350), downloading the multimedia material corresponding to the emotional state of the user (step 360), and storing the downloaded multimedia material into the database 140, thereby providing the multimedia reading mode The group 150 reads the downloaded multimedia material (step 380), avoiding the user repeatedly watching the same multimedia material in the database 140 repeatedly and not attracting the user's attention.

In summary, it can be seen that the difference between the present invention and the prior art is that there is a technical means for judging the emotional state of the user according to the physiological state of the user, and reading the corresponding multimedia material according to the emotional state of the user. A technical means can solve the problem that the prior art cannot play the appropriate multimedia material according to the user's emotion, thereby achieving the technical effect of transferring the user's attention to relax the user's emotion when the user's mood is low.

Furthermore, the method for playing corresponding multimedia materials according to the user's emotions can be implemented in hardware, software or a combination of hardware and software, or can be implemented in a centralized manner in a computer system or distributed in different components. The decentralized implementation of interconnected computer systems.

While the embodiments of the present invention have been described above, the above description is not intended to limit the scope of the invention. Any modification of the form and details of the practice of the present invention, which is a matter of ordinary skill in the art to which the present invention pertains, is a patent protection of the present invention. range. The scope of the invention is to be determined by the scope of the appended claims.

110. . . Physiological state receiving module

130. . . Emotional judgment module

140. . . database

150. . . Multimedia reading module

160. . . Playback module

190. . . Multimedia download module

200. . . Physiological state sensing device

Step 310: The physiological state detecting device detects the physiological state data of the user.

Step 321 The physiological state detecting device transmits the physiological state data to the digital device

Step 330: The digital device determines the emotional state of the user according to the physiological state data.

Step 350: The digital device determines the multimedia material corresponding to the emotional state from the network data according to the keyword corresponding to the emotional state.

Step 360 Download Gallery

Step 370 The digital device determines whether the emotional state belongs to positive emotions

Step 380: The digital device reads the multimedia material corresponding to the emotional state

Step 390 Digital device playing multimedia data

FIG. 1 is a system architecture diagram of the present invention for playing corresponding multimedia materials according to user emotions.

FIG. 2A is a flow chart of a method for playing corresponding multimedia materials according to user emotions according to the present invention.

FIG. 2B is a flow chart of an additional method for downloading multimedia materials according to the present invention.

Step 310: The physiological state detecting device detects the physiological state data of the user.

Step 321 The physiological state detecting device transmits the physiological state data to the digital device

Step 330: The digital device determines the emotional state of the user according to the physiological state data.

Step 370 The digital device determines whether the emotional state belongs to positive emotions

Step 380: The digital device reads the multimedia material corresponding to the emotional state

Step 390 Digital device playing multimedia data

Claims (10)

A method for playing corresponding multimedia data according to a user's emotions, the method comprising at least the following steps: a physiological state detecting device detects a physiological state data of a user; and the physiological state detecting device transmits the physiological state data to a a digital device; the digital device determines an emotional state of the user according to the physiological state data; the digital device reads one of the multimedia materials corresponding to the emotional state; and the digital device plays the multimedia material. The method for playing the corresponding multimedia material according to the user's emotion according to the first aspect of the patent application, wherein the step of the digital device reading the multimedia material corresponding to the emotional state further comprises the digital device reading the user preference The steps of the multimedia material. The method for playing the corresponding multimedia material according to the user's emotion according to the first aspect of the patent application, wherein the step of the digital device reading the multimedia material corresponding to the emotional state further comprises the digital device determining that the emotional state is not positive. The step of reading the multimedia material when feeling emotional. The method for playing the corresponding multimedia material according to the user's emotion according to the first aspect of the patent application, wherein the method further comprises the digital device after the step of determining, by the digital device, the emotional state of the user according to the physiological state data. And the step of downloading the multimedia material after searching for the multimedia material corresponding to the emotional state by using at least one keyword corresponding to the emotional state. A system for playing corresponding multimedia materials according to user emotions is applied to a digital device, wherein the digital device provides a physiological state detecting device connection, and the system includes at least: a physiological state receiving module for receiving the physiological state detection One of the user's physiological state data transmitted by the measuring device; an emotional judgment module for determining an emotional state of the user based on the physiological state data; a database for storing a plurality of multimedia materials; a multimedia The reading module is configured to read the multimedia material corresponding to the emotional state from the database; and a playing module for playing the multimedia material read by the multimedia reading module. For example, in the system of claim 5, the system for playing corresponding multimedia materials according to user emotions, wherein the physiological state receiving module receives the physiological state data by wireless technology. For example, the system for playing corresponding multimedia materials according to user emotions as described in claim 5, wherein the physiological state detecting device is shaped as a patch. The system for playing corresponding multimedia materials according to user emotions as described in claim 5, wherein the multimedia reading module is further configured to read the multimedia material when the emotional state is not positive. The system for playing the corresponding multimedia material according to the user's emotion, as described in claim 5, wherein the system further includes a multimedia downloading module for searching by the network according to at least one keyword corresponding to the emotional state. After the multimedia material corresponding to the emotional state, the multimedia material is downloaded. The system for playing the corresponding multimedia material according to the user's emotion, as described in claim 5, wherein the multimedia reading module is further configured to read the multimedia material that meets the user's preference.