CN116486770A - Vehicle-mounted K song method, electronic equipment, storage medium and vehicle - Google Patents
Vehicle-mounted K song method, electronic equipment, storage medium and vehicle Download PDFInfo
- Publication number
- CN116486770A CN116486770A CN202210051163.7A CN202210051163A CN116486770A CN 116486770 A CN116486770 A CN 116486770A CN 202210051163 A CN202210051163 A CN 202210051163A CN 116486770 A CN116486770 A CN 116486770A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- position information
- streaming media
- audio data
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000012545 processing Methods 0.000 claims description 50
- 238000004590 computer program Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 3
- 238000012958 reprocessing Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 17
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000000605 extraction Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004936 stimulating effect Effects 0.000 description 2
- 241000271897 Viperidae Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
- G10H1/368—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The embodiment of the invention provides a vehicle-mounted karaoke method, electronic equipment, a storage medium and a vehicle. The method comprises the following steps: responding to a first selection operation of a user, starting a vehicle-mounted camera to carry out picture shooting, and obtaining initial streaming media data; identifying initial streaming media data, and acquiring first position information of a face image on a shooting picture; collecting audio data through a voice sensor, and analyzing the audio data to obtain sound source position information of the audio data; determining second position information of the output object according to the first position information and the sound source position information; calling a vehicle-mounted camera to shoot pictures aiming at an output object according to the second position information to obtain first streaming media data; the audio data is combined with the first streaming media data to generate an MV. Through the method of the embodiment, the K song MV belonging to the user can be generated, so that the user can obtain the K song MV belonging to the user after the K song, and the entertainment activity of the user after the K song in the vehicle is further enriched.
Description
Technical Field
The embodiment of the invention relates to the technical field of vehicle entertainment, in particular to a vehicle-mounted K song method, electronic equipment, a storage medium and a vehicle.
Background
With the improvement of the living standard of people, automobiles become an indispensable leisure space in the life of people gradually, and in order to meet the leisure and entertainment demands of people, vehicle-mounted entertainment systems in automobiles are also updated continuously, wherein vehicle-mounted K songs become a very popular in-vehicle entertainment mode.
However, in the current vehicle-mounted karaoke method, a user can only perform karaoke according to song accompaniment and lyrics in a vehicle, and enjoy the pleasure of singing the karaoke, namely the user can only enjoy the pleasure in the singing process, but the entertainment is limited in the way, and more entertainment demands of people, especially after the karaoke of the user is completed, cannot be met.
Disclosure of Invention
The embodiment of the invention provides a vehicle-mounted karaoke method, electronic equipment, a storage medium and a vehicle, and aims to further enrich in-vehicle entertainment activities.
The first aspect of the embodiment of the invention provides a vehicle-mounted K song method, which comprises the following steps:
responding to a first selection operation of a user, starting a vehicle-mounted camera to carry out picture shooting, and obtaining initial streaming media data; identifying the initial streaming media data, and acquiring first position information of a face image on a shooting picture;
collecting audio data through a voice sensor, and analyzing the audio data to obtain sound source position information of the audio data;
determining second position information of an output object according to the first position information and the sound source position information;
calling a vehicle-mounted camera to aim at the output object to shoot pictures according to the second position information so as to obtain first streaming media data;
and combining the audio data with the first streaming media data to generate MV.
A second aspect of an embodiment of the present invention provides an electronic device, including: comprising a memory, a processor and a computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, implements a method for on-board K-songs according to the first aspect of an embodiment of the invention.
A third aspect of the embodiment of the present invention provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the vehicle-mounted K song method of the first aspect of the embodiment of the present invention.
A fourth aspect of an embodiment of the present invention provides a vehicle, including: the vehicle-mounted K song method comprises an electric element and a vehicle-mounted terminal, wherein the vehicle-mounted terminal is used for realizing the vehicle-mounted K song method according to the first aspect of the embodiment of the invention when being executed.
According to the vehicle-mounted K song method provided by the embodiment of the invention, when a user carries out K songs in a vehicle, the vehicle-mounted terminal can determine the specific position of the K singer in the vehicle by calling the linkage of the camera and the voice sensor, and then the K singer is aligned to the vehicle-mounted camera to record K songs MV, so that K songs MV belonging to the user are generated, the user can obtain K songs MV belonging to the user after the K songs are completed, the entertainment requirement of the user in the vehicle is further met, and the entertainment activity of the user after the K songs in the vehicle is enriched. In addition, the position of the K singer can be comprehensively determined through the multi-party linkage call, and the actual position of the K singer can be more accurately determined, so that the quality of the MV is further improved, and better entertainment experience is brought to users.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for Karaoke in a vehicle according to one embodiment of the invention;
FIG. 2 is a flow chart of a method for Karaoke in a vehicle according to one embodiment of the invention;
FIG. 3 is a flow chart of a method for Karaoke in vehicle according to one embodiment of the present invention;
fig. 4 is a schematic diagram of an electronic device according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As described above, the current conventional vehicle-mounted K-song mode has limited entertainment, and users can only enjoy the current singing and entertainment experience of the users in the vehicle is limited, and the mode cannot meet more entertainment requirements of people, especially after K-songs.
In order to at least partially solve one or more of the above problems and other potential problems, an embodiment of the present invention provides a vehicle-mounted K-song method, which determines a specific position of a K-singer in a vehicle by calling a linkage of a camera and a voice sensor, and then records K-singing MV by calling the vehicle-mounted camera to aim at the K-singer to generate K-singing MV belonging to the K-singer, so that a user can obtain the K-singing MV belonging to the user after completing the K-singing, thereby further satisfying the in-vehicle entertainment requirement of people and enriching entertainment activities of the user after the K-singing in the vehicle.
Hereinafter, specific examples of the present scheme will be described in more detail with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a flowchart of a vehicle-mounted K song method according to an embodiment of the present invention, where the method is applied to a vehicle-mounted terminal, and the vehicle-mounted terminal according to the embodiment may include, but is not limited to, a terminal for controlling an entertainment function, where the vehicle-mounted terminal refers to an abbreviation of a vehicle-mounted infotainment product installed in an automobile, and the vehicle-mounted terminal is capable of implementing information communication between a person and an automobile and between an automobile and the outside (automobile and automobile).
As shown in fig. 1, the vehicle-mounted K song method of the present embodiment may include the following steps:
step S11: responding to a first selection operation of a user, starting a vehicle-mounted camera to carry out picture shooting, and obtaining initial streaming media data; and identifying the initial streaming media data, and acquiring first position information of the face image on a shooting picture.
In this embodiment, when the user wants to perform the K song in the vehicle, a first selection operation may be performed, where the first selection operation may be an operation that the user opens the K song application software on the vehicle-mounted terminal, for example, may be that the user touches a related control on an interface of the vehicle-mounted terminal, so as to open the K song application software (K song APP) in the vehicle-mounted terminal. When K sings APP starts, the vehicle-mounted terminal starts the vehicle-mounted camera to shoot pictures by calling the vehicle-mounted camera so as to acquire initial streaming media data (such as video data and the like), and the initial streaming media data acquired by the vehicle-mounted camera is sent to the vehicle-mounted terminal so that the vehicle-mounted terminal acquires the initial streaming media data.
After obtaining the initial streaming media data, the vehicle-mounted terminal can identify the initial streaming media data, for example: the method comprises the steps that a vehicle-mounted terminal firstly performs feature extraction on each image frame in initial streaming media data, and identifies face image features in each image frame; and then according to the pre-stored image position corresponding relation, finding out a first position relation which corresponds to the identified face image characteristics and is positioned in the image frame (namely in a shooting picture).
The pre-stored image position relationship is as follows: the mapping relation between the pre-stored face features of the person sitting on each seat in the car and the corresponding image areas in the shooting picture of the camera and the position information of each seat. As may be the case where the face features of the person sitting in the main drive have an opposite image area in the shot, the face features of the person sitting in the rear right have an opposite image area in the shot, etc. The vehicle-mounted terminal of the embodiment can obtain the position information of the vehicle corresponding to the face feature according to the position relation between the face feature and the pre-stored image, so as to obtain the first position information of the face image corresponding to the face feature in the shooting picture. The first position information is the position information of the person in the vehicle, which is obtained according to the image processing.
Step S12: and acquiring audio data through a voice sensor, and analyzing the audio data to obtain sound source position information of the audio data.
In this embodiment, after the K song APP is started, a user may perform K song according to song accompaniment played in the vehicle, and a voice sensor set in the vehicle performs audio acquisition on sound in the vehicle, and sends acquired audio data to the vehicle-mounted terminal, and the vehicle-mounted terminal analyzes the received audio data, so as to obtain sound source position information corresponding to the audio data.
The voice sensor is arranged at a fixed position in the vehicle, and because the position of the voice sensor is fixed, the position information determined after the analysis of the collected audio data is accurate, and the inaccuracy of the determined sound source position information caused by the change of the position of the voice sensor can not occur. The vehicle-mounted terminal analyzes the audio data received by the earphone, so that the position information of the sounding sound source corresponding to the audio data can be determined according to the audio data.
Step S13: and determining second position information of an output object according to the first position information and the sound source position information.
In this embodiment, after determining the first position information corresponding to the face in the vehicle and the position information of the sound source in the vehicle in the process of performing K songs by the user, the vehicle-mounted terminal may perform comprehensive judgment according to the first position information and the position information of the sound source to determine the second position information of the output object. The output object is the actual K singer determined by the vehicle-mounted terminal according to the camera and the voice sensor.
For example, the vehicle-mounted terminal analyzes the initial streaming media data acquired by the vehicle-mounted camera to obtain that the first position information of the face image 1 on the shooting picture is a corresponding co-driving area in the vehicle, namely, the user 1 (face image 1) sits in the co-driving area, and also obtain that the first position information of the face image 2 on the shooting picture is a corresponding rear middle area in the vehicle, namely, the rear middle position of the user 2 (face image 2) sits in the vehicle. In addition, the vehicle-mounted terminal analyzes the audio data acquired by the voice sensor to obtain that the second position information of the sounding sound source is the middle position of the rear row in the vehicle, and then the vehicle-mounted terminal can determine that the second position information of the output object is the middle position of the rear row in the vehicle, namely the vehicle-mounted terminal determines that the K singer is a person sitting in the middle position of the rear row in the vehicle. It should be noted that the above is only one example in the embodiment, and the vehicle-mounted terminal may also determine the second position information of each of the plurality of K singers through the information collected by the camera and the voice sensor, that is, the embodiment is also applicable to a scenario where multiple persons simultaneously sings.
Step S14: and calling the vehicle-mounted camera to shoot the picture aiming at the output object according to the second position information to obtain the first streaming media data.
In this embodiment, after determining the second position information of the output object, the vehicle-mounted terminal may perform image shooting by calling the vehicle-mounted camera to aim at the output object according to the second position information; specifically, the vehicle-mounted terminal may send an alignment instruction carrying the second position information to the vehicle-mounted camera, and after receiving the alignment instruction, the vehicle-mounted camera may perform image shooting according to a position corresponding to the second position information (i.e. a position where the output object is located) so as to enable the vehicle-mounted camera to acquire first streaming media data (such as video data) about the output object. And the vehicle-mounted camera sends the acquired first streaming media data to the vehicle-mounted terminal, and the vehicle-mounted terminal obtains the first streaming media data about the aligned output object.
Step S15: and combining the audio data with the first streaming media data to generate MV.
In this embodiment, after receiving the first streaming media data sent by the vehicle-mounted camera and the audio data sent by the voice sensor, the vehicle-mounted terminal may combine the first streaming media data with the audio data, so as to generate MV (Music Video) with an output object (K singer) in the vehicle singing. Specifically, the merging processing manner in the present embodiment includes, but is not limited to: and carrying out alignment and combination processing on the first streaming media data and the audio data according to the time stamp carried in the first streaming media data and the time stamp carried in the audio data, generating and displaying the MV, so that a user can watch the MV singing by himself, and can obtain corresponding relaxation and entertainment through the MV after K singing.
In this embodiment, when a user (K singer) performs K singing in a vehicle, the vehicle-mounted terminal can determine the specific position of the K singer in the vehicle through multiparty linkage (such as linkage calling of a camera and a voice sensor), and then the vehicle-mounted camera is called to aim at the K singer to record the K singer MV, so as to generate the K singer MV belonging to the user, so that the user can also obtain the K singer MV belonging to the user after the K singing is completed, the in-vehicle entertainment requirement of people is further met, the entertainment activity of the user after the K singing in the vehicle is enriched, and a novel entertainment mode is established for people after tension work. In addition, the position of the K singer can be comprehensively determined through multiparty linkage calling, and the actual position of the K singer can be more accurately determined, so that the quality of the MV is further improved, and better entertainment experience is brought to users.
In combination with the above embodiment, in an implementation manner, the embodiment of the invention further provides a vehicle-mounted karaoke method. Specifically, in the method, the above step S14 includes step S21 and step S22:
step S21: and calling the vehicle-mounted cameras closest to the output object under the condition that the plurality of vehicle-mounted cameras are provided, and shooting pictures aiming at the output object according to the second position information to obtain first streaming media data.
In this embodiment, when there are a plurality of cameras on board the vehicle, the initial streaming media data may be acquired by any one or more cameras that can capture all the positions in the vehicle. After the second position information of the output object is determined by the vehicle-mounted camera, calling the vehicle-mounted camera closest to the second position information according to the second position information, and shooting the video to obtain the first streaming media data.
Specifically, in an alternative embodiment, the vehicle-mounted terminal stores position information corresponding to each camera in the vehicle, and after determining second position information of the output object, the vehicle-mounted terminal can send a shooting instruction to a camera closest to the second position information through the second position information, where the shooting instruction carries the second position information and is used for instructing the camera to shoot a video.
According to the embodiment, the camera closest to the output object is called to shoot the picture, so that the proportion of the output object to the shot picture is larger, and the effect of shooting the picture aiming at the output object is achieved for the obtained shot picture.
Step S22: and under the condition that only one vehicle-mounted camera exists, calling the vehicle-mounted camera to shoot the image aiming at the output object by adjusting the size of the image shot by the vehicle-mounted camera according to the second position information, so as to obtain the first streaming media data.
In this embodiment, when there is only one in-vehicle camera, the in-vehicle terminal may send a focus alignment instruction carrying second position information of the output object to the in-vehicle camera, and after the in-vehicle camera receives the alignment instruction, the in-vehicle camera may automatically adjust the size of a picture shot by the in-vehicle camera according to the second position information of the alignment instruction, for example, automatically zoom in or zoom out the size of the picture, and move the center of gravity of the shot picture onto the body of the output object through clipping the picture, thereby implementing shooting of the aligned picture of the output object, so as to acquire first streaming media data (such as video data) about the output object, and may send the first video stream data to the in-vehicle terminal.
In this embodiment, according to different situations of the vehicle-mounted camera, the effect that the camera aims at the output object to perform picture shooting can be achieved by calling a camera closest to the output object to perform picture shooting, or by adjusting the size of a picture shot by the vehicle-mounted camera to move the center of gravity of the picture to the output object to perform picture shooting.
In combination with the above embodiment, in another implementation manner, the embodiment of the present invention further provides a vehicle-mounted K song method. Specifically, in this method, in addition to the above steps S11 to S15, the following steps S31 to S32 are included, and step S13 specifically includes S33:
step S31: extracting features of the initial streaming media data to obtain face features in a shooting picture; and extracting features of the pre-stored preset face images to obtain preset face features.
In this embodiment, after receiving the initial streaming media data sent by the vehicle-mounted camera, the vehicle-mounted terminal performs feature extraction on the initial streaming media data, for example, performs feature extraction on each image frame in the initial streaming media data, so as to obtain the face feature in the shooting picture (each image frame in the initial streaming media data). In addition, the preset face image is prestored in the vehicle-mounted terminal, and can be the vehicle owner itself uploaded in advance or the face image of the person authorized by the vehicle owner (such as friends of the vehicle owner, etc.), and the vehicle-mounted terminal can perform feature extraction on the prestored preset face image to obtain the preset face features.
Step S32: and comparing the face features with the preset face features to determine third position information of the preset face image on a shooting picture.
In this embodiment, the vehicle-mounted terminal compares the face features obtained from the initial streaming media data with the preset face features obtained by recognition, and determines the preset face features in the initial streaming media data. And then according to the pre-stored image position corresponding relation, finding out a third position relation which corresponds to the identified preset face feature and is positioned in the image frame (namely in a shooting picture). The pre-stored image position relationship is as follows: the mapping relation between the pre-stored face features of the person sitting on each seat in the car and the corresponding image areas in the shooting picture of the camera and the position information of each seat.
Step S33: and comparing the third position information with the sound source position information to determine fourth position information of the output object.
In this embodiment, after determining that the preset face image is located in the third position information of the shot image, the vehicle-mounted terminal may compare the third position information with the sound source position information, so as to perform comprehensive judgment to determine fourth position information of the output object. Because the third position information is the position information of the authorized person on the vehicle, which is determined by the camera, the sound source position information is the position information of the sounding sound source, which is determined by the voice sensor, if the vehicle-mounted terminal can determine the consistent position information by comparing the third position information with the sound source position information, the current K song sound source is the authorized person relative to the vehicle, and the specific identity information of the current sound source can be determined according to the pre-stored preset face image.
That is, the present embodiment can determine the fourth position information of the output object by comparing the third position information with the sound source position information, such as determining that the current K song sound source (output object) is the vehicle owner, and can determine the fourth position information of the vehicle owner in the vehicle. Wherein the fourth location information characterizes: the actual position information of the K singer in the car with definite identity information. In addition, in this embodiment, the identity information of the K singer may be associated with the produced MV according to the identity information of the K singer, so that the user may directly display the identity information of the K singer when viewing the MV, or the user may display the MV when viewing the related information of the authorized person corresponding to the vehicle.
In this embodiment, the identity information of the current K singer may be determined according to the preset face image stored in the vehicle-mounted terminal, and if it is determined that the current K singer is a person with authority bound to the vehicle, the MV may be associated with the authority information after the MV is generated, so as to further improve the vehicle authority setting and entertainment during use.
In combination with the above embodiment, in an implementation manner, the embodiment of the present invention further provides a vehicle-mounted K song method, as shown in fig. 2. Fig. 2 is a flowchart of a vehicle-mounted K song method according to an embodiment of the present invention. Specifically, in the method, the above step S15 specifically includes the following steps S41 to S43:
step S41: and processing the audio data according to a preset mode to obtain first processed audio data.
In this embodiment, after receiving the audio data sent by the voice sensor, the vehicle-mounted terminal may process the audio data according to a preset mode to obtain first processed audio data. The processing of the audio data according to the preset mode in this embodiment may be: and comparing the audio data with the original singing audio of the current K song, and if the difference between the tone in the audio data and the tone in the original singing audio exceeds a threshold value, tuning the tone exceeding the threshold value in the audio data through a reverberation mode. The threshold in this embodiment is a preset tone threshold that needs tuning, and the specific value of the threshold in this embodiment is not limited.
The tuning operation for the audio data collected by the voice sensor through the preset mode may be directly executed by the vehicle-mounted terminal, or may be executed by the K song APP in the vehicle-mounted terminal, which is not limited in this embodiment.
Step S42: and responding to a second selection operation of the user, and processing the first streaming media data according to the image processing mode selected by the user to obtain second streaming media video data.
In this embodiment, the relevant control related to image beautification may be displayed in the vehicle-mounted terminal, and when the user wants to beautify the video data recorded by the camera, a second selection operation may be performed in the vehicle-mounted terminal, that is, the relevant control related to image beautification is touched in the vehicle-mounted terminal, so as to perform selection of the image processing mode. The vehicle-mounted terminal responds to the second selection operation of the user, determines the image processing mode selected by the user, and performs image processing on the first streaming media data according to the image processing mode selected by the user, so that second streaming media video data is obtained. The image processing mode in this embodiment may be an AR background mode, a cartoon mode, a landscape mode, or the like, which is not limited in this embodiment. In addition, the image processing mode in this embodiment may also be a reward for stimulating the user to perform a K song activity, for example, after the user performs a certain number of K songs, there may be more selections of the image processing mode.
Step S43: and combining the first processed audio data with the second streaming media video data to generate MV.
In this embodiment, after determining the first processed audio data and the second streaming media video data, the vehicle-mounted terminal may combine the first processed audio data and the second streaming media video data, so as to generate MV for outputting the object in-vehicle singing. Specifically, the MV may be generated by performing alignment and merging processing of the first processed audio data and the second streaming video data according to the time stamp carried in the first processed audio data and the time stamp carried in the second streaming video data.
In this embodiment, after the vehicle-mounted terminal obtains the audio data, tuning operation can be performed on the audio data, and picture processing can be performed on the streaming media data collected by the camera according to a picture processing function selected by a user, so that high-quality MV preferred by the user is generated, and the richness of entertainment in the vehicle is further improved.
In combination with the above embodiment, in an implementation manner, the embodiment of the present invention further provides a vehicle-mounted K song method, as shown in fig. 3. Fig. 3 is a flowchart of a vehicle-mounted K song method according to an embodiment of the present invention. Specifically, in the method, the above step S15 specifically includes the following steps S51 to S53:
step S51: and selecting a preset mode to process the audio data to obtain first processed audio data.
Step S51 in this embodiment is the same as step S41 in the above embodiment, and thus, the description of this embodiment is not repeated here.
Step S52: responding to a third selection operation of a user, and reprocessing the first processed audio data according to an audio processing mode selected by the user to obtain second processed audio data; and processing the first stream media data according to the image processing mode selected by the user to obtain second stream media data.
In this embodiment, related controls related to image beautification and audio processing may be displayed in the vehicle-mounted terminal, and when a user wants to beautify video data recorded by the camera and process audio acquired by the voice sensor, a third selection operation may be performed in the vehicle-mounted terminal, that is, the related controls related to image beautification are touched in the vehicle-mounted terminal to perform selection of an image processing mode, and the related controls related to audio processing are touched in the vehicle-mounted terminal to perform selection of an audio processing mode.
The vehicle-mounted terminal responds to a third selection operation of the user, determines an image processing mode and an audio processing mode selected by the user, and performs image processing on the first streaming media data according to the image processing mode selected by the user so as to obtain second streaming media data; and reprocessing the first processed audio data subjected to tuning processing according to the sound effect processing mode selected by the user to obtain second processed audio data. The image processing mode in this embodiment may be an AR background mode, a cartoon mode, a landscape mode, or the like, and the sound effect processing mode may be a classical mode, a blue tone mode, a pop mode, a jazz mode, a rock mode, a bruse mode, a ballad mode, or the like, which is not limited in this embodiment. In addition, the image processing mode and the sound effect processing mode in the embodiment may also be rewards for stimulating the user to perform the K song activity, for example, after the user performs a certain number of K songs, more image processing modes and/or sound effect processing modes may be selected.
Step S53: and combining the second processed audio data with the second streaming media data to generate MV.
In this embodiment, after determining the second processed audio data and the second streaming media data, the vehicle-mounted terminal may combine the second processed audio data with the second streaming media data, thereby generating MV of the output object in-vehicle singing. Specifically, the MV may be generated by performing alignment merging processing of the second-processed audio data and the second streaming media data according to the time stamp carried in the second-processed audio data and the time stamp carried in the second streaming media data.
In this embodiment, the vehicle-mounted terminal performs tuning operation on the audio data, and may further process the streaming media data collected by the camera and the first processed audio data after tuning processing according to the picture processing function and the audio processing mode selected by the user, so as to generate a high-quality MV that meets the user preference, thereby further enriching the in-vehicle entertainment activity.
In combination with the above embodiment, in an implementation manner, the embodiment of the invention further provides a vehicle-mounted karaoke method. Specifically, in the method, in addition to the above-described step S11 to step S15, the method further includes step S61:
step S61: and in response to a first selection operation of a user, adjusting the operation parameters of the in-car music equipment to parameters corresponding to a first mode, and adjusting the operation parameters of the in-car light equipment to parameters corresponding to a second mode, wherein the second mode represents that the operation parameters of the light equipment change in real time along with the attribute of the audio data.
In this embodiment, after the vehicle-mounted responds to the first selection operation of the user and the K song APP is started, the vehicle-mounted terminal adjusts the operation parameters of the music equipment in the vehicle to the parameters corresponding to the first mode. The music device in the vehicle may be a device related to music in the vehicle, such as an audio device, a microphone device, and the like. The first mode is an audio immersion mode, such as dolby audio, viper audio, etc. which are improved in various aspects of audio. And the vehicle-mounted terminal can adjust the operation parameters of the in-vehicle light equipment to parameters corresponding to the second mode. The in-vehicle light device may be an element related to light in a vehicle such as an atmosphere lamp; the second mode characterizes real-time changes in the operating parameters of the in-vehicle light device along with the attributes of the audio data. For example, the atmosphere lamp can be lightened according to the rhythm of music in the car, or the color system of the atmosphere lamp can be adjusted according to the label (such as popular music, classical music and the like) of the music in the car, for example, when the music is classical music, the vehicle-mounted terminal can adjust the operation parameters of the light equipment in the car to the operation parameters related to green, and when the music is popular music, the vehicle-mounted terminal can adjust the operation parameters of the light equipment in the car from the operation parameters related to green to the operation parameters related to blue. It should be noted that the above is only a specific example provided in this embodiment, and the specific numerical values of the operation parameters in this embodiment are not limited in any way.
In this embodiment, when the vehicle-mounted terminal can K sings APP to start, the operation parameters of the lamplight and music equipment in the vehicle are adjusted, so that when the user K sings in the vehicle, the vehicle can display all equipment in the vehicle according to the operation parameters matched with the current music, thereby improving K sings atmosphere in the vehicle and further enriching entertainment in the vehicle.
In combination with the above embodiment, in an implementation manner, the embodiment of the invention further provides a vehicle-mounted karaoke method. Specifically, in the method, in addition to the above steps, the method further includes step S71:
step S71: and sharing the MVs, obtaining the scores of the MVs according to the audio data of the MVs, and determining a first MV in a preset period.
In this embodiment, after the vehicle terminal generates the K song MV, the K song MV may be played, so that the user may see the MV, if the user finds that the MV is not good in effect, the user may also invalidate the MV. In addition, the user can also select a suitable picture as the cover of the MV and analyze the MV, for example, the MV can be directly uploaded to a social platform or directly shared with other users.
The vehicle-mounted terminal can score the MV according to the audio data of the MV; for example, MV scores can be calculated from the aspects of timbre, music tempo, intonation, etc. in audio data by a speech algorithm.
In this embodiment, a preset period, such as a week, a day, a month, etc., is preset, which is not limited in this embodiment. The preset period is used for comparing the MV scores of the MVs uploaded to the social platform in the period, or the preset period is used for comparing the MV scores of the MVs generated by the vehicle-mounted terminal in the period. Therefore, the vehicle-mounted terminal can determine the first MV in the preset period according to the scores of the MVs. The first MV in this embodiment is a high quality MV in the preset period, for example, may be the MV with the highest score in the preset period, or may be the MV with the higher score in the preset period (for example, the top three, seven, etc. of the score ranking), which is not limited in this embodiment. In this embodiment, the determined first MV may be rewarded, for example, the first MV is set to top in a related page of the social platform or the vehicle-mounted terminal, and so on.
In this embodiment, after generating the MV, the vehicle-mounted terminal may share and score the MV, and obtain the first MV according to the score of the MV, thereby further enriching the entertainment and social activities of the user after K singing in the vehicle, providing rich entertainment activities and communication modes for the user after tension work, and greatly improving the in-vehicle entertainment experience of the user.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Based on the same inventive concept, another embodiment of the present invention provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps in the vehicle-mounted K song method according to any one of the above embodiments of the present invention.
Based on the same inventive concept, another embodiment of the present invention provides an electronic device 400 as shown in fig. 4. Fig. 4 is a schematic diagram of an electronic device according to an embodiment of the present invention. The electronic device comprises a memory 402, a processor 401 and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the vehicle-mounted karaoke method according to any of the above embodiments of the present invention when executed.
Based on the same inventive concept, another embodiment of the present invention provides a vehicle including: an electrical component and an in-vehicle terminal for performing the steps of the in-vehicle karaoke method according to any of the above embodiments of the present invention.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method or a computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The above detailed description of the vehicle-mounted karaoke method, the electronic device, the storage medium and the vehicle provided by the invention applies specific examples to illustrate the principle and the implementation of the invention, and the above examples are only used for helping to understand the method and the core idea of the invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. A vehicle-mounted K song method comprises the following steps:
responding to a first selection operation of a user, starting a vehicle-mounted camera to carry out picture shooting, and obtaining initial streaming media data; identifying the initial streaming media data, and acquiring first position information of a face image on a shooting picture;
collecting audio data through a voice sensor, and analyzing the audio data to obtain sound source position information of the audio data;
determining second position information of an output object according to the first position information and the sound source position information;
calling a vehicle-mounted camera to aim at the output object to shoot pictures according to the second position information so as to obtain first streaming media data;
and combining the audio data with the first streaming media data to generate MV.
2. The method according to claim 1, wherein the calling the vehicle-mounted camera to take pictures of the output object according to the second position information to obtain the first streaming media data comprises:
when a plurality of vehicle-mounted cameras are provided, calling the vehicle-mounted camera closest to the output object, and shooting pictures aiming at the output object according to the second position information to obtain first streaming media data;
and under the condition that only one vehicle-mounted camera exists, calling the vehicle-mounted camera to shoot the image aiming at the output object by adjusting the size of the image shot by the vehicle-mounted camera according to the second position information, so as to obtain the first streaming media data.
3. The method according to claim 1, further comprising the step of:
extracting features of the initial streaming media data to obtain face features in a shooting picture; extracting features of a pre-stored preset face image to obtain preset face features;
comparing the face features with the preset face features, and determining third position information of the preset face image on a shooting picture;
the determining the second position information of the output object according to the first position information and the sound source position information includes:
and comparing the third position information with the sound source position information to determine fourth position information of the output object.
4. The method of claim 1, the merging the audio data with the first streaming media data, generating MVs, comprising:
processing the audio data according to a preset mode to obtain first processed audio data;
responding to a second selection operation of a user, and processing the first streaming media data according to an image processing mode selected by the user to obtain second streaming media video data;
and combining the first processed audio data with the second streaming media video data to generate MV.
5. The method of claim 1, the merging the audio data with the first streaming media data, generating MVs, comprising:
selecting a preset mode to process the audio data to obtain first processed audio data;
responding to a third selection operation of a user, and reprocessing the first processed audio data according to an audio processing mode selected by the user to obtain second processed audio data; processing the first streaming media data according to the image processing mode selected by the user to obtain second streaming media data;
and combining the second processed audio data with the second streaming media data to generate MV.
6. The method according to claim 1, further comprising the step of:
and in response to a first selection operation of a user, adjusting the operation parameters of the in-car music equipment to parameters corresponding to a first mode, and adjusting the operation parameters of the in-car light equipment to parameters corresponding to a second mode, wherein the second mode represents that the operation parameters of the light equipment change in real time along with the attribute of the audio data.
7. The method according to any one of claims 1 to 6, further comprising the step of:
and sharing the MVs, obtaining the scores of the MVs according to the audio data of the MVs, and determining a first MV in a preset period.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, which when executed by the processor implements the in-vehicle singing method as claimed in any one of claims 1 to 7.
9. A computer readable storage medium having stored thereon a computer program which when executed by a processor implements the in-vehicle singing method of any of claims 1 to 7.
10. A vehicle, characterized by comprising: electrical component and a vehicle-mounted terminal for performing the vehicle-mounted K song method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210051163.7A CN116486770A (en) | 2022-01-17 | 2022-01-17 | Vehicle-mounted K song method, electronic equipment, storage medium and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210051163.7A CN116486770A (en) | 2022-01-17 | 2022-01-17 | Vehicle-mounted K song method, electronic equipment, storage medium and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116486770A true CN116486770A (en) | 2023-07-25 |
Family
ID=87216517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210051163.7A Pending CN116486770A (en) | 2022-01-17 | 2022-01-17 | Vehicle-mounted K song method, electronic equipment, storage medium and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116486770A (en) |
-
2022
- 2022-01-17 CN CN202210051163.7A patent/CN116486770A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11580941B2 (en) | Music compilation systems and related methods | |
| JP4736586B2 (en) | Information processing apparatus, information processing method, and program | |
| US9319019B2 (en) | Method for augmenting a listening experience | |
| US10942563B2 (en) | Prediction of the attention of an audience during a presentation | |
| CN107005724A (en) | Information processor, information processing method and program | |
| US11758228B2 (en) | Methods, systems, and media for modifying the presentation of video content on a user device based on a consumption of the user device | |
| CN109147745A (en) | Song editing and processing method, apparatus, electronic equipment and storage medium | |
| CN113707113B (en) | User singing voice repairing method and device and electronic equipment | |
| JP7453712B2 (en) | Audio reproduction method, device, computer readable storage medium and electronic equipment | |
| CN112954390A (en) | Video processing method, device, storage medium and equipment | |
| CN114466242A (en) | Display device and audio processing method | |
| CN116486770A (en) | Vehicle-mounted K song method, electronic equipment, storage medium and vehicle | |
| JP2009260718A (en) | Image reproduction system and image reproduction processing program | |
| JP7451999B2 (en) | Recording device, video system, recording method, and program | |
| CN114466241A (en) | Display device and audio processing method | |
| CN114598917A (en) | Display device and audio processing method | |
| JP7452000B2 (en) | Recording device, recording method, and program | |
| WO2024122322A1 (en) | Information processing device, information processing method, and program | |
| JP7470726B2 (en) | Image processing device and image processing method | |
| WO2024107342A1 (en) | Dynamic effects karaoke | |
| WO2023276279A1 (en) | Image processing device, image processing method, and program | |
| US8134063B2 (en) | Music piece production apparatus, music piece reproduction method, and music piece reproduction program | |
| CN115881063A (en) | Music generation method, device and storage medium | |
| JP2021101526A (en) | Moving image system, reproduction method and program | |
| CN118474458A (en) | Scene rendering method and system and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: Room 3701, No. 866 East Changzhi Road, Hongkou District, Shanghai, 200080 Applicant after: Botai vehicle networking technology (Shanghai) Co.,Ltd. Address before: 201800 208, building 4, No. 1411, Yecheng Road, Jiading Industrial Zone, Jiading District, Shanghai Applicant before: Botai vehicle networking technology (Shanghai) Co.,Ltd. Country or region before: China |