CN110267097A - Video pushing method, device and electronic equipment based on characteristic of division - Google Patents
Video pushing method, device and electronic equipment based on characteristic of division Download PDFInfo
- Publication number
- CN110267097A CN110267097A CN201910562955.9A CN201910562955A CN110267097A CN 110267097 A CN110267097 A CN 110267097A CN 201910562955 A CN201910562955 A CN 201910562955A CN 110267097 A CN110267097 A CN 110267097A
- Authority
- CN
- China
- Prior art keywords
- video
- target video
- classification information
- classification
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000004458 analytical method Methods 0.000 claims description 51
- 238000013145 classification model Methods 0.000 claims description 24
- 238000012545 processing Methods 0.000 abstract description 7
- 238000013528 artificial neural network Methods 0.000 description 20
- 230000000306 recurrent effect Effects 0.000 description 14
- 238000004590 computer program Methods 0.000 description 13
- 238000003062 neural network model Methods 0.000 description 11
- 238000011176 pooling Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000012549 training Methods 0.000 description 9
- 238000013527 convolutional neural network Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000005070 sampling Methods 0.000 description 8
- 230000009471 action Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000011156 evaluation Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000002035 prolonged effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of video pushing method based on characteristic of division, device and electronic equipment are provided in the embodiment of the present disclosure, belongs to technical field of data processing, this method comprises: obtaining one or more target videos；The different types of content that the target video includes is parsed, Context resolution result is obtained；Classified by preset disaggregated model to the Context resolution result, forms classification information corresponding with the target video；To target object push and the matched target video of the classification information.By the processing scheme of the disclosure, the accuracy of video push is improved.
Description
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a video pushing method and apparatus based on classification features, and an electronic device.
Background
With the continuous development of the internet technology, network videos are increasingly abundant, a user can search interesting videos to watch through the internet without limiting the videos to a television, and the video providing platform can actively recommend the videos to the user after analyzing the video hobbies of the user, so that the user can watch the videos conveniently. In order to grasp the behavior habits of the user, the history of the video watched by the user needs to be checked, and the video recommendation is performed through a large amount of historical behavior data.
In the existing recommendation system, the learning and training of the recommendation system are mainly performed by relying on the interaction between the user and the recommendation information, the recommendation effect depends on the interaction influence between the user and the user, and between the user and the recommendation information, and in the process, the recommendation system lacks the content understanding of the recommended information, so that the complete understanding information aiming at the video content is lost in the recommendation process. In particular, when a new user or a new recommendable video appears, the recommendation effect is often unsatisfactory.
Disclosure of Invention
In view of the above, embodiments of the present disclosure provide a video pushing method and apparatus based on classification features, and an electronic device, which at least partially solve the problems in the prior art.
In a first aspect, an embodiment of the present disclosure provides a video pushing method based on classification features, including:
acquiring one or more target videos;
analyzing different types of contents contained in the target video to obtain a content analysis result;
classifying the content analysis result through a preset classification model to form classification information corresponding to the target video;
and pushing the target video matched with the classification information to the target object.
According to a specific implementation manner of the embodiment of the present disclosure, the acquiring one or more target videos includes:
acquiring one or more videos to be screened from a target video source;
judging whether a recommendation mark exists on the label of the video to be screened;
and if so, selecting the video to be screened as a target video.
According to a specific implementation manner of the embodiment of the present disclosure, the analyzing different types of content included in the target video to obtain a content analysis result includes:
analyzing the frame image in the target video;
selecting one or more video frames based on the analysis result of the image in the target video;
and taking the video frame as a component of the content analysis result.
According to a specific implementation manner of the embodiment of the present disclosure, the analyzing different types of content included in the target video to obtain a content analysis result further includes:
acquiring an audio file contained in the target video;
converting the audio file into an audio frequency spectrogram;
and taking the audio frequency spectrogram as a component of the content analysis result.
According to a specific implementation manner of the embodiment of the present disclosure, the analyzing different types of content included in the target video to obtain a content analysis result further includes:
and acquiring a title text contained in the target video, and taking the title text as a component of the content analysis result.
According to a specific implementation manner of the embodiment of the present disclosure, the classifying the content analysis result through a preset classification model to form classification information corresponding to the target video includes:
classifying video frames in the content analysis result by adopting a preset CNN classification model to obtain first classification information;
and setting the first classification information as classification information corresponding to the target video.
According to a specific implementation manner of the embodiment of the present disclosure, the classifying the content analysis result through a preset classification model to form classification information corresponding to the target video includes:
classifying the audio frequency spectrogram in the content analysis result by adopting a preset CNN classification model to obtain second classification information;
and setting the second classification information as classification information corresponding to the target video.
According to a specific implementation manner of the embodiment of the present disclosure, the classifying the content analysis result through a preset classification model to form classification information corresponding to the target video includes:
classifying the title texts in the content analysis result by adopting a preset RNN classification model to obtain third classification information;
and setting the third classification information as classification information corresponding to the target video.
According to a specific implementation manner of the embodiment of the present disclosure, the pushing the target video matched with the classification information to the target object includes:
adding the first classification information, the second classification information and the third classification information as additional features of the target video into a preset recommendation model;
and the recommendation model pushes the target video matched with the classification information to a target object by using the first classification information, the second classification information, the third classification information and the inherent information of the target video, wherein the inherent information comprises publishing time, publishing place and video duration information of the target video.
In a second aspect, an embodiment of the present disclosure provides a video pushing apparatus based on classification features, including:
the acquisition module is used for acquiring one or more target videos;
the analysis module is used for analyzing different types of contents contained in the target video to obtain a content analysis result;
the classification module is used for classifying the content analysis result through a preset classification model to form classification information corresponding to the target video;
and the pushing module is used for pushing the target video matched with the classification information to the target object.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method for video push based on classification features of any of the first aspects or any implementation manner of the first aspect.
In a fourth aspect, the disclosed embodiments also provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the classification feature-based video push method in the first aspect or any implementation manner of the first aspect.
In a fifth aspect, the present disclosure also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, where the computer program includes program instructions, which, when executed by a computer, cause the computer to perform the classification feature-based video push method in the foregoing first aspect or any implementation manner of the first aspect.
The video pushing scheme based on the classification characteristics in the embodiment of the disclosure comprises the steps of obtaining one or more target videos; analyzing different types of contents contained in the target video to obtain a content analysis result; classifying the content analysis result through a preset classification model to form classification information corresponding to the target video; and pushing the target video matched with the classification information to the target object. By the scheme, the classification information of the videos can be extracted deeply, video recommendation is performed on the basis of the classification information extracted from the target videos, and accuracy of video pushing is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic view of a video pushing process based on classification features according to an embodiment of the present disclosure;
2a-2b are schematic diagrams of a neural network model structure provided by an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a video push system according to an embodiment of the present disclosure;
fig. 4 is a schematic view of another video pushing flow based on classification features according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a video pushing apparatus based on classification features according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of an electronic device provided in an embodiment of the present disclosure.
Detailed Description
The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
The embodiments of the present disclosure are described below with specific examples, and other advantages and effects of the present disclosure will be readily apparent to those skilled in the art from the disclosure in the specification. It is to be understood that the described embodiments are merely illustrative of some, and not restrictive, of the embodiments of the disclosure. The disclosure may be embodied or carried out in various other specific embodiments, and various modifications and changes may be made in the details within the description without departing from the spirit of the disclosure. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the appended claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the disclosure, one skilled in the art should appreciate that one aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. Additionally, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present disclosure, and the drawings only show the components related to the present disclosure rather than the number, shape and size of the components in actual implementation, and the type, amount and ratio of the components in actual implementation may be changed arbitrarily, and the layout of the components may be more complicated.
In addition, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects may be practiced without these specific details.
The embodiment of the disclosure provides a video pushing method based on classification characteristics. The video pushing method based on the classification features provided by the embodiment can be executed by a computing device, the computing device can be implemented as software, or implemented as a combination of software and hardware, and the computing device can be integrally arranged in a server, a terminal device and the like.
Referring to fig. 1, a video pushing method based on classification features provided by the embodiments of the present disclosure includes the following steps:
s101, one or more target videos are obtained.
As a video operation platform, a large amount of video resources are generally stored, and these video resources may include various types of videos such as movie and television videos, news videos, self-portrait videos, and the like. The operation platform always hopes to push the video which is most interesting to the user, so that the attention of the user to the video platform is improved, and the stay time of the user on the video operation platform is further prolonged.
The target video is all or part of the video selected from the massive videos by the video operation platform after analyzing the massive videos. For example, the target video may be a video recommended by a user, or a video with a high attention in a massive video library. In order to effectively distinguish the target video, a recommendation label can be set for the video needing to be recommended through the video operation platform, and the video containing the recommendation label is used as the target video.
S102, analyzing different types of contents contained in the target video to obtain a content analysis result.
The target video exists in the form of a video file, which typically contains components that are common in video files. For example, the target video includes a video frame, an audio content, and a text title included in the video, and the video frame, the audio content, and the text title included in the video include more abundant information in the target video.
Specifically, video frames included in the target video may be extracted, a part of typical frame images may be selected from all extracted video frame images to describe the content of the target video by analyzing the video frames, and the finally selected video frame image may be used as a component of the content analysis result.
The target video also contains an audio file, the audio file comprises background music of the target video, character conversations in the target video and other sounds in the target video, and classification of the target video can be judged from the perspective of the sounds by analyzing the audio file in the target video. Specifically, an audio file existing in the target video is extracted in the process of analyzing the target video, and as an example, the extracted audio file is stored in the form of an audio spectrogram. Audio spectrograms may also be a component of the content parsing results.
The target video usually also contains text content, which includes a text title (e.g., a movie name) of the video file, and by extracting the text title of the video file, related content of the target video can be further obtained, and the text title of the target video can also be used as a component of the content parsing result.
S103, classifying the content analysis result through a preset classification model to form classification information corresponding to the target video.
After the content analysis results are obtained, analysis of the target video needs to be performed based on the content analysis results. A common video classification method is generally a simple classification based on video names and the like, and does not deeply analyze detailed contents contained in videos, so that there is an inaccurate case for the classification of videos. In order to be able to analyze and target the content of the video in depth, referring to fig. 2a-2b, a special neural network may be set, and the classification information of the target video is obtained by means of neural network training.
As an exemplary application, for the video frame and the audio spectrogram in the content parsing result, a CNN convolutional neural network may be set for classification training, see fig. 2a, where the neural network model includes a convolutional layer, a pooling layer, a sampling layer, and a full-link layer.
The convolutional layers mainly comprise the size of convolutional kernels and the number of input feature graphs, each convolutional layer can comprise a plurality of feature graphs with the same size, the feature values of the same layer adopt a weight sharing mode, and the sizes of the convolutional kernels in each layer are consistent. The convolution layer performs convolution calculation on the input image and extracts the layout characteristics of the input image.
The back of the feature extraction layer of the convolutional layer can be connected with the sampling layer, the sampling layer is used for solving the local average value of the input image and carrying out secondary feature extraction, and the sampling layer is connected with the convolutional layer, so that the neural network model can be guaranteed to have better robustness for the input image.
In order to accelerate the training speed of the neural network model, a pooling layer is arranged behind the convolutional layer, the pooling layer processes the output result of the convolutional layer in a maximum pooling mode, and invariance characteristics of an input image can be better extracted.
The full-connection layer integrates the features in the image feature map passing through the plurality of convolution layers and the pooling layer, and obtains the classification features of the input image features for image classification. In the neural network model, the fully-connected layer maps the feature map generated by the convolutional layer into a fixed-length feature vector. The feature vector contains the combined information of all the features of the input image, and the feature vector reserves the image features with the most features in the image to complete the image classification task. In this way, the value of the specific category to which the input image belongs (the probability of the category to which the input image belongs) can be calculated, and the classification task can be completed by outputting the most possible category. For example, after calculation through the full connection layer, the input image may be classified as a result containing [ animal, landscape, person, plant ] categories, the corresponding probabilities of which are [ P1, P2, P3, P4], respectively.
For the text header content in the target video, an RNN recurrent neural network can be adopted for classification training. Referring to fig. 2b, the recurrent neural network is composed of nodes distributed hierarchically, including a parent node in a higher hierarchy and a child node in a lower hierarchy, where the child node at the end is usually an output node, and the properties of the node are the same as those of the nodes in the tree. The output node of the recurrent neural network is usually located at the top of the tree, where the structure is drawn from bottom to top, and the parent node is located below the child node. Each node of the recurrent neural network can have data input, and the system state of the node of the ith level can be calculated in the following way:
in the formulaThe system state for the node and all its parents, when there are multiple parents,is the system state merged into a matrix, X is the data input for the node, and if the node has no input, no computation is performed. f is an excitation function or an encapsulated feed-forward neural network, which may employ a depth algorithm like a gating algorithm. U, W, b are weighting factors that are independent of the hierarchy of nodes, and the weights of all nodes of the recurrent neural network are shared.
By inputting the text header content in the target video as input into the RNN recurrent neural network, a classification value of the text header content based on the RNN recurrent neural network can be obtained.
S104, pushing the target video matched with the classification information to the target object.
After the classification information of the target video is acquired, the related target video can be pushed to the target object (e.g., a video user) based on the behavior characteristics of the target object. For example, through the discovery of the video browsing history of the user on a video website or a video application program, the user usually focuses on the videos of the action class, and the videos classified into the action class in the target videos can be continuously pushed to the user.
In addition, referring to fig. 3, the classification information may be added to the video recommendation system as a supplementary feature, and the classification information is recommended to the user together with other video information already existing in the video recommendation system, where the other video information includes, but is not limited to, the time of video publication, the city where the video publication is made, the device where the video publication is made, the duration of the video, and the like.
The image, the audio and the text information in the video are respectively input into the classification models trained in advance, and corresponding label results are obtained for recommendable video contents through the three models. And the three label results are used as new characteristics to be added into the recommendation system, so that the recommendation effect is improved. Particularly for new videos, the recommendation effect is improved obviously under the condition that the related behaviors of the user are few.
Referring to fig. 4, according to a specific implementation manner of the embodiment of the present disclosure, the acquiring one or more target videos may include:
s401, one or more videos to be screened are obtained from a target video source.
The video operation platform generally stores massive video resources, and the video resources may include various types of videos such as movie and television videos, news videos, self-portrait videos, and the like. The operation platform always hopes to push the video which is most interesting to the user, so that the attention of the user to the video platform is improved, and the stay time of the user on the video operation platform is further prolonged.
The video to be screened can be all or part of the video selected from the massive videos by analyzing the massive videos by the video operation platform.
S402, judging whether the label of the video to be screened has a recommendation mark.
In order to improve the screening efficiency of the target video, recommendation marks can be set on the video in advance, and therefore effective screening can be performed by judging whether the recommendation marks exist in the labels on the video to be screened.
And S403, if the video to be screened exists, selecting the video to be screened as a target video.
As a case, in the process of parsing different types of content included in a target video, parsing images (video frames) in the target video is included, one or more video frames are selected based on a parsing result of the images in the target video, and the video frames are used as a component of the content parsing result.
In addition to analyzing the frame image in the target video, the method may also analyze an audio file in the target video, and analyze different types of content contained in the target video to obtain a content analysis result, including: and acquiring an audio file contained in the target video, converting the audio file into an audio spectrogram, and taking the audio spectrogram as a component of the content analysis result.
In addition to parsing the image and audio files in the target video, the title text in the target video may also be parsed, that is: and acquiring a title text contained in the target video, and taking the title text as a component of the content analysis result.
After the content analysis result is obtained, a neural network model trained in advance may be used to obtain classification information, and according to a specific implementation manner of the embodiment of the present disclosure, the classifying the content analysis result by a preset classification model to form classification information corresponding to the target video includes:
and classifying the video frames in the content analysis result by adopting a preset CNN classification model to obtain first classification information, and setting the first classification information as classification information corresponding to the target video.
And classifying the audio frequency spectrogram in the content analysis result by adopting a preset CNN classification model to obtain second classification information, and setting the second classification information as the classification information corresponding to the target video.
And classifying the title texts in the content analysis result by adopting a preset RNN classification model to obtain third classification information, and setting the third classification information as the classification information corresponding to the target video.
By adopting the preset neural network model to obtain the classification information in the target video, the classification content of the target video can be accurately obtained, and the accuracy of the classification information is improved.
After the classification information is acquired, a target video matched with the classification information is pushed to a target object, and the first classification information, the second classification information and the third classification information can be added to a preset recommendation model as additional features of the target video, wherein the recommendation model utilizes the first classification information, the second classification information, the third classification information and inherent information of the target video to push the target video matched with the classification information to the target object, and the inherent information comprises publishing time, publishing place and video duration information of the target video.
Corresponding to the above method embodiment, referring to fig. 5, the present disclosure also provides a video pushing apparatus 50 based on classification features, including:
an obtaining module 501 is configured to obtain one or more target videos.
As a video operation platform, a large amount of video resources are generally stored, and these video resources may include various types of videos such as movie and television videos, news videos, self-portrait videos, and the like. The operation platform always hopes to push the video which is most interesting to the user, so that the attention of the user to the video platform is improved, and the stay time of the user on the video operation platform is further prolonged.
The target video is all or part of the video selected from the massive videos by the video operation platform after analyzing the massive videos. For example, the target video may be a video recommended by a user, or a video with a high attention in a massive video library. In order to effectively distinguish the target video, a recommendation label can be set for the video needing to be recommended through the video operation platform, and the video containing the recommendation label is used as the target video.
The parsing module 502 is configured to parse different types of content included in the target video to obtain a content parsing result.
The target video exists in the form of a video file, which typically contains components that are common in video files. For example, the target video includes a video frame, an audio content, and a text title included in the video, and the video frame, the audio content, and the text title included in the video include more abundant information in the target video.
Specifically, video frames included in the target video may be extracted, a part of typical frame images may be selected from all extracted video frame images to describe the content of the target video by analyzing the video frames, and the finally selected video frame image may be used as a component of the content analysis result.
The target video also contains an audio file, the audio file comprises background music of the target video, character conversations in the target video and other sounds in the target video, and classification of the target video can be judged from the perspective of the sounds by analyzing the audio file in the target video. Specifically, an audio file existing in the target video is extracted in the process of analyzing the target video, and as an example, the extracted audio file is stored in the form of an audio spectrogram. Audio spectrograms may also be a component of the content parsing results.
The target video usually also contains text content, which includes a text title (e.g., a movie name) of the video file, and by extracting the text title of the video file, related content of the target video can be further obtained, and the text title of the target video can also be used as a component of the content parsing result.
The classification module 503 is configured to classify the content analysis result through a preset classification model, and form classification information corresponding to the target video.
After the content analysis results are obtained, analysis of the target video needs to be performed based on the content analysis results. A common video classification method is generally a simple classification based on video names and the like, and does not deeply analyze detailed contents contained in videos, so that there is an inaccurate case for the classification of videos. In order to be able to analyze and target the content of the video in depth, referring to fig. 2a-2b, a special neural network may be set, and the classification information of the target video is obtained by means of neural network training.
As an exemplary application, for the video frame and the audio spectrogram in the content parsing result, a CNN convolutional neural network may be set for classification training, see fig. 2a, where the neural network model includes a convolutional layer, a pooling layer, a sampling layer, and a full-link layer.
The convolutional layers mainly comprise the size of convolutional kernels and the number of input feature graphs, each convolutional layer can comprise a plurality of feature graphs with the same size, the feature values of the same layer adopt a weight sharing mode, and the sizes of the convolutional kernels in each layer are consistent. The convolution layer performs convolution calculation on the input image and extracts the layout characteristics of the input image.
The back of the feature extraction layer of the convolutional layer can be connected with the sampling layer, the sampling layer is used for solving the local average value of the input image and carrying out secondary feature extraction, and the sampling layer is connected with the convolutional layer, so that the neural network model can be guaranteed to have better robustness for the input image.
In order to accelerate the training speed of the neural network model, a pooling layer is arranged behind the convolutional layer, the pooling layer processes the output result of the convolutional layer in a maximum pooling mode, and invariance characteristics of an input image can be better extracted.
The full-connection layer integrates the features in the image feature map passing through the plurality of convolution layers and the pooling layer, and obtains the classification features of the input image features for image classification. In the neural network model, the fully-connected layer maps the feature map generated by the convolutional layer into a fixed-length feature vector. The feature vector contains the combined information of all the features of the input image, and the feature vector reserves the image features with the most features in the image to complete the image classification task. In this way, the value of the specific category to which the input image belongs (the probability of the category to which the input image belongs) can be calculated, and the classification task can be completed by outputting the most possible category. For example, after calculation through the full connection layer, the input image may be classified as a result containing [ animal, landscape, person, plant ] categories, the corresponding probabilities of which are [ P1, P2, P3, P4], respectively.
For the text header content in the target video, an RNN recurrent neural network can be adopted for classification training. Referring to fig. 2b, the recurrent neural network is composed of nodes distributed hierarchically, including a parent node in a higher hierarchy and a child node in a lower hierarchy, where the child node at the end is usually an output node, and the properties of the node are the same as those of the nodes in the tree. The output node of the recurrent neural network is usually located at the top of the tree, where the structure is drawn from bottom to top, and the parent node is located below the child node. Each node of the recurrent neural network can have data input, and the system state of the node of the ith level can be calculated in the following way:
in the formulaThe system state for the node and all its parents, when there are multiple parents,is the system state merged into a matrix, X is the data input for the node, and if the node has no input, no computation is performed. f is an excitation function or an encapsulated feed-forward neural network, which may employ a depth algorithm like a gating algorithm. U, W, b are weighting factors that are independent of the hierarchy of nodes, and the weights of all nodes of the recurrent neural network are shared.
By inputting the text header content in the target video as input into the RNN recurrent neural network, a classification value of the text header content based on the RNN recurrent neural network can be obtained.
And a pushing module 504, configured to push the target video matched with the classification information to the target object.
After the classification information of the target video is acquired, the related target video can be pushed to the target object (e.g., a video user) based on the behavior characteristics of the target object. For example, through the discovery of the video browsing history of the user on a video website or a video application program, the user usually focuses on the videos of the action class, and the videos classified into the action class in the target videos can be continuously pushed to the user.
In addition, referring to fig. 3, the classification information may be added to the video recommendation system as a supplementary feature, and the classification information is recommended to the user together with other video information already existing in the video recommendation system, where the other video information includes, but is not limited to, the time of video publication, the city where the video publication is made, the device where the video publication is made, the duration of the video, and the like.
The apparatus shown in fig. 5 may correspondingly execute the content in the above method embodiment, and details of the part not described in detail in this embodiment refer to the content described in the above method embodiment, which is not described again here.
Referring to fig. 6, an embodiment of the present disclosure also provides an electronic device 60, including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the video push method based on classification characteristics of the method embodiments described above.
The disclosed embodiments also provide a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the foregoing method embodiments.
The disclosed embodiments also provide a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to perform the classification feature-based video push method in the aforementioned method embodiments.
Referring now to FIG. 6, a schematic diagram of an electronic device 60 suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, the electronic device 60 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 60 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 60 to communicate with other devices wirelessly or by wire to exchange data. While the figures illustrate an electronic device 60 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 609, or may be installed from the storage means 608, or may be installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring at least two internet protocol addresses; sending a node evaluation request comprising the at least two internet protocol addresses to node evaluation equipment, wherein the node evaluation equipment selects the internet protocol addresses from the at least two internet protocol addresses and returns the internet protocol addresses; receiving an internet protocol address returned by the node evaluation equipment; wherein the obtained internet protocol address indicates an edge node in the content distribution network.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a node evaluation request comprising at least two internet protocol addresses; selecting an internet protocol address from the at least two internet protocol addresses; returning the selected internet protocol address; wherein the received internet protocol address indicates an edge node in the content distribution network.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.
The above description is only for the specific embodiments of the present disclosure, but the scope of the present disclosure is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present disclosure should be covered within the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (12)
1. A video pushing method based on classification features is characterized by comprising the following steps:
acquiring one or more target videos;
analyzing different types of contents contained in the target video to obtain a content analysis result;
classifying the content analysis result through a preset classification model to form classification information corresponding to the target video;
and pushing the target video matched with the classification information to the target object.
2. The method of claim 1, wherein the obtaining one or more target videos comprises:
acquiring one or more videos to be screened from a target video source;
judging whether a recommendation mark exists on the label of the video to be screened;
and if so, selecting the video to be screened as a target video.
3. The method according to claim 1, wherein the parsing different types of content contained in the target video to obtain a content parsing result comprises:
analyzing the frame image in the target video;
selecting one or more video frames based on the analysis result of the image in the target video;
and taking the video frame as a component of the content analysis result.
4. The method according to claim 3, wherein the parsing different types of content contained in the target video to obtain a content parsing result further comprises:
acquiring an audio file contained in the target video;
converting the audio file into an audio frequency spectrogram;
and taking the audio frequency spectrogram as a component of the content analysis result.
5. The method according to claim 4, wherein the parsing different types of content contained in the target video to obtain a content parsing result further comprises:
and acquiring a title text contained in the target video, and taking the title text as a component of the content analysis result.
6. The method according to claim 5, wherein the classifying the content parsing result through a preset classification model to form classification information corresponding to the target video comprises:
classifying video frames in the content analysis result by adopting a preset CNN classification model to obtain first classification information;
and setting the first classification information as classification information corresponding to the target video.
7. The method according to claim 6, wherein the classifying the content parsing result through a preset classification model to form classification information corresponding to the target video comprises:
classifying the audio frequency spectrogram in the content analysis result by adopting a preset CNN classification model to obtain second classification information;
and setting the second classification information as classification information corresponding to the target video.
8. The method according to claim 7, wherein the classifying the content parsing result through a preset classification model to form classification information corresponding to the target video comprises:
classifying the title texts in the content analysis result by adopting a preset RNN classification model to obtain third classification information;
and setting the third classification information as classification information corresponding to the target video.
9. The method of claim 8, wherein pushing the target video matching the classification information to the target object comprises:
adding the first classification information, the second classification information and the third classification information as additional features of the target video into a preset recommendation model;
and the recommendation model pushes the target video matched with the classification information to a target object by using the first classification information, the second classification information, the third classification information and the inherent information of the target video, wherein the inherent information comprises publishing time, publishing place and video duration information of the target video.
10. A video push apparatus based on classification features, comprising:
the acquisition module is used for acquiring one or more target videos;
the analysis module is used for analyzing different types of contents contained in the target video to obtain a content analysis result;
the classification module is used for classifying the content analysis result through a preset classification model to form classification information corresponding to the target video;
and the pushing module is used for pushing the target video matched with the classification information to the target object.
11. An electronic device, characterized in that the electronic device comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method for classified feature based video push of any of claims 1-9.
12. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the classification feature based video push method of any one of the preceding claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910562955.9A CN110267097A (en) | 2019-06-26 | 2019-06-26 | Video pushing method, device and electronic equipment based on characteristic of division |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910562955.9A CN110267097A (en) | 2019-06-26 | 2019-06-26 | Video pushing method, device and electronic equipment based on characteristic of division |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110267097A true CN110267097A (en) | 2019-09-20 |
Family
ID=67921917
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910562955.9A Pending CN110267097A (en) | 2019-06-26 | 2019-06-26 | Video pushing method, device and electronic equipment based on characteristic of division |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110267097A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110674348A (en) * | 2019-09-27 | 2020-01-10 | 北京字节跳动网络技术有限公司 | Video classification method and device and electronic equipment |
| CN110929087A (en) * | 2019-10-21 | 2020-03-27 | 量子云未来（北京）信息科技有限公司 | Audio classification method and device, electronic equipment and storage medium |
| CN111212303A (en) * | 2019-12-30 | 2020-05-29 | 咪咕视讯科技有限公司 | Video recommendation method, server and computer-readable storage medium |
| CN111444387A (en) * | 2020-03-27 | 2020-07-24 | 腾讯科技（深圳）有限公司 | Video classification method and device, computer equipment and storage medium |
| CN111695422A (en) * | 2020-05-06 | 2020-09-22 | Oppo（重庆）智能科技有限公司 | Video tag acquisition method and device, storage medium and server |
| CN113689084A (en) * | 2021-07-30 | 2021-11-23 | 深圳集智数字科技有限公司 | Resource attribute determination method and device |
| CN113742565A (en) * | 2020-05-29 | 2021-12-03 | 华为技术有限公司 | Content classification method, device and system |
| CN114339049A (en) * | 2021-12-31 | 2022-04-12 | 深圳市商汤科技有限公司 | Video processing method and device, computer equipment and storage medium |
| CN114339307A (en) * | 2021-12-31 | 2022-04-12 | 上海商汤临港智能科技有限公司 | Video desensitization method and device, computer equipment and storage medium |
| CN114979767A (en) * | 2022-05-07 | 2022-08-30 | 咪咕视讯科技有限公司 | Video recommendation method, device, equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108416013A (en) * | 2018-03-02 | 2018-08-17 | 北京奇艺世纪科技有限公司 | Video matching, retrieval, classification and recommendation method, apparatus and electronic equipment |
| CN109325148A (en) * | 2018-08-03 | 2019-02-12 | 百度在线网络技术（北京）有限公司 | The method and apparatus for generating information |
| CN109360028A (en) * | 2018-10-30 | 2019-02-19 | 北京字节跳动网络技术有限公司 | Method and apparatus for pushed information |
| CN109684506A (en) * | 2018-11-22 | 2019-04-26 | 北京奇虎科技有限公司 | A kind of labeling processing method of video, device and calculate equipment |
| EP3518145A1 (en) * | 2018-01-30 | 2019-07-31 | Deluxe Entertainment Services Group Inc. | Cognitive indexing of images in digital video content |
-
2019
- 2019-06-26 CN CN201910562955.9A patent/CN110267097A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3518145A1 (en) * | 2018-01-30 | 2019-07-31 | Deluxe Entertainment Services Group Inc. | Cognitive indexing of images in digital video content |
| CN108416013A (en) * | 2018-03-02 | 2018-08-17 | 北京奇艺世纪科技有限公司 | Video matching, retrieval, classification and recommendation method, apparatus and electronic equipment |
| CN109325148A (en) * | 2018-08-03 | 2019-02-12 | 百度在线网络技术（北京）有限公司 | The method and apparatus for generating information |
| CN109360028A (en) * | 2018-10-30 | 2019-02-19 | 北京字节跳动网络技术有限公司 | Method and apparatus for pushed information |
| CN109684506A (en) * | 2018-11-22 | 2019-04-26 | 北京奇虎科技有限公司 | A kind of labeling processing method of video, device and calculate equipment |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110674348A (en) * | 2019-09-27 | 2020-01-10 | 北京字节跳动网络技术有限公司 | Video classification method and device and electronic equipment |
| CN110929087A (en) * | 2019-10-21 | 2020-03-27 | 量子云未来（北京）信息科技有限公司 | Audio classification method and device, electronic equipment and storage medium |
| CN111212303A (en) * | 2019-12-30 | 2020-05-29 | 咪咕视讯科技有限公司 | Video recommendation method, server and computer-readable storage medium |
| CN111444387A (en) * | 2020-03-27 | 2020-07-24 | 腾讯科技（深圳）有限公司 | Video classification method and device, computer equipment and storage medium |
| CN111695422A (en) * | 2020-05-06 | 2020-09-22 | Oppo（重庆）智能科技有限公司 | Video tag acquisition method and device, storage medium and server |
| CN111695422B (en) * | 2020-05-06 | 2023-08-18 | Oppo（重庆）智能科技有限公司 | Video tag acquisition method and device, storage medium and server |
| CN113742565A (en) * | 2020-05-29 | 2021-12-03 | 华为技术有限公司 | Content classification method, device and system |
| CN113689084A (en) * | 2021-07-30 | 2021-11-23 | 深圳集智数字科技有限公司 | Resource attribute determination method and device |
| CN114339049A (en) * | 2021-12-31 | 2022-04-12 | 深圳市商汤科技有限公司 | Video processing method and device, computer equipment and storage medium |
| CN114339307A (en) * | 2021-12-31 | 2022-04-12 | 上海商汤临港智能科技有限公司 | Video desensitization method and device, computer equipment and storage medium |
| CN114979767A (en) * | 2022-05-07 | 2022-08-30 | 咪咕视讯科技有限公司 | Video recommendation method, device, equipment and computer readable storage medium |
| CN114979767B (en) * | 2022-05-07 | 2023-11-21 | 咪咕视讯科技有限公司 | Video recommendation method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110267097A (en) | Video pushing method, device and electronic equipment based on characteristic of division | |
| CN110278447B (en) | Video pushing method and device based on continuous features and electronic equipment | |
| CN111381909B (en) | Page display method and device, terminal equipment and storage medium | |
| CN110674349B (en) | Video POI (Point of interest) identification method and device and electronic equipment | |
| CN110633423B (en) | Target account identification method, device, equipment and storage medium | |
| CN111767740B (en) | Sound effect adding method and device, storage medium and electronic equipment | |
| CN113688310B (en) | Content recommendation method, device, equipment and storage medium | |
| CN111738316B (en) | Zero sample learning image classification method and device and electronic equipment | |
| CN113204555B (en) | Data table processing method, device, electronic equipment and storage medium | |
| CN113033682B (en) | Video classification method, device, readable medium and electronic equipment | |
| CN113868538B (en) | Information processing method, device, equipment and medium | |
| CN110288037A (en) | Image processing method, device and electronic equipment | |
| CN110069997B (en) | Scene classification method and device and electronic equipment | |
| CN110300329B (en) | Video pushing method and device based on discrete features and electronic equipment | |
| US20230315990A1 (en) | Text detection method and apparatus, electronic device, and storage medium | |
| CN113033707B (en) | Video classification method and device, readable medium and electronic equipment | |
| CN110287350A (en) | Image search method, device and electronic equipment | |
| CN113033680B (en) | Video classification method and device, readable medium and electronic equipment | |
| KR20210084641A (en) | Method and apparatus for transmitting information | |
| CN111832354A (en) | Target object age identification method and device and electronic equipment | |
| CN110287371A (en) | Video pushing method, device and electronic equipment end to end | |
| CN113706663B (en) | Image generation method, device, equipment and storage medium | |
| CN116109374A (en) | Resource bit display method, device, electronic equipment and computer readable medium | |
| CN114428867A (en) | Data mining method and device, storage medium and electronic equipment | |
| CN110704679B (en) | Video classification method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190920 |
|
| RJ01 | Rejection of invention patent application after publication |