Nothing Special   »   [go: up one dir, main page]

CN109769138B - Audio and video recognition system based on Internet - Google Patents

Audio and video recognition system based on Internet Download PDF

Info

Publication number
CN109769138B
CN109769138B CN201910162655.1A CN201910162655A CN109769138B CN 109769138 B CN109769138 B CN 109769138B CN 201910162655 A CN201910162655 A CN 201910162655A CN 109769138 B CN109769138 B CN 109769138B
Authority
CN
China
Prior art keywords
video
module
audio
playing
protocol
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201910162655.1A
Other languages
Chinese (zh)
Other versions
CN109769138A (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yuanlian Information Technology Co ltd
Original Assignee
Shandong Yuanlian Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yuanlian Information Technology Co ltd filed Critical Shandong Yuanlian Information Technology Co ltd
Priority to CN201910162655.1A priority Critical patent/CN109769138B/en
Publication of CN109769138A publication Critical patent/CN109769138A/en
Application granted granted Critical
Publication of CN109769138B publication Critical patent/CN109769138B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses an internet-based audio and video identification system, which comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module, wherein the data acquisition module is used for acquiring audio and video data; the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit; the data playing module is respectively connected with the video monitoring module and the video storage module; the video storage module is respectively connected with the video retrieval module and the video statistics module. The method plays the acquired audio and video information through the video playing module, has a diversified playing mode, and improves the monotonicity of the video playing mode; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.

Description

Audio and video recognition system based on Internet
The present application is a divisional application of the following applications: the invention relates to an internet-based audio and video identification system and a method thereof, wherein the application date is 2016, 12 and 12 months, and the application number is 201611137782.9.
Technical Field
The invention belongs to the technical field of internet, relates to an audio and video identification method, and particularly relates to an audio and video identification system based on the internet.
Background
Along with the increasing popularization of the Internet, more and more audios and videos are published on the Internet, the domestic websites represent online video websites such as a heat network, a potato network, a Tencent video network and the like, the video websites provide service items such as video on demand, audio on demand, MTV playing, music playing and the like for users, the rise of the Internet audio and video websites enables the personalized requirements of the users to be fully met, the audio and video playing programs not only improve the life pleasure of people, but also increase the knowledge of people, and the supervision difficulty is brought while massive audio and video programs are uploaded and shared.
At present, the main internet audio and video identification mostly adopts a search engine mode, namely, a searcher is used for capturing web pages of audio and video programs on the internet, an index database of the programs is established through the operation of the search engine, a user searches information meeting the requirements of the user in the program search database and plays the information, and the internet audio and video identification method adopting the search engine mode can obtain a large number of audio and video web pages by using smaller network resources, but cannot monitor audio and video data transmitted by the internet in real time.
Disclosure of Invention
The invention aims to provide an internet-based audio and video identification system, which analyzes and decodes the protocols of audio and video through a data acquisition module, so that a video playing module can play audio and video with different protocols, and the problem that the audio and video information in internet transmission data streams cannot be monitored in real time is solved by monitoring the played audio and video information through a video monitoring module.
The purpose of the invention can be realized by the following technical scheme:
the audio and video identification system based on the Internet comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted transmission protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the credit of the user;
the data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module and is used for storing the acquired audio and video information;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audios and videos stored in the video storage module under each protocol and counting the quantity of all the audios and videos in the video storage module.
Furthermore, the user management unit comprises user registration, user login, inquiry and editing, and is used for identity registration of the user, verifying the identity of a registrant after successful registration, inquiring the authority of the user and editing audio and video contents in the authority range.
Furthermore, the playing modes of the video playing module include random playing, alternate playing and repeated playing.
Further, the types of protocols are TP, UDP, TCP, HTTP and RTP protocols.
An internet-based audio and video recognition method comprises the following steps:
s1, acquiring a data packet of the network;
s2, the protocol analysis unit analyzes and judges the acquired protocol;
s3, if the data packets are valid, sequencing the audio and video information according to the size of the acquired data packets; if the obtained data packet is an invalid data packet, no sequencing processing is carried out;
s4, storing the effective audio and video;
s5, carrying out statistical analysis on the audio and video quantity of different protocol packets in the audio and video storage module every 10S, and updating the user information of the online client every 30S;
s6, sending the audio and video data packet to a user client, and buffering the received audio and video by the client;
s7, selecting an audio and video playing mode at the client by the user;
and S8, after the audio and video playing is finished, sending a finishing instruction to the client, and selecting to play a new audio and video or pause by the client.
The invention has the beneficial effects that: according to the invention, different protocols of the audio and video can be analyzed through the data acquisition module, and the protocols can be decoded, so that the audio and video of different protocols can be played at the client of the user; the video playing module can play the acquired audio and video information, and has a sequential, random and repeated diversified playing mode, so that the monotonicity of the video playing mode is improved; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a diagram of an internet-based audio and video recognition system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the invention relates to an internet-based audio/video recognition system, which comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video statistics module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted audio and video protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information, ensuring that different protocols can be disclosed, and simultaneously sending the analysis result to the media decoding unit; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the information of the user, and the managed content comprises user registration and login, inquiry and editing, wherein the user registration and login is used for identity registration of the user, after the registration is successful, the identity of a registrant is verified, and meanwhile, the user authority can be inquired and the audio and video content which can be collected in the user authority range can be edited.
The data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol, and the playing adopts the modes of random playing, alternate playing and repeated playing;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module, and is used for storing the acquired audio and video information and dividing the stored audio and video according to the types of protocols, wherein the stored audio and video comprises TP, UDP, TCP, HTTP and RTP protocols;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audios and videos under each protocol stored in the video storage module and counting the quantity of all the audios and videos in the video storage module.
An audio and video recognition method based on the Internet comprises the following steps:
s1, acquiring a data packet of the network;
s2, the protocol analysis unit analyzes and judges the acquired protocol;
s3, if the data packets are valid, sequencing the audio and video information according to the size of the acquired data packets; if the obtained data packet is an invalid data packet, no sequencing processing is carried out;
s4, storing the effective audio and video;
s5, carrying out statistical analysis on the audio and video quantity of different protocol packets in the audio and video storage module every 10S, and updating the user information of the online client every 30S;
s6, sending the audio and video data packet to a user client, and buffering the received audio and video by the client;
s7, selecting an audio and video playing mode at the client by the user;
and S8, after one of the audios and videos is played, sending a completion instruction to the client, and selecting to play a new audio and video or pause by the client.
And for different time when any audio/video data packet is sent to the user client, buffering is performed according to the arrival time, so that the problem of poor playing fluency caused by directly playing the audio/video information is avoided.
According to the invention, different protocols of the audio and video can be analyzed through the data acquisition module, and the protocols can be decoded, so that the audio and video of different protocols can be played at the client of the user; the video playing module can play the acquired audio and video information, and has a sequential, random and repeated diversified playing mode, so that the monotonicity of the video playing mode is improved; the functions of video query and statistics can be increased by storing, retrieving and counting the audio and video; through the video monitoring module, the audio and video programs transmitted by the internet can be monitored, and the management of the audio and video contents is improved.
The foregoing is merely exemplary and illustrative of the principles of the present invention and various modifications, additions and substitutions of the specific embodiments described herein may be made by those skilled in the art without departing from the principles of the present invention or exceeding the scope of the claims set forth herein.

Claims (1)

1. Audio and video identification system based on internet its characterized in that: the system comprises a data acquisition module, a data playing module, a video monitoring module, a video storage module, a video retrieval module and a video counting module;
the data acquisition module is connected with the data playing module and comprises an audio and video extraction unit, a protocol analysis unit, a media decoding unit and a user management unit, wherein the audio and video extraction unit is used for extracting a transmission protocol of the played audio and video and sending the extracted transmission protocol to the protocol analysis unit; the protocol analysis unit is used for analyzing the transmission protocol of the received audio and video information; the media decoding unit is used for decoding the protocol of the received audio and video information; the user management unit is used for managing the information of the user, and the managed content comprises user registration and login, inquiry and editing, wherein the user registration and login is used for carrying out identity registration on the user;
the data playing module is respectively connected with the video monitoring module and the video storage module, and is used for playing the audio and video stored in the video storage module according to the division of each protocol, and the playing modes comprise random playing, alternate playing and repeated playing;
the video monitoring module is used for monitoring the played audio and video information in real time and storing the monitored audio and video information to the video storage module;
the video storage module is respectively connected with the video retrieval module and the video statistics module and is used for storing the acquired audio and video information;
the video retrieval module is used for screening the audio and video information stored in the video storage module;
the video counting module is used for counting the audio and video under each protocol stored in the video storage module and counting the quantity of all the audio and video in the video storage module, and the types of the protocols comprise TP, UDP, TCP, HTTP and RTP protocols.
CN201910162655.1A 2016-12-12 2016-12-12 Audio and video recognition system based on Internet Expired - Fee Related CN109769138B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910162655.1A CN109769138B (en) 2016-12-12 2016-12-12 Audio and video recognition system based on Internet

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910162655.1A CN109769138B (en) 2016-12-12 2016-12-12 Audio and video recognition system based on Internet
CN201611137782.9A CN106535006B (en) 2016-12-12 2016-12-12 A kind of audio-video identifying system Internet-based and its method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201611137782.9A Division CN106535006B (en) 2016-12-12 2016-12-12 A kind of audio-video identifying system Internet-based and its method

Publications (2)

Publication Number Publication Date
CN109769138A CN109769138A (en) 2019-05-17
CN109769138B true CN109769138B (en) 2021-11-12

Family

ID=58343056

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201910162655.1A Expired - Fee Related CN109769138B (en) 2016-12-12 2016-12-12 Audio and video recognition system based on Internet
CN201611137782.9A Active CN106535006B (en) 2016-12-12 2016-12-12 A kind of audio-video identifying system Internet-based and its method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201611137782.9A Active CN106535006B (en) 2016-12-12 2016-12-12 A kind of audio-video identifying system Internet-based and its method

Country Status (1)

Country Link
CN (2) CN109769138B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347334B (en) * 2020-09-22 2023-05-23 中国科学院信息工程研究所 Active-passive combination-based audio and video website user entry identification method and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394408A (en) * 2008-10-15 2009-03-25 中山大学 Protocol managing system used for digital video monitoring system
CN102223260A (en) * 2010-04-19 2011-10-19 中国移动通信集团重庆有限公司 Method, system and device for testing transmission quality of IPTV (Internet Protocol Television) video data streams
CN102244813A (en) * 2011-06-24 2011-11-16 百视通网络电视技术发展有限责任公司 Video playing method and internet television terminal applying same
CN102638727A (en) * 2012-04-20 2012-08-15 江苏奇异点网络有限公司 Website video player system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030099200A1 (en) * 2001-11-27 2003-05-29 Amplify.Net, Inc. Parallel limit checking in a hierarchical network for bandwidth management traffic-shaping cell
US7487116B2 (en) * 2005-12-01 2009-02-03 International Business Machines Corporation Consumer representation rendering with selected merchandise
US8881011B2 (en) * 2006-12-05 2014-11-04 Crackle, Inc. Tool for creating content for video sharing platform
BRPI0622169A2 (en) * 2006-12-20 2011-12-27 Thomson Res Funding Corp video data loss recovery using low bit rate stream on an iptv system
EP2250749A2 (en) * 2008-02-05 2010-11-17 StratosAudio, Inc. Systems, methods, and devices for scanning broadcasts
CN101895750B (en) * 2010-07-13 2012-05-30 上海未来宽带技术及应用工程研究中心有限公司 Set-top box and PC-oriented real-time streaming media server and working method
CN101938626B (en) * 2010-09-15 2013-10-30 杭州海康威视数字技术股份有限公司 Video session terminal, system, and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394408A (en) * 2008-10-15 2009-03-25 中山大学 Protocol managing system used for digital video monitoring system
CN102223260A (en) * 2010-04-19 2011-10-19 中国移动通信集团重庆有限公司 Method, system and device for testing transmission quality of IPTV (Internet Protocol Television) video data streams
CN102244813A (en) * 2011-06-24 2011-11-16 百视通网络电视技术发展有限责任公司 Video playing method and internet television terminal applying same
CN102638727A (en) * 2012-04-20 2012-08-15 江苏奇异点网络有限公司 Website video player system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
网络视频监控服务器的设计与实现;窦心春;《中国优秀硕士学位论文全文数据库 信息科技辑》;20150415(第4期);全文 *

Also Published As

Publication number Publication date
CN109769138A (en) 2019-05-17
CN106535006B (en) 2019-04-09
CN106535006A (en) 2017-03-22

Similar Documents

Publication Publication Date Title
KR101728122B1 (en) Method for recommending users in social network and the system thereof
CN106331779B (en) Method and system based on user preferences push main broadcaster during playing video
CN104918066B (en) Verifying video content method and system
CN103686231B (en) Method and system for integrated management, failure replacement and continuous playing of film
CN105095211B (en) The acquisition methods and device of multi-medium data
US20090271524A1 (en) Associating User Comments to Events Presented in a Media Stream
KR20140138804A (en) Enhancing live broadcast viewing through display of filtered internet information streams
CN104615627B (en) A kind of event public feelings information extracting method and system based on microblog
CN101540874A (en) Interactive TV program recommendation method based on collaborative filtration
KR101541495B1 (en) Apparatus, method and computer readable recording medium for analyzing a video using the image captured from the video
CN103165151B (en) Method for broadcasting multimedia file and device
US20120011085A1 (en) Systems And Methods For Identifying And Notifying Users of Electronic Content Based on Biometric Recognition
US9294796B2 (en) Inserting personalized information into digital content
US20130159406A1 (en) Location Aware Commenting Widget for Creation and Consumption of Relevant Comments
CN106027673B (en) The control and training method, device that resource pushes in advance
Mujtaba et al. Client-driven personalized trailer framework using thumbnail containers
CN109769138B (en) Audio and video recognition system based on Internet
CN107172178B (en) A kind of content delivery method and device
CN106791961B (en) Video preference information processing method, device and system
CN110336959A (en) A kind of original video automatic processing method
US10198737B2 (en) Peer-to-peer data collector and analyzer
CN114139491A (en) Data processing method, device and storage medium
CN112862498A (en) Product tracing method and device, electronic device and storage medium
TWI526059B (en) An apparatus and method for selecting clips
CN103227942A (en) Intelligent authorization method for digital television

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20211026

Address after: 250000 Room 502, building 3, science and Technology Industrial Park, Shandong University, No. 2600, Yingxiu Road, Jinan area, pilot Free Trade Zone, Jinan, Shandong Province

Applicant after: Shandong Yuanlian Information Technology Co.,Ltd.

Address before: Room 506, 5 / F, building 9, 972 Moganshan Road, Gongshu District, Hangzhou City, Zhejiang Province 310000

Applicant before: HANGZHOU HONGSHENG INFORMATION TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20211112

CF01 Termination of patent right due to non-payment of annual fee