CN106713937A - Video playing control method and device as well as terminal equipment - Google Patents
Video playing control method and device as well as terminal equipment Download PDFInfo
- Publication number
- CN106713937A CN106713937A CN201611259122.8A CN201611259122A CN106713937A CN 106713937 A CN106713937 A CN 106713937A CN 201611259122 A CN201611259122 A CN 201611259122A CN 106713937 A CN106713937 A CN 106713937A
- Authority
- CN
- China
- Prior art keywords
- interface
- hardware
- decoding
- terminal
- video flowing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000009877 rendering Methods 0.000 claims abstract description 14
- 230000008859 change Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 230000006399 behavior Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 abstract description 17
- 238000004891 communication Methods 0.000 description 11
- 230000006854 communication Effects 0.000 description 11
- 230000008901 benefit Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000007175 bidirectional communication Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to the field of multimedia technologies, in particular to a video playing control method and device as well as terminal equipment. The method comprises the following steps of obtaining video stream of a direct broadcasting room from a server; determining a decoding condition provided by a terminal, selecting a matched decoding interface to decode the video stream, and preferentially calling a hardware decoding interface to decode when the decoding condition includes the hardware decoding interface and a software decoding interface, otherwise calling the software decoding interface to decode; and determining a rendering condition provided by the terminal, selecting a matched graphic rendering interface to output the decoded video stream to a user interface to display after drawing, and preferentially calling a hardware rendering interface to render when the rendering condition includes the hardware rendering interface and a software rendering interface, otherwise calling the software rendering interface to render. According to the method, the device and the terminal equipment, the terminal can realize smooth watching of the live video stream at high resolution, high bit rate and high frame rate.
Description
【Technical field】
The present invention relates to multimedia technology field, and in particular to a kind of video playing control method, device and terminal device.
【Background technology】
With the development of Internet technology and intelligent mobile terminal equipment, work, life that various internet products give people
Work brings many convenient and amusement, and in recent years, all kinds of live platforms for net cast emerge in an endless stream, and net cast gives people
Bring more real-time social experience, and the upgrading of capture apparatus in recent years, high-resolution, code check high, the video of frame per second high
It is also applied in live scene, at present for the client of viewing live video stream, is decoded and use using software
A kind of traditional GDI (pure graphic interface with Software on Drawing) is rendered, (wide for viewing high-resolution>=1920 is high>=
1080), code check high>=3000, frame number (FPS high:>During=net cast 30), because software decoding and GDI are rendered and taken
Cpu resource high, causes the nonsynchronous problem of video pictures interim card, audio frequency and video, and bad viewing experience, shadow are brought to user
The live platform public praise of sound, and then reduce user activity.
Therefore, for how using terminal existing hardware, as much as possible reduce CPU occupancy, it is ensured that live video
The fluency of broadcasting is the problem of current urgent need to resolve.
【The content of the invention】
Primary and foremost purpose of the invention is to provide a kind of video playing control method and device；
Another object of the present invention is to provide a kind of terminal device for realizing the video broadcasting method.
To realize the purpose, the present invention is adopted the following technical scheme that：
In a first aspect, the present invention provides a kind of video playing control method, comprise the following steps：
The video flowing of direct broadcasting room is obtained from server；
Determine the decoding condition that terminal is provided, the decoding interface that selection is adapted is decoded to the video flowing, works as institute
Decoding condition is stated comprising hardware decoding interface and during software decoding interface, preferentially calls the hardware decoding interface to be decoded,
The software decoding interface is otherwise called to be decoded；
Determine terminal offer renders condition, and the selected figure being adapted renders interface by after the drafting of decoded video flowing
User interface is exported to show, when it is described render condition and render interface comprising Hardware Render interface and software when, preferentially call institute
State Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
Further, it is described determination terminal provide decoding condition and determine terminal provide render condition before,
Also include：
Determine the operating system version of terminal.
Specifically, the operating system is WINDOWS systems, when terminal operating system for WINDOWS7 versions or
During more than WINDOWS7 versions, determine that terminal meets the precondition for providing hardware decoding and Hardware Render, otherwise call software
Decoding interface is decoded to the video flowing, is recalled software and is rendered interface by output after the drafting of decoded video flowing to use
Family interface display.
Specifically, described determine the decoding condition that terminal is provided, the decoding interface that selection is adapted is flowed into the video
The step of row decoding, specifically include：
Determine the decoder type that terminal is supported, the decoder type includes Nvidia hardware decoders, Intel hardware
Decoder, AMD hardware decoders；
When terminal supports Nvidia hardware decoders, the hardware decoding interface of Nvidia hardware decoders is called to described
Video flowing is decoded；
When terminal supports Intel hardware decoders, the hardware decoding interface of Intel hardware decoders is called to be regarded to described
Frequency stream is decoded；
When terminal supports AMD hardware decoders, the hardware decoding interface of AMD hardware decoders is called to the video flowing
Decoded.
Preferably, the Hardware Render interface renders interface for the figures of DirectX 11, when the video flowing uses hardware
During decoding, call the figures of DirectX 11 to render interface and decoded video flowing is converted into the forms of YUV 420, and be loaded into
In the texture that DirectX 11 is created, exported in user interface after then video flowing is drawn using the equipment of DirectX 11.
Optionally, when the video flowing is decoded using software, the figures of DirectX 11 are called to render interface by after decoding
Video flowing change into RGBA forms and be loaded in video memory, after then video flowing is drawn using the equipment of DirectX 11 export
Onto user interface.
Preferably, when the video flowing uses Hardware Render, judging whether the video flowing is VR videos, if so, then
Rendered using 3D figures, otherwise, rendered using 2D figures.
Further, it is described from server obtain direct broadcasting room video flowing the step of after, when the control for receiving user
The subsequent step of methods described is just performed during system instruction.
Second aspect, the present invention provides a kind of video playback control device, including：
Read module：Video flowing for obtaining direct broadcasting room from server；
Decoder module：For determining the decoding condition that terminal is provided, the decoding interface that selection is adapted is to the video flowing
Decoded, when the decoding condition includes hardware decoding interface and software decoding interface, preferentially call the hardware to decode
Interface is decoded, and otherwise calls the software decoding interface to be decoded；
Rendering module：For determining that what terminal provided renders condition, the selected figure being adapted is rendered after interface will decode
Video flowing draw after export user interface and show, when the condition that renders renders interface comprising Hardware Render interface and software
When, preferentially call the Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
In addition, the present invention also provides a kind of terminal device for realizing above-mentioned first aspect method, including：Video Decoder,
Video rendering engine, central processing unit, graphic process unit, memory, touch-sensitive display.
Compared with prior art, the present invention possesses following advantage：
The present invention for net cast platform can effectively specification live video stream coded format, watching live regarding
When the terminal of frequency meets hardware decoding condition and/or Hardware Render condition, it is preferred to use hardware is decoded and Hardware Render is to live
Video flowing is decoded, rendered, it is ensured that the fluency of high-quality live video stream broadcasting, particularly with VR video flowings,
The occupancy of terminal CPU can be effectively reduced with Hardware Render using hardware decoding, solution is rendered using Software Coding and GDI
Cause the problem of video playback interim card；
Further, since live platform can effective specification live video stream coded format, video can be effectively prevented from
Stream encryption form is unsatisfactory for supporting the condition of hardware decoding, to provide more easily condition using hardware decoding by video flowing.
Obviously, the above-mentioned description about advantage of the present invention is recapitulative, and more advantage descriptions will be embodied in follow-up
Embodiment disclose in, and, the content that those skilled in the art can also be disclosed reasonably find it is of the invention its
His plurality of advantages.
The additional aspect of the present invention and advantage will be set forth in part in the description, and these will become from the following description
Obtain substantially, or recognized by practice of the invention.
【Brief description of the drawings】
Fig. 1 is an embodiment schematic flow sheet of video playing control method of the present invention；
Fig. 2 is the embodiment schematic flow sheet present invention determine that terminal decoder type；
Fig. 3 is the embodiment schematic diagram that the present invention plays live video stream；
Fig. 4 is an embodiment schematic diagram of video playback control device of the present invention.
【Specific embodiment】
The present invention is further described with exemplary embodiment below in conjunction with the accompanying drawings, identical label wherein in accompanying drawing
All refer to identical part.Additionally, if it is known that the detailed description of technology is for showing the invention is characterized in that unnecessary
, then omitted.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " " used herein, " one
It is individual ", " described " and " being somebody's turn to do " may also comprise plural form.It is to be further understood that what is used in specification of the invention arranges
Diction " including " refer to the presence of the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition
One or more other features, integer, step, operation, element, component and/or their group.It should be understood that when we claim unit
Part is " connected " or during " coupled " to another element, and it can be directly connected or coupled to other elements, or can also exist
Intermediary element.Additionally, " connection " used herein or " coupling " can include wireless connection or wireless coupling.It is used herein to arrange
Diction "and/or" includes one or more associated wholes or any cell of listing item and all combines.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific terminology), with art of the present invention in those of ordinary skill general understanding identical meaning.Should also
Understand, those terms defined in such as general dictionary, it should be understood that with the context with prior art
The consistent meaning of meaning, and unless by specific definitions as here, will not otherwise use idealization or excessively formal implication
To explain.
Those skilled in the art of the present technique are appreciated that " terminal " used herein above, " terminal device " both include wireless communication
The equipment of number receiver, the equipment of its wireless signal receiver for only possessing non-emissive ability, and including receiving and transmitting hardware
Equipment, its have can on bidirectional communication link, perform two-way communication reception and transmitting hardware equipment.This equipment
Can include：Honeycomb or other communication equipments, it has single line display or multi-line display or is shown without multi-line
The honeycomb of device or other communication equipments；PCS (Personal Communications Service, PCS Personal Communications System), it can
With combine voice, data processing, fax and/or its communication ability；PDA (Personal Digital Assistant, it is personal
Digital assistants), it can include radio frequency receiver, pager, the Internet/intranet access, web browser, notepad, day
Go through and/or GPS (Global Positioning System, global positioning system) receiver；Conventional laptop and/or palm
Type computer or other equipment, its have and/or conventional laptop and/or palmtop computer including radio frequency receiver or its
His equipment." terminal " used herein above, " terminal device " they can be portable, can transport, installed in the vehicles (aviation,
Sea-freight and/or land) in, or be suitable for and/or be configured in local runtime, and/or with distribution form, operate in the earth
And/or any other position operation in space." terminal " used herein above, " terminal device " can also be communication terminal, on
Network termination, music/video playback terminal, for example, can be PDA, MID (Mobile Internet Device, mobile Internet
Equipment) and/or the equipment such as mobile phone, or intelligent television, Set Top Box with music/video playing function.
Those skilled in the art of the present technique are appreciated that remote network devices used herein above, and it includes but is not limited to meter
The cloud that calculation machine, network host, single network server, multiple webserver collection or multiple servers are constituted.Here, Yun Youji
Constituted in a large amount of computers or the webserver of cloud computing (Cloud Computing), wherein, cloud computing is Distributed Calculation
One kind, a super virtual computer being made up of the computer collection of a group loose couplings.In embodiments of the invention, distal end
Can realize communicating by any communication mode between the network equipment, terminal device and WNS servers, including but not limited to, be based on
The mobile communication of 3GPP, LTE, WIMAX, based on TCP/IP, the computer network communication of udp protocol and based on bluetooth, infrared
The low coverage wireless transmission method of transmission standard.
It will be appreciated by those skilled in the art that " application ", " application program ", " application software " and class alleged by the present invention
It is the same concept well known to those skilled in the art like the concept of statement, refers to be instructed by series of computation machine and related data
The computer software for being suitable to electronics operation of the organic construction of resource.Unless specified, programming language is not received in this name in itself
Species, rank, the operating system or platform of operation of also not rely by it are limited.In the nature of things, this genus is not also appointed
The terminal of what form is limited.
The realization of the method for the invention depends on a certain functional module or plug-in unit in mobile terminal operating system, specifically
For the executable code being built in the corresponding application programs of mobile terminal or independently of the individually executable of any application program
Application program, it can be defined in specific application program and perform, it is also possible in running on the application programs of various compatibilities.
Functional module or plug-in unit implement form not as to specific restriction of the invention.
Direct broadcasting room：Direct broadcasting room of the present invention includes following meanings, 1. a kind of created based on network direct broadcasting platform
Virtual Space (or virtual room), direct broadcasting room is typically created by main broadcaster's client and is connected with multiple viewing clients, i.e., live
Between in include main broadcaster and multiple spectators, the viewing client in the Virtual Space can watch the live of main broadcaster's client
Content, while the user of main broadcaster's client and user, the user of viewing client and the use for watching client of watching client
Voice, picture, word can also be carried out between family or give the interaction of electronics present；2. be polymerized for user in group's mode by one kind
Immediate communication platform together, such as video conferencing system, user enter group, Yong Hu by way of logging in client
Exist with the identity of group member in group, multiple group members are included in same group, user can be optionally added or move back
Go out group, in group, various interactions such as word, voice, video can be carried out.
It is as shown in Figure 1 an embodiment schematic flow sheet of video playing control method of the present invention, comprises the following steps：
Step S100：The video flowing of direct broadcasting room is obtained from server.
The playing flow of net cast is：Viewing end send watch a certain direct broadcasting room net cast ask->Server connects
Receive after the request by the broadcast address (usually one multicast URL) of direct broadcasting room return to viewing end->Viewing end is according to the ground
The corresponding multicast group of location addition->Then the video flowing (flow data) of the direct broadcasting room is obtained from server.Terminal gets described
After video flowing, the video flowing had been converted into image output display before end-user interface, in addition it is also necessary to the video
Stream such as is decoded, is rendered at the operation.
Preferably, the coded format of shown video flowing is H.264 or H.265 coded format, for live platform, can
To efficiently control the coded format of live video stream, and then for the hardware decoding of video flowing provides more easily condition.
Step S200：Determine the decoding condition that terminal is provided, the decoding interface that selection is adapted is carried out to the video flowing
Decoding, when the decoding condition includes hardware decoding interface and software decoding interface, preferentially calls the hardware decoding interface
Decoded, otherwise call the software decoding interface to be decoded.
Step S300：Determine terminal offer renders condition, and the selected figure being adapted renders interface and regarded decoded
Frequency stream exports user interface and shows after drawing, when it is described render condition and render interface comprising Hardware Render interface and software when,
Preferentially call the Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
It is determined that terminal provide decoding condition and determine terminal provide render condition before, this method also include step
Suddenly：
Determine the operating system version of terminal.
The operating system be WINDOWS systems, due to Microsoft WINDOWS systems WINDOWS7 and above version
For system bottom is configured with hardware-accelerated interface, cannot meet hardware in the operating system of below WINDOWS7 versions and decode and hard
The condition that part is rendered, therefore in the present embodiment, when the operating system of terminal is WINDOWS7 versions or more than WINDOWS7 versions,
Determine that terminal meets the precondition for providing hardware decoding and Hardware Render, otherwise, call software decoding interface to the video
Stream carries out soft decoding, then recalls WINDOWS GDI and draws decoded video flowing, exports and shown to user interface.
After it is determined that the operating system of terminal is WINDOWS7 versions or more than WINDOWS7 versions, also need to determine terminal
Whether hardware supports that hardware is decoded, therefore the present embodiment also includes step：
Determine the decoder type that terminal is supported.
The decoder type includes NVIDIA hardware decoders, INTEL hardware decoders, AMD hardware decoders, hardware
Decoding technique it is main by NVIDIA/INTEL/AMD tri- provide, wherein, the video card of Nvidia is released in terms of hardware decoding
PureVideo technologies and PureVideo HD technologies, the video card of Intel are proposed Intel Clear in terms of hardware decoding
Video technologies, the video card of AMD is proposed AMD Avivo technologies and AMD Avivo HD technologies in terms of hardware decoding.
Meanwhile, supporting the video card of PureVideo technologies has：GeForce6 series video cards, GeForce7 series video cards；Support
The video card of PureVideo HD (first generation) technology has：GeForce6 series video cards, GeForce7 series video cards,
GeForce6150 integrated graphics cards；The video card of PureVideo HD (second generation) technology of support has：GeForce8 series.
Supporting the video card of AMD Avaio technologies has：ATi X1300/X1600/X1800/X1900 series, ATi HD2000/
HD3000/HD4000 series, AMD HD5000/HD6000 series.
Supporting the video card of AMD Avaio HD technologies has：ATI HD2400/HD2600 series.
Supporting the video card of Intel Clear Video technologies has：Intel GMA X4500 series.
It is as shown in Figure 2 the flow chart of the decoder type that the present embodiment determines terminal support, specifically,
When terminal supports Nvidia hardware decoders, the hardware decoding interface of Nvidia hardware decoders is called to described
Video flowing is decoded；
When terminal supports Intel hardware decoders, the hardware decoding interface of Intel hardware decoders is called to be regarded to described
Frequency stream is decoded；
When terminal supports AMD hardware decoders, the hardware decoding interface of AMD hardware decoders is called to the video flowing
Decoded.
For whether hardware decoding can be carried out, except the support of terminal system and hardware in itself, in addition it is also necessary to video flowing
Encapsulation format and coded format all meet can just carry out hardware decoding, therefore in net cast field, live platform can be tight
The coded format (such as H.264 or H.265 form) and encapsulation format of lattice control live video stream, hardware solution is used for video flowing
Code provides more easily condition.
After to the decoding video stream, in addition it is also necessary to render decoded video flowing, now also need to determine
What terminal was provided renders condition, when it is described render condition and render interface comprising Hardware Render interface and software when, preferentially call institute
State Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
Specifically, the Hardware Render interface renders interface for DirectX figures, Microsoft is integrated by DirectX 11
It is following to be illustrated by taking DirectX 11 as an example in Windows 7：
A kind of implementation method is, when the video flowing is decoded using hardware, calls the figures of DirectX 11 to render interface
Decoded video flowing is converted into the forms of YUV 420, and (one kind is stored in video memory to be loaded into the texture of the establishments of DirectX 11
Picture container) in, export user interface after then video flowing is drawn using the equipment of DirectX 11 and show, this mode
The utilization rate of CPU can be saved with top down.
Another embodiment is, when the video flowing is decoded using software, calls the figures of DirectX 11 to render and connects
Decoded video flowing is changed into RGBA forms and is loaded in video memory by mouth, then recycles the equipment of DirectX 11 by video
Stream exports user interface and shows after drawing.
Also, when the video flowing renders interface and renders using the figures of DirectX 11, whether judge the video flowing
It is VR videos, if so, then being rendered using 3D figures, otherwise, is rendered using 2D figures.The DirectX 11 includes Direct
3D and Direct Draw interfaces, the 3D figures are rendered to be carried out by calling Direct 3D interfaces, and the 2D figures render logical
Cross and call the Direct Draw to carry out, VR (Virtual Reality) video is also called panoramic video, is that one kind can be real
Existing three dimensions shows the video of function, in net cast field, VR video flowings are high-resolution, code check high, and frame per second high is regarded
Frequency live TV stream, renders according to software decoding and GDI, and the excessive cpu resource of meeting occupied terminal causes video pictures interim card to show
As, and hardware decoding and/or Hardware Render are used, can effectively discharge the pressure of terminal CPU, it is ensured that high-quality video is broadcast
The fluency put.
In addition, in the present embodiment, open includes following manner using the function of hardware decoding and/or Hardware Render：
A kind of implementation method is after terminal renders outputting video streams using software decoding with GDI, to detect terminal
When CPU usage is higher than predetermined threshold value, hardware decoding and/or hardware wash with watercolours are carried out to the video flowing according to the method for the invention
Dye, to reduce the CPU usage of terminal, reduces the frame condition that falls of video flowing, improves the fluency of video playback, and then lift use
Experience at family.
Second implementation method is, after terminal gets video flowing, according to terminal provide decoding condition and render bar
Part, if meet providing hardware decoding and Hardware Render condition, automatically turns on to the hardware decoding of video flowing and Hardware Render.
Another embodiment is, opened when the control instruction of user is received to the hardware decoding of video flowing and/or
Hardware Render, the control instruction can be touched in triggering before terminal obtains video flowing or after terminal obtains video flowing
Hair, is as shown in Figure 3 an embodiment schematic diagram of present invention broadcasting live video stream, and arrow is pointed to during user can click on Fig. 3
Button open to the decoding of the hardware of video flowing and Hardware Render.
Second aspect, is as shown in Figure 4 an embodiment schematic diagram of video playback control device of the present invention, including：
Read module 100：Video flowing for obtaining direct broadcasting room from server.
The playing flow of net cast is：Viewing end send watch a certain direct broadcasting room net cast ask->Server connects
Receive after the request by the broadcast address (usually one multicast URL) of direct broadcasting room return to viewing end->Viewing end is according to the ground
The corresponding multicast group of location addition->Then the video flowing (flow data) of the direct broadcasting room is obtained from server.Read module 100 is obtained
After getting the video flowing, the video flowing had been converted into image output display before end-user interface, in addition it is also necessary to right
The video flowing such as is decoded, is rendered at the operation.
Decoder module 200：For determining the decoding condition that terminal is provided, the decoding interface that selection is adapted is to the video
Stream is decoded, and when the decoding condition includes hardware decoding interface and software decoding interface, preferentially calls the hardware solution
Code interface is decoded, and otherwise calls the software decoding interface to be decoded.
Rendering module 300：For determining that what terminal provided renders condition, the selected figure being adapted renders interface and will decode
Rear video flowing exports user interface and shows after drawing, when it is described render condition and rendered comprising Hardware Render interface and software connect
During mouth, preferentially call the Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
In the present embodiment, when the operating system of terminal is WINDOWS7 versions or more than WINDOWS7 versions, it is determined that eventually
End meets the precondition for providing hardware decoding and Hardware Render, and otherwise, decoder module 200 calls software decoding interface to described
Video flowing carries out soft decoding, and then rendering module 300 recalls WINDOWS GDI and draws decoded video flowing, exports and arrive
User interface shows.
After it is determined that the operating system of terminal is WINDOWS7 versions or more than WINDOWS7 versions, also need to determine terminal branch
The decoder type held, the decoder type includes NVIDIA hardware decoders, INTEL hardware decoders, the decoding of AMD hardware
Device；
When terminal supports Nvidia hardware decoders, decoder module 200 calls the hardware solution of Nvidia hardware decoders
Code interface is decoded to the video flowing；
When terminal supports Intel hardware decoders, decoder module 200 calls the hardware of Intel hardware decoders to decode
Interface is decoded to the video flowing；
When terminal supports AMD hardware decoders, decoder module 200 calls the hardware decoding interface of AMD hardware decoders
The video flowing is decoded.
After to the decoding video stream, in addition it is also necessary to which determine terminal offer renders condition, when the video flowing is used
When hardware is decoded, rendering module 300 calls the figures of DirectX 11 to render interface and decoded video flowing is converted into YUV 420
Form, and be loaded into the texture (a kind of to be stored in the picture container of video memory) of the establishments of DirectX 11, then using DirectX
11 equipment export user interface and show after video flowing is drawn；When the video flowing is decoded using software, rendering module 300
Call the figures of DirectX 11 to render interface decoded video flowing to be changed into RGBA forms and is loaded in video memory, Ran Houzai
User interface is exported after video flowing is drawn using the equipment of DirectX 11 to show.
The third aspect, the present invention also provides a kind of terminal device, for realizing above-mentioned video playing control method, including：
Video Decoder, video rendering engine, central processing unit, graphic process unit, memory, touch-sensitive display.
The present invention for net cast platform can effectively specification live video stream coded format, watching live regarding
When the terminal of frequency meets hardware decoding condition and/or Hardware Render condition, it is preferred to use hardware is decoded and Hardware Render is to live
Video flowing is decoded, rendered, it is ensured that the fluency of high-quality live video stream broadcasting, particularly with VR video flowings,
The occupancy of terminal CPU can be effectively reduced with Hardware Render using hardware decoding, solution is rendered using Software Coding and GDI
Cause the problem of video playback interim card；
Further, since live platform can effective specification live video stream coded format, video can be effectively prevented from
Stream encryption form is unsatisfactory for supporting the condition of hardware decoding, to provide more easily condition using hardware decoding by video flowing.
Although having been illustrated with some exemplary embodiments of the invention above, those skilled in the art will manage
Solution, in the case where principle of the invention or spirit is not departed from, can make a change to these exemplary embodiments, of the invention
Scope is limited by claim and its equivalent.
Claims (10)
1. a kind of video playing control method, it is characterised in that comprise the following steps：
The video flowing of direct broadcasting room is obtained from server；
Determine the decoding condition that terminal is provided, the decoding interface that selection is adapted is decoded to the video flowing, when the solution
When code-bar part includes hardware decoding interface and software decoding interface, the hardware decoding interface is preferentially called to be decoded, otherwise
The software decoding interface is called to be decoded；
Determine terminal offer renders condition, and the selected figure being adapted renders interface and will be exported after the drafting of decoded video flowing
Shown to user interface, when it is described render condition and render interface comprising Hardware Render interface and software when, preferentially call described hard
Part renders interface and is rendered, and otherwise calls the software to render interface and is rendered.
2. method according to claim 1, it is characterised in that the decoding condition that is provided in the determination terminal and determine eventually
Before what end provided renders condition, also include：
Determine the operating system version of terminal.
3. method according to claim 2, it is characterised in that the operating system is WINDOWS systems, as the behaviour of terminal
When making system for WINDOWS7 versions or more than WINDOWS7 versions, determine that terminal meets and hardware decoding and Hardware Render are provided
Precondition, otherwise calls software decoding interface to decode the video flowing, recalls software and renders interface by after decoding
Video flowing draw after export user interface and show.
4. method according to claim 1, it is characterised in that the decoding condition that the determination terminal is provided, selection is mutually fitted
The step of decoding interface matched somebody with somebody is decoded to the video flowing, specifically includes：
Determine the decoder type that terminal is supported, the decoder type includes that Nvidia hardware decoders, Intel hardware are decoded
Device, AMD hardware decoders；
When terminal supports Nvidia hardware decoders, the hardware decoding interface of Nvidia hardware decoders is called to the video
Stream is decoded；
When terminal supports Intel hardware decoders, the hardware decoding interface of Intel hardware decoders is called to the video flowing
Decoded；
When terminal supports AMD hardware decoders, call the hardware decoding interface of AMD hardware decoders is carried out to the video flowing
Decoding.
5. method according to claim 1, it is characterised in that the Hardware Render interface is rendered for the figures of DirectX 11
Interface, when the video flowing is decoded using hardware, calls the figures of DirectX 11 to render interface and decoded video circulates
Change the forms of YUV 420 into, and be loaded into the texture of the establishments of DirectX 11, then using the equipment of DirectX 11 by video flowing
Exported in user interface after drafting.
6. method according to claim 5, it is characterised in that when the video flowing is decoded using software, call
The figures of DirectX 11 render interface and decoded video flowing are changed into RGBA forms and is loaded in video memory, then utilize
The equipment of DirectX 11 is exported in user interface after video flowing is drawn.
7. the method according to claim 5 or 6, it is characterised in that when the video flowing uses Hardware Render, judge institute
State whether video flowing is VR videos, if so, then being rendered using 3D figures, otherwise, rendered using 2D figures.
8. method according to claim 1 and 2, it is characterised in that in the video flowing that direct broadcasting room is obtained from server
The step of after, when the control instruction of user is received just perform methods described subsequent step.
9. a kind of video playback control device, it is characterised in that including：
Read module：Video flowing for obtaining direct broadcasting room from server；
Decoder module：For determining the decoding condition that terminal is provided, the decoding interface that selection is adapted is carried out to the video flowing
Decoding, when the decoding condition includes hardware decoding interface and software decoding interface, preferentially calls the hardware decoding interface
Decoded, otherwise call the software decoding interface to be decoded；
Rendering module：For determining that what terminal provided renders condition, the selected figure being adapted renders interface and is regarded decoded
Frequency stream exports user interface and shows after drawing, when it is described render condition and render interface comprising Hardware Render interface and software when,
Preferentially call the Hardware Render interface to be rendered, otherwise call the software to render interface and rendered.
10. a kind of terminal device, for performing such as the step of claim 1-8 methods describeds, it is characterised in that including：Video
Decoder, video rendering engine, central processing unit, graphic process unit, memory, touch-sensitive display.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611259122.8A CN106713937A (en) | 2016-12-30 | 2016-12-30 | Video playing control method and device as well as terminal equipment |
| PCT/CN2017/107311 WO2018121014A1 (en) | 2016-12-30 | 2017-10-23 | Video play control method and apparatus and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611259122.8A CN106713937A (en) | 2016-12-30 | 2016-12-30 | Video playing control method and device as well as terminal equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106713937A true CN106713937A (en) | 2017-05-24 |
Family
ID=58905684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611259122.8A Pending CN106713937A (en) | 2016-12-30 | 2016-12-30 | Video playing control method and device as well as terminal equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106713937A (en) |
| WO (1) | WO2018121014A1 (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107864343A (en) * | 2017-10-09 | 2018-03-30 | 上海幻电信息科技有限公司 | The live image rendering method of computer and system based on video card |
| CN108040258A (en) * | 2017-11-21 | 2018-05-15 | 北京臻迪科技股份有限公司 | A kind of coding, coding/decoding method, apparatus and system |
| CN108235096A (en) * | 2018-01-18 | 2018-06-29 | 湖南快乐阳光互动娱乐传媒有限公司 | Method for intelligently switching soft decoding and playing video through hard decoding of mobile terminal |
| WO2018121014A1 (en) * | 2016-12-30 | 2018-07-05 | 广州虎牙信息科技有限公司 | Video play control method and apparatus and terminal device |
| CN108400977A (en) * | 2018-02-07 | 2018-08-14 | 苏州科达科技股份有限公司 | Video data transfers method and device |
| CN108600813A (en) * | 2018-05-17 | 2018-09-28 | 上海七牛信息技术有限公司 | a kind of media file playing method, device and media play system |
| CN109005420A (en) * | 2018-08-10 | 2018-12-14 | 深圳Tcl数字技术有限公司 | Presentation of video frames, acquisition methods, TV, cloud platform server and system |
| CN109088887A (en) * | 2018-09-29 | 2018-12-25 | 北京金山云网络技术有限公司 | A kind of decoded method and device of Streaming Media |
| CN109194983A (en) * | 2018-10-10 | 2019-01-11 | 贵阳朗玛信息技术股份有限公司 | Live broadcasting method, system, storage medium, broadcasting server and server cluster |
| CN109302617A (en) * | 2018-10-19 | 2019-02-01 | 武汉斗鱼网络科技有限公司 | A kind of video of specified multielement connects wheat method, apparatus, equipment and storage medium |
| CN109309867A (en) * | 2017-07-28 | 2019-02-05 | 中兴通讯股份有限公司 | Display methods, display terminal and the computer readable storage medium of terminal |
| CN109963191A (en) * | 2017-12-14 | 2019-07-02 | 中兴通讯股份有限公司 | A kind of processing method of video information, device and storage medium |
| CN110022479A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on Nvidia Maxwell2 video card |
| CN110022480A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on AMD video card |
| CN110022478A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on Intel SkyLake integrated graphics card |
| CN110620954A (en) * | 2018-06-20 | 2019-12-27 | 北京优酷科技有限公司 | Video processing method and device for hard solution |
| CN111246214A (en) * | 2018-11-28 | 2020-06-05 | 杭州海康威视数字技术股份有限公司 | Video decoding method and device |
| CN111836101A (en) * | 2019-04-19 | 2020-10-27 | 深圳市茁壮网络股份有限公司 | Video playing method and device |
| CN112203097A (en) * | 2020-09-30 | 2021-01-08 | 苏州臻迪智能科技有限公司 | Adaptive video decoding method and device, terminal equipment and storage medium |
| CN113032080A (en) * | 2021-03-31 | 2021-06-25 | 广州虎牙科技有限公司 | Page implementation method, application program, electronic device and storage medium |
| CN113055744A (en) * | 2020-08-31 | 2021-06-29 | 惠州华阳通用电子有限公司 | Video decoding method and device |
| CN114222073A (en) * | 2021-12-13 | 2022-03-22 | 北京百度网讯科技有限公司 | Video output method, video output device, electronic equipment and storage medium |
| CN114222185A (en) * | 2021-12-10 | 2022-03-22 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
| WO2023024370A1 (en) * | 2021-08-25 | 2023-03-02 | 上海擎感智能科技有限公司 | Video data processing method and video playing system |
| WO2024152893A1 (en) * | 2023-01-18 | 2024-07-25 | 百果园技术(新加坡)有限公司 | Video display control method, apparatus and device, and medium and product |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114007077B (en) * | 2021-11-17 | 2023-09-01 | 北京百度网讯科技有限公司 | Method and device for processing multimedia resources, electronic equipment and storage medium |
| CN114611101B (en) * | 2022-03-17 | 2024-04-26 | 杭州云深科技有限公司 | Data processing system for acquiring trend of application software |
| CN115665485B (en) * | 2022-12-26 | 2023-04-28 | 杭州星犀科技有限公司 | Video picture optimization method and device, storage medium and video terminal |
| CN118101971B (en) * | 2024-04-26 | 2024-07-05 | 飞狐信息技术（天津）有限公司 | Decoding data rendering method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102074257A (en) * | 2011-01-17 | 2011-05-25 | 博视联（苏州）信息科技有限公司 | Software and hardware-decoding general multi-media playing equipment and playing method thereof |
| CN103702124A (en) * | 2012-09-27 | 2014-04-02 | 深圳市快播科技有限公司 | Transcoding acceleration method and transcoder |
| CN104185062A (en) * | 2013-05-27 | 2014-12-03 | 中兴通讯股份有限公司 | Method for processing video streams by terminal and terminal |
| CN106131550A (en) * | 2016-07-25 | 2016-11-16 | 合网络技术（北京）有限公司 | Play the method and device of multimedia file |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713937A (en) * | 2016-12-30 | 2017-05-24 | 广州虎牙信息科技有限公司 | Video playing control method and device as well as terminal equipment |
-
2016
- 2016-12-30 CN CN201611259122.8A patent/CN106713937A/en active Pending
-
2017
- 2017-10-23 WO PCT/CN2017/107311 patent/WO2018121014A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102074257A (en) * | 2011-01-17 | 2011-05-25 | 博视联（苏州）信息科技有限公司 | Software and hardware-decoding general multi-media playing equipment and playing method thereof |
| CN103702124A (en) * | 2012-09-27 | 2014-04-02 | 深圳市快播科技有限公司 | Transcoding acceleration method and transcoder |
| CN104185062A (en) * | 2013-05-27 | 2014-12-03 | 中兴通讯股份有限公司 | Method for processing video streams by terminal and terminal |
| CN106131550A (en) * | 2016-07-25 | 2016-11-16 | 合网络技术（北京）有限公司 | Play the method and device of multimedia file |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018121014A1 (en) * | 2016-12-30 | 2018-07-05 | 广州虎牙信息科技有限公司 | Video play control method and apparatus and terminal device |
| CN109309867A (en) * | 2017-07-28 | 2019-02-05 | 中兴通讯股份有限公司 | Display methods, display terminal and the computer readable storage medium of terminal |
| CN107864343A (en) * | 2017-10-09 | 2018-03-30 | 上海幻电信息科技有限公司 | The live image rendering method of computer and system based on video card |
| CN108040258A (en) * | 2017-11-21 | 2018-05-15 | 北京臻迪科技股份有限公司 | A kind of coding, coding/decoding method, apparatus and system |
| CN108040258B (en) * | 2017-11-21 | 2020-05-15 | 北京臻迪科技股份有限公司 | Encoding and decoding method, device and system |
| CN109963191A (en) * | 2017-12-14 | 2019-07-02 | 中兴通讯股份有限公司 | A kind of processing method of video information, device and storage medium |
| CN110022479A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on Nvidia Maxwell2 video card |
| CN110022480B (en) * | 2018-01-09 | 2022-03-25 | 武汉斗鱼网络科技有限公司 | H265 hardware coding method based on AMD display card and live broadcast platform |
| CN110022480A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on AMD video card |
| CN110022478A (en) * | 2018-01-09 | 2019-07-16 | 武汉斗鱼网络科技有限公司 | A kind of H265 hardware encoding method and live streaming platform based on Intel SkyLake integrated graphics card |
| CN108235096A (en) * | 2018-01-18 | 2018-06-29 | 湖南快乐阳光互动娱乐传媒有限公司 | Method for intelligently switching soft decoding and playing video through hard decoding of mobile terminal |
| CN108400977A (en) * | 2018-02-07 | 2018-08-14 | 苏州科达科技股份有限公司 | Video data transfers method and device |
| CN108600813A (en) * | 2018-05-17 | 2018-09-28 | 上海七牛信息技术有限公司 | a kind of media file playing method, device and media play system |
| CN110620954A (en) * | 2018-06-20 | 2019-12-27 | 北京优酷科技有限公司 | Video processing method and device for hard solution |
| CN109005420A (en) * | 2018-08-10 | 2018-12-14 | 深圳Tcl数字技术有限公司 | Presentation of video frames, acquisition methods, TV, cloud platform server and system |
| CN109088887A (en) * | 2018-09-29 | 2018-12-25 | 北京金山云网络技术有限公司 | A kind of decoded method and device of Streaming Media |
| CN109194983A (en) * | 2018-10-10 | 2019-01-11 | 贵阳朗玛信息技术股份有限公司 | Live broadcasting method, system, storage medium, broadcasting server and server cluster |
| CN109302617A (en) * | 2018-10-19 | 2019-02-01 | 武汉斗鱼网络科技有限公司 | A kind of video of specified multielement connects wheat method, apparatus, equipment and storage medium |
| CN109302617B (en) * | 2018-10-19 | 2020-12-15 | 武汉斗鱼网络科技有限公司 | Multi-element-designated video microphone connecting method, device, equipment and storage medium |
| CN111246214A (en) * | 2018-11-28 | 2020-06-05 | 杭州海康威视数字技术股份有限公司 | Video decoding method and device |
| CN111246214B (en) * | 2018-11-28 | 2022-05-06 | 杭州海康威视数字技术股份有限公司 | Video decoding method and device |
| CN111836101A (en) * | 2019-04-19 | 2020-10-27 | 深圳市茁壮网络股份有限公司 | Video playing method and device |
| CN113055744B (en) * | 2020-08-31 | 2023-07-07 | 惠州华阳通用电子有限公司 | Video decoding method and device |
| CN113055744A (en) * | 2020-08-31 | 2021-06-29 | 惠州华阳通用电子有限公司 | Video decoding method and device |
| CN112203097A (en) * | 2020-09-30 | 2021-01-08 | 苏州臻迪智能科技有限公司 | Adaptive video decoding method and device, terminal equipment and storage medium |
| CN113032080B (en) * | 2021-03-31 | 2023-06-27 | 广州虎牙科技有限公司 | Page implementation method, application program, electronic device and storage medium |
| CN113032080A (en) * | 2021-03-31 | 2021-06-25 | 广州虎牙科技有限公司 | Page implementation method, application program, electronic device and storage medium |
| WO2023024370A1 (en) * | 2021-08-25 | 2023-03-02 | 上海擎感智能科技有限公司 | Video data processing method and video playing system |
| CN114222185A (en) * | 2021-12-10 | 2022-03-22 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
| CN114222185B (en) * | 2021-12-10 | 2024-04-05 | 洪恩完美(北京)教育科技发展有限公司 | Video playing method, terminal equipment and storage medium |
| CN114222073A (en) * | 2021-12-13 | 2022-03-22 | 北京百度网讯科技有限公司 | Video output method, video output device, electronic equipment and storage medium |
| WO2024152893A1 (en) * | 2023-01-18 | 2024-07-25 | 百果园技术(新加坡)有限公司 | Video display control method, apparatus and device, and medium and product |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018121014A1 (en) | 2018-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106713937A (en) | Video playing control method and device as well as terminal equipment | |
| CN106412621B (en) | Image display method and device, control method and relevant device between network direct broadcasting | |
| CN114501062B (en) | Video rendering coordination method, device, equipment and storage medium | |
| CN109525853B (en) | Live broadcast room cover display method and device, terminal, server and readable medium | |
| CN106576158A (en) | Immersive video | |
| CN106227492B (en) | Combination and mobile intelligent terminal interconnected method and device | |
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| WO2018103384A1 (en) | Method, device and system for playing 360 degree panoramic video | |
| CN109525802A (en) | A kind of video stream transmission method and device | |
| CN113535063A (en) | Live broadcast page switching method, video page switching method, electronic device and storage medium | |
| CN111327921A (en) | Video data processing method and device | |
| CN109862381A (en) | Promotion method, system, device and storage medium based on dynamic video poster | |
| CN111464828A (en) | Virtual special effect display method, device, terminal and storage medium | |
| US20170171579A1 (en) | Method and Device for Transcoding Live Video | |
| CN113596571B (en) | Screen sharing method, device, system, storage medium and computer equipment | |
| CN113569089A (en) | Information processing method, device, server, equipment, system and storage medium | |
| CN117676241A (en) | Digital factory large scene display method and system based on server three-dimensional rendering | |
| KR20160131830A (en) | System for cloud streaming service, method of cloud streaming service of providing multi-view screen based on resize and apparatus for the same | |
| CN116170636A (en) | Live video playing method and device, equipment and medium thereof | |
| CN107872683B (en) | Video data processing method, device, equipment and storage medium | |
| CN113596495B (en) | Live broadcast push stream processing method and device, equipment and medium thereof | |
| CN113411622B (en) | Loading method and device of live broadcast interface, client and storage medium | |
| KR20160131827A (en) | System for cloud streaming service, method of image cloud streaming service using alpha level of color bit and apparatus for the same | |
| CN115393490A (en) | Image rendering method and device, storage medium and electronic equipment | |
| CN1822563A (en) | Network terminal method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170524 |