CN106792093B - Video split-screen playing method and device and playing terminal - Google Patents
Video split-screen playing method and device and playing terminal Download PDFInfo
- Publication number
- CN106792093B CN106792093B CN201611183496.6A CN201611183496A CN106792093B CN 106792093 B CN106792093 B CN 106792093B CN 201611183496 A CN201611183496 A CN 201611183496A CN 106792093 B CN106792093 B CN 106792093B
- Authority
- CN
- China
- Prior art keywords
- screen
- texture
- video
- model
- split
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Controls And Circuits For Display Device (AREA)
- Image Generation (AREA)
Abstract
The invention discloses a video split-screen playing method, which comprises the steps that video picture data output by a player are drawn on texture A, the texture A is attached to a sphere model, and the texture A is continuously refreshed along with the video picture data; judging whether a split screen mode exists, if so, setting a view port to be a half of a display area, and simultaneously drawing the whole sphere model to a texture B associated with a left plane model and a texture C associated with a right plane model, wherein the left plane model and the right plane model respectively correspond to the half of the display area; setting the view port as the size of a display area, and drawing the left and right plane models on a display screen. According to the playing method, only one display layer (view) is operated, and the sphere model with the playing picture rendered can be selectively controlled to be drawn on textures associated with the left plane model and the right plane model and then be drawn on a screen, or the sphere model with the playing picture rendered is directly drawn on a real screen.
Description
Technical Field
The present invention relates to the field of panoramic video playing technologies, and in particular, to a video split-screen playing method and apparatus, and a playing terminal.
Background
With the rapid development of computer technology, multimedia has more and more kinds and performance effects. Some of the more traditional modes of expression are increasingly unable to meet the requirements of most customers. So 360 degree panoramic video is certainly the best choice when we need to represent a certain scene truly, comprehensively and intuitively. The 360-degree panoramic video technology can be used for house property display, sightseeing spots, automobiles, hotels, campuses, culture and gyms, corporate office environments and the like.
At present, the most convenient mode for feeling 360 the lowest cost of the panoramic video is a mode of adopting a mobile phone and a helmet display device. The mobile phone is placed in the helmet display equipment, the 360-degree panoramic video is played on the mobile phone, and a user can feel sensory shock experience caused by panoramic on the scene. Since the playing picture of the mobile phone is very close to human eyes, and the left and right split screens are needed to be carried out on the playing picture in order to see the picture clearly according to the principle that the human eyes see objects, the left and right split screen playing is an important technology in 360-degree panoramic viewing screens.
Currently, the implementation scheme of left and right split-screen playing is mainly implemented by adopting two control display layers (views), wherein a display area corresponding to a display screen is equally divided into left and right areas, each area displays one View, the same thing is done in each View, namely, a sphere model is drawn in each View by adopting OpenGL, and video pictures output by a player are respectively drawn on the surfaces of two spheres as textures. And switching the full-screen split-screen mode by controlling the display and the hiding of one of the views.
At present, the common realization scheme of split-screen playing needs two views to realize, so that the system resource cost is doubled, and great waste is caused, meanwhile, based on the scheme, when the dynamic switching of 360-degree panoramic video full-screen playing and split-screen playing is realized, one display layer (View) is dynamically hidden or displayed, the hidden or displayed View can lead to redrawing of a View system of an Android system, and not only can lead to great system resource cost, but also can flash a black screen in the switching process due to the existence of delay, meanwhile, the switching is not smooth enough, and the user experience is poor.
Disclosure of Invention
The invention aims at overcoming the technical defects in the prior art and provides a video split-screen playing method, a video split-screen playing device and a playing terminal.
The technical scheme adopted for realizing the purpose of the invention is as follows:
a video split-screen playing method comprises the steps of,
drawing video picture data output by the player onto texture A, attaching the texture A to the sphere model, and continuously refreshing the texture A along with the video picture data;
judging whether the split screen mode is adopted, if so,
setting a view port as a half of a display area, and simultaneously drawing the whole sphere model onto a texture B associated with a left plane model and a texture C associated with a right plane model, wherein the left plane model and the right plane model respectively correspond to the half of the display area;
setting the view port as the size of a display area, and drawing the left and right plane models on a display screen.
And if the mode is not the split screen mode, drawing the whole sphere model on a display screen.
In the Android system framework, the onDrawFrame method is utilized to continuously call back for refreshing the current video frame.
The display screen is a real screen, and the video is a 360-degree panoramic video.
A device for video split-screen playing comprises,
the playing module is used for drawing video picture data output by the player onto texture A, attaching the texture A to the sphere model, and continuously refreshing the texture A along with the video picture data;
a judging module for judging whether the split screen mode is in use,
the mapping module is used for setting the view port to be half of the display area in a split screen mode, integrally drawing the sphere model on a texture B associated with the left plane model and a texture C associated with the right plane model, wherein the left plane model and the right plane model respectively correspond to half of the display area;
and the drawing module is used for setting the view port as the size of the display area and drawing the left and right plane models on the display screen.
In the Android system framework, the onDrawFrame method is utilized to continuously call back for refreshing the current frame.
The display screen is a real screen.
A playing terminal with the video split-screen playing device is provided.
Compared with the prior art, the invention has the beneficial effects that:
according to the playing method, only one display layer (view) is operated, and the sphere model rendering the playing picture can be selectively controlled to be drawn on textures associated with the left plane model and the right plane model and then drawn on a screen, or the sphere model rendering the playing picture is directly drawn on a real screen. And smooth and rapid switching of full-screen split-screen playing can be realized, and user experience is greatly improved.
Drawings
Fig. 1 is a schematic structural diagram of a video split-screen playing method according to the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and the specific examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, the video split-screen playing method of the present invention includes,
step 101, video picture data output by a player is drawn on texture A, the texture A is attached to a sphere model, and the texture A is continuously refreshed along with the video picture data;
102, judging whether a split screen mode exists, if so, drawing the whole sphere model on a display screen if not;
step 103, setting a view port as a half of a display area, and simultaneously drawing the whole sphere model onto a texture B associated with a left plane model and a texture C associated with a right plane model, wherein the left plane model and the right plane model respectively correspond to the half of the display area;
the sphere model, the left plane model and the right plane model are instantiated models, the left plane model and the right plane model respectively correspond to left and right parts of a display area, the display area corresponds to a display screen, and the display screen is generally a real screen. The left plane model and the right plane model respectively correspond to half of the display area, and the view port is correspondingly adjusted when drawing is performed, so that normal display is ensured.
Step 104, setting the view port as the size of the display area, and drawing the left and right plane models to the preset area on the display screen correspondingly.
In the step, the left plane model and the right plane model are directly drawn on a real display screen for display, and the left plane model and the right plane model respectively occupy half of the screen for realizing split-screen display.
OpenGL (Open Graphics Library) is a specialized graphical programming interface defining a cross-programming language, cross-platform programming interface specification. The method is used for three-dimensional images (two-dimensional images can also be used), and is a bottom graphic library with powerful functions and convenient calling. The invention is realized based on opengl, and Frame Buffer Object (FBO) frame buffer object technology is also a technology in the opengl category. Specifically, the process flow of the onDrawFrame is: firstly refreshing picture data drawn on the texture A, then judging whether the variable is a split screen mode, and executing the following steps if the variable is the split screen mode: setting the view port to be half of a display area (width/2, height), simultaneously drawing the sphere model on a texture B associated with the left plane model and a texture C associated with the right plane model by using an FBO technology, setting the view port to be the original size of the display area, and drawing the left plane model and the right plane model on a real display screen, wherein the left plane model and the right plane model respectively occupy half of the screen. If the split screen mode is not adopted, the sphere model is integrally drawn on a real screen. That is, full screen and split screen modes can be dynamically switched by one variable. The onDrawFrame method is continuously callback-executed, so that continuous playing of the video is realized.
With whether the split screen mode is used as the only variable, only one example exists in video playing, rendering and drawing, and full-screen and split-screen panoramic video playing can be controlled by only one variable, so that system resource consumption is low, the speed is high, and user experience is good.
Meanwhile, the invention also discloses a device for video split-screen playing, which comprises,
the playing module is used for drawing video picture data output by the player onto texture A, attaching the texture A to the sphere model, and continuously refreshing the texture A along with the video picture data;
a judging module for judging whether the split screen mode is in use,
the mapping module is used for setting the view port to be half of the display area in a split screen mode, drawing the sphere model on a texture B associated with the left plane model and a texture C associated with the right plane model, and the left plane model and the right plane model respectively correspond to half of the display area;
and the drawing module is used for setting the view port as the size of the display area and integrally drawing the left plane model and the right plane model on the display screen.
The invention is realized in an Android system frame, and a control GLSurfaceView supporting OpenGL ES in the Android system is adopted for realization, but the principle of the invention can be applied to any platform supporting OpenGL.
The Android system is realized as follows:
in the onsurface protected callback method of glsurface view, render, a Sphere model (Sphere), a left plane model (screen queue), and a right plane model are respectively instantiated, a view port (view port) is set to be a high (height) width returned in the callback method in the onsurface protected callback method, and the ondraw frame method is continuously used for refreshing the current frame.
The playing terminal with the video split-screen playing device, such as a mobile phone, adopts the FBO technology, can dynamically control whether a sphere model is drawn on textures associated with a left plane model and a right plane model or is directly drawn on a real screen in the same View, can realize the rapid switching of the full-screen split-screen of the video, particularly 360-degree panoramic video, with low cost and high efficiency, and improves the user experience.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (7)
1. A video split-screen playing method is characterized by comprising the steps of,
the video is 360 degrees, video picture data output by the panoramic video player is drawn on texture A, the texture A is attached to the sphere model, and the texture A is continuously refreshed along with the video picture data;
judging whether the split screen mode is adopted, if so,
setting a view port as a half of a display area, and simultaneously drawing the whole sphere model onto a texture B associated with a left plane model and a texture C associated with a right plane model, wherein the left plane model and the right plane model respectively correspond to the half of the display area;
setting a view port as the size of a display area, and drawing left and right plane models on a display screen;
if the screen splitting mode is not adopted, the whole sphere model is drawn on the display screen, and through a variable, whether the sphere model is drawn on textures associated with the left plane model and the right plane model or directly drawn on a real screen is dynamically controlled, so that the full screen mode and the screen splitting mode are dynamically switched.
2. The method for video split-screen playing according to claim 1, wherein in the Android system framework, the method for ondraw frame is used for continuously recalling and refreshing the current video frame.
3. The method of claim 1, wherein the display screen is a real screen.
4. A device for video split-screen playing is characterized by comprising,
the playing module is used for drawing video picture data output by the player onto texture A, attaching the texture A to the sphere model, and continuously refreshing the texture A along with the video picture data;
a judging module for judging whether the split screen mode is in use,
the mapping module is used for setting the view port to be half of the display area in a split screen mode, integrally drawing the sphere model on a texture B associated with the left plane model and a texture C associated with the right plane model, wherein the left plane model and the right plane model respectively correspond to half of the display area;
and the drawing module is used for setting the view port as the size of the display area and drawing the left and right plane models on the display screen.
5. The apparatus for split-screen video playing according to claim 4, wherein in the Android system framework, the ondraw frame method is utilized to continuously call back for refreshing the current frame.
6. The apparatus for split-screen video playback as claimed in claim 5, wherein the display screen is a real screen.
7. A playback terminal having a video split-screen playback apparatus as claimed in any one of claims 4 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611183496.6A CN106792093B (en) | 2016-12-20 | 2016-12-20 | Video split-screen playing method and device and playing terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611183496.6A CN106792093B (en) | 2016-12-20 | 2016-12-20 | Video split-screen playing method and device and playing terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106792093A CN106792093A (en) | 2017-05-31 |
| CN106792093B true CN106792093B (en) | 2023-09-19 |
Family
ID=58895804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611183496.6A Active CN106792093B (en) | 2016-12-20 | 2016-12-20 | Video split-screen playing method and device and playing terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106792093B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10043302B2 (en) | 2016-04-18 | 2018-08-07 | Beijing Pico Technology Co., Ltd. | Method and apparatus for realizing boot animation of virtual reality system |
| CN105913477B (en) * | 2016-04-18 | 2019-02-12 | 北京小鸟看看科技有限公司 | A kind of method and apparatus for realizing virtual reality system solid starting animation |
| CN111258519B (en) * | 2018-11-30 | 2021-07-06 | 北京字节跳动网络技术有限公司 | Screen split implementation method, device, terminal and medium |
| CN109766039B (en) * | 2018-12-29 | 2021-06-25 | 努比亚技术有限公司 | Information display method of mobile terminal, mobile terminal and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105447898A (en) * | 2015-12-31 | 2016-03-30 | 北京小鸟看看科技有限公司 | Method and device for displaying 2D application interface in virtual real device |
| CN105678693A (en) * | 2016-01-25 | 2016-06-15 | 成都易瞳科技有限公司 | Panorama video browsing-playing method |
| CN106097245A (en) * | 2016-07-26 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind for the treatment of method and apparatus of panorama 3D video image |
| CN106162203A (en) * | 2016-07-05 | 2016-11-23 | 实野文化传媒（上海）有限公司 | Panoramic video player method, player and wear-type virtual reality device |
-
2016
- 2016-12-20 CN CN201611183496.6A patent/CN106792093B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105447898A (en) * | 2015-12-31 | 2016-03-30 | 北京小鸟看看科技有限公司 | Method and device for displaying 2D application interface in virtual real device |
| CN105678693A (en) * | 2016-01-25 | 2016-06-15 | 成都易瞳科技有限公司 | Panorama video browsing-playing method |
| CN106162203A (en) * | 2016-07-05 | 2016-11-23 | 实野文化传媒（上海）有限公司 | Panoramic video player method, player and wear-type virtual reality device |
| CN106097245A (en) * | 2016-07-26 | 2016-11-09 | 北京小鸟看看科技有限公司 | A kind for the treatment of method and apparatus of panorama 3D video image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106792093A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Li et al. | Building and using a scalable display wall system | |
| US9143770B2 (en) | Application programming interface supporting mixed two and three dimensional displays | |
| CN106792093B (en) | Video split-screen playing method and device and playing terminal | |
| WO2018188499A1 (en) | Image processing method and device, video processing method and device, virtual reality device and storage medium | |
| US11416201B2 (en) | Apparatus and associated methods for communication between users experiencing virtual reality | |
| CN108108140B (en) | Multi-screen cooperative display method, storage device and equipment supporting 3D display | |
| US20220188989A1 (en) | Per-pixel filter | |
| CN104038807A (en) | Layer mixing method and device based on open graphics library (OpenGL) | |
| US20030095131A1 (en) | Method and apparatus for processing photographic images | |
| CN112138386A (en) | Volume rendering method and device, storage medium and computer equipment | |
| WO2023207001A1 (en) | Image rendering method and apparatus, and electronic device and storage medium | |
| CN111754607A (en) | Picture processing method and device, electronic equipment and computer readable storage medium | |
| CN114782648A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN113645476A (en) | Picture processing method and device, electronic equipment and storage medium | |
| CN117319725A (en) | Subtitle display method, device, equipment and medium | |
| US11775051B2 (en) | Apparatus and associated methods for presentation of presentation data | |
| US12002165B1 (en) | Light probe placement for displaying objects in 3D environments on electronic devices | |
| CN205793049U (en) | Augmented reality scene news conference system | |
| US20190215581A1 (en) | A method and system for delivering an interactive video | |
| KR20220157323A (en) | Perspective correct vector graphics with foveated rendering | |
| US11023995B2 (en) | Systems and methods to toggle display links | |
| US20200258279A1 (en) | Image display method and apparatus, and storage medium | |
| US20240303768A1 (en) | Multidimensional Image Scaler | |
| US11869144B1 (en) | Modeling a physical environment based on saliency | |
| KR102586860B1 (en) | Handling interactive overlays for immersive teleconferencing and telepresence on remote devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |