Nothing Special   »   [go: up one dir, main page]

CN105892683A - Display method and target equipment - Google Patents

Display method and target equipment Download PDF

Info

Publication number
CN105892683A
CN105892683A CN201610285647.2A CN201610285647A CN105892683A CN 105892683 A CN105892683 A CN 105892683A CN 201610285647 A CN201610285647 A CN 201610285647A CN 105892683 A CN105892683 A CN 105892683A
Authority
CN
China
Prior art keywords
picture frame
processing unit
graphics processing
memory space
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610285647.2A
Other languages
Chinese (zh)
Inventor
吕铁汉
孙庆安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Le Xiang Science And Technology Ltd
Original Assignee
Shanghai Le Xiang Science And Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Le Xiang Science And Technology Ltd filed Critical Shanghai Le Xiang Science And Technology Ltd
Priority to CN201610285647.2A priority Critical patent/CN105892683A/en
Publication of CN105892683A publication Critical patent/CN105892683A/en
Priority to PCT/CN2016/100180 priority patent/WO2017185622A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention relates to the technical field of virtual reality and particularly relates to a display method and target equipment. The display method comprises the following steps that a first image processing unit in the target equipment renders to generate image frames to be displayed according to acquired position information of VR equipment, and duplicates the image frames to be displayed to a shared storage space; a second image processing unit in the target equipment adjusts the image frames in the shared storage space according to the current position information of the VR equipment in displaying and displays the adjusted image frames in the VR equipment. The display method and target equipment realizes the purpose that the rendered image frames generated and rendered by the first image processing unit are stored in the shared storage space, then the image frames in the shared space are adjusted by the second image processing unit according to the current position information of the VR equipment in displaying, and then the image frames displayed in the VR equipment correspond to the current position, so that the smearing phenomenon and the spinning sensation caused by sameness between the image frames seen by a user and the image frames at the former position can be avoided.

Description

A kind of display packing and target device
Technical field
The present invention relates to technical field of virtual reality, particularly relate to a kind of display packing and target device.
Background technology
In field of virtual reality, user uses VR (Virtual Reality, virtual reality) equipment to observe Virtual scene, but owing to the head movement of people is often very fast, and computer or the rendering capability of game host Limited, the head of the delay of scene rendering, i.e. people therefore can be caused to have had been rotated through, but computer or trip The image that play main frame is corresponding renders out the most in time, therefore the still former frame of display in VR equipment Image, thus there will be float and produce spinning sensation, affect user VR experience.
For the problems referred to above existed, the most still the good mode of neither one solves.
In sum, when VR equipment is worn in prior art existence, if the too fast meeting of head movement causes picture to be trembled Dynamic, and then produce the technical problem of spinning sensation.
Summary of the invention
The present invention provides a kind of display packing and target device, wears present in prior art in order to solving During VR equipment, if the too fast meeting of head movement causes float, and then the problem producing spinning sensation.
On the one hand, the embodiment of the present invention provides a kind of display packing, including:
The first graphics processing unit in target device is according to the Virtual Reality device location letter got Breath, renders and generates picture frame to be shown, and is copied to described picture frame to be shown share memory space;
The second graphics processing unit in described target device is according to the current location of described VR equipment during display Information adjusts the picture frame in described shared memory space, and the picture frame after adjusting shows at described VR Equipment.
The method that the embodiment of the present invention provides, the first graphics processing unit in target device is according to getting Virtual Reality device location information, renders and generates picture frame to be shown, and by described figure to be shown As frame is copied to share memory space;The second graphics processing unit in described target device is according to display time institute State the current location information of VR equipment and adjust the picture frame in described shared memory space, and after adjusting Picture frame shows at described VR equipment.The method achieve after being rendered by the first graphics processing unit generation Picture frame is also stored in shared memory space, then by the second graphics processing unit according to VR equipment during display Current location information the picture frame in the communal space is adjusted so that in VR equipment display image Frame is corresponding with current location, thus does not results in user because of the picture frame seen and the image of a upper position Frame is identical and causes motion blur phenomenon occur and cause spinning sensation, and therefore the method can realize user's head and quickly transports Time dynamic, it is also possible to see image and do not have spinning sensation clearly.
Alternatively, the second graphics processing unit in described target device is according to described VR equipment during display Current location information adjusts the picture frame in described shared memory space, including:
Described second graphics processing unit, according to the current location information of described VR equipment, determines described sharing Picture frame in memory space whether according to described current location render generation;
If described second graphics processing unit determines that the picture frame in described shared memory space is according to described Current location renders generation, then using the picture frame in described shared memory space as the image after adjustment Frame;
If described second graphics processing unit determines that the picture frame in described shared memory space is not according to institute State current location and render generation, then according to current location information and the described shared storage of described VR equipment Picture frame in space generates intermediate frame, and using described intermediate frame as the picture frame after adjustment.
Alternatively, described second graphics processing unit is according to the current location information of described VR equipment and described Share the picture frame in memory space and generate intermediate frame, including:
Described second graphics processing unit determine described VR equipment from described a position to described current location Rotation amount and translational movement, carry out rotating peace to described picture frame according to described rotation amount and described translational movement Move operation, obtain described intermediate frame.
Alternatively, described first graphics processing unit is created by first thread, described second graphics processing unit By the second thread creation;
Described being copied to by described picture frame to be shown shares memory space, including:
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Described shared memory space;
The second graphics processing unit in described target device is according to the current location of described VR equipment during display Before information adjusts the picture frame in described shared memory space, also include:
Picture frame in described shared memory space is sent to described second image procossing by described second thread Unit.
Alternatively, described first graphics processing unit includes the first pinup picture and the second pinup picture, described second pinup picture For described shared memory space;
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Before described shared memory space, also include:
The picture frame to be shown rendering generation is stored in described first patch by described first graphics processing unit In figure;
Described picture frame to be shown is copied to share memory space by described first thread, including:
Described picture frame in described first pinup picture is copied to described second pinup picture by described first thread.
Alternatively, described second thread is created by described first thread;
Described first graphics processing unit is DirectX equipment, and/or described second graphics processing unit is DirectX equipment.
On the other hand, the embodiment of the present invention provides a kind of target device, including:
First graphics processing unit, according to the Virtual Reality device location information got, renders generation Picture frame to be shown, and be copied to described picture frame to be shown share memory space;
Second graphics processing unit, adjusts described common according to the current location information of described VR equipment during display Enjoy the picture frame in memory space, and the picture frame after adjusting shows at described VR equipment.
Alternatively, described second graphics processing unit, specifically for:
According to the current location information of described VR equipment, determine that the picture frame in described shared memory space is According to no, described current location renders generation;
If it is determined that the picture frame in described shared memory space renders generation according to described current location, then Using the picture frame in described shared memory space as the picture frame after adjustment;
If it is determined that the picture frame in described shared memory space does not renders generation according to described current location, In the middle of then generating according to the picture frame in the current location information of described VR equipment and described shared memory space Frame, and using described intermediate frame as the picture frame after adjustment.
Alternatively, described second graphics processing unit, specifically for:
Determine described VR equipment from described a position to the rotation amount of described current location and translational movement, root According to described rotation amount and described translational movement, described picture frame is rotated and translation, obtain described centre Frame.
Alternatively, described first graphics processing unit is created by first thread, described second graphics processing unit By the second thread creation;
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Described shared memory space;
Picture frame in described shared memory space is sent to described second image procossing by described second thread Unit.
Alternatively, described first graphics processing unit includes the first pinup picture and the second pinup picture, described second pinup picture For described shared memory space;
Described first graphics processing unit is additionally operable to: described first thread passes through described first graphics processing unit Before described picture frame to be shown is copied to described shared memory space, the to be shown of generation will be rendered Picture frame is stored in described first pinup picture;
Described first thread specifically for: the described picture frame in described first pinup picture is copied to described second Pinup picture.
Alternatively, described second thread is created by described first thread;
Described first graphics processing unit is DirectX equipment, and/or described second graphics processing unit is DirectX equipment.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, institute in embodiment being described below The accompanying drawing used is needed to briefly introduce, it should be apparent that, the accompanying drawing in describing below is only the present invention's Some embodiments, from the point of view of those of ordinary skill in the art, in the premise not paying creative work Under, it is also possible to other accompanying drawing is obtained according to these accompanying drawings.
The display packing schematic diagram that Fig. 1 is suitable for by the embodiment of the present invention;
The display packing flow chart that Fig. 2 provides for the embodiment of the present invention;
The display packing schematic diagram that Fig. 3 provides for the embodiment of the present invention;
The display packing detail flowchart that Fig. 4 provides for the embodiment of the present invention;
The target device schematic diagram that Fig. 5 provides for the embodiment of the present invention.
Detailed description of the invention
In order to make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to this Bright it is described in further detail, it is clear that described embodiment is only a part of embodiment of the present invention, Rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not doing Go out all other embodiments obtained under creative work premise, broadly fall into the scope of protection of the invention.
As it is shown in figure 1, the display packing schematic diagram being suitable for by the embodiment of the present invention, wherein, target device In have two graphics processing units, the respectively first graphics processing unit 101 and the second graphics processing unit 102, wherein, target device can be VR equipment, it is also possible to VR equipment by wired or wireless The computer equipment that mode is attached, the first graphics processing unit 101 is mainly used according to VR equipment Positional information carries out image rendering and generates picture frame, then the picture frame of generation is stored shared memory space 103, the second graphics processing unit 102 from shared memory space 103, obtain picture frame, and according to figure As the display screen of VR equipment is carried out refreshing display by frame.
Wherein, when target device is VR equipment itself, VR equipment can complete image rendering to image The all working that frame refreshing shows, now VR equipment is an equipment with independent image disposal ability; When target device is a computer equipment, then VR equipment is by the way of wired or wireless and computer It is attached, is then completed image rendering work by computer equipment, and send to VR after generating picture frame Equipment carries out refreshing display, and now, VR equipment is only responsible for receiving the figure that computer equipment constantly sends over As frame, show, and not responsible render work.
Below in conjunction with Figure of description, the embodiment of the present invention is described in further detail.
As in figure 2 it is shown, the display packing that the embodiment of the present invention provides, including:
The first graphics processing unit in step 201, target device is according to the VR device location letter got Breath, renders and generates picture frame to be shown, and is copied to described picture frame to be shown share memory space;
The second graphics processing unit in step 202, described target device is according to described VR equipment during display Current location information adjust the picture frame in described shared memory space, and the picture frame after adjusting shows At described VR equipment.
First graphics processing unit, according to the VR device location information got, renders and generates figure to be shown As frame, it is then copied to share in memory space, and the second graphics processing unit is from shared memory space Obtain picture frame then to show on VR equipment, but owing to the first graphics processing unit generates image The frequency of frame and the second image procossing display picture frame (i.e. the frequency of VR equipment display picture frame) not phase With, such as generate the frequency of picture frame less than the second image procossing display picture frame when the first graphics processing unit Time, then causing the picture frame that likely the second graphics processing unit gets from shared memory space is last time The picture frame obtained, the picture frame i.e. sharing memory space does not have enough time to update, now by The above-mentioned steps 201 of the present invention~the method for step 202, may be implemented in the figure shown on VR equipment after adjusting As frame.
Specifically, the first graphics processing unit is responsible for generating picture frame according to VR device location information and storing In shared memory space, and in above-mentioned steps 202, and the second graphics processing unit is according to VR equipment Current location information adjust the picture frame in described shared memory space, and the picture frame after adjusting shows At described VR equipment.
Specifically, the picture frame in the shared memory space that the second graphics processing unit gets is divided into following two Kind situation:
Situation one, described picture frame are that the current location according to VR equipment renders generation
If the second graphics processing unit determines that the picture frame in shared memory space is to render according to current location Generate, then directly this picture frame is shown as the picture frame after adjustment, the picture frame after then adjusting At described VR equipment.
Under this situation, when user's head rotation, reach new position, now first image procossing Unit renders according to this new position and obtains a new picture frame, and this picture frame is at the first image procossing Unit obtains before picture frame to shared memory space, is stored on sharing in memory space, therefore when the One graphics processing unit when shared memory space obtains picture frame, get to be one be exactly the newest Picture frame corresponding to position, thus directly this picture frame is shown.
Situation two, described picture frame are not that the current location according to VR equipment renders generation
Under this situation, the picture frame in the shared memory space that the first image procossing gets is not according to current Position renders generation, is i.e. to be generated, due to the first graphics processing unit according to VR position before Render the frequency speed less than the second graphics processing unit display picture frame of new picture frame, therefore when second When graphics processing unit wants to show a two field picture, get from shared memory space remain before Picture frame through showing, if now directly shown by this picture frame, then can cause user currently The picture frame that moment is seen is identical with the picture frame that a upper moment is seen, thus causes motion blur phenomenon occur, very To being the situation that can cause user that dizziness occurs.
Therefore, for solving this problem, the picture frame in the second graphics processing unit determines shared memory space Generation is not rendered, then according to current location information and the shared storage sky of VR equipment according to current location Picture frame between generates intermediate frame, and using intermediate frame as the picture frame after adjustment.I.e. according to VR equipment Current location information and the picture frame that gets, generate an intermediate frame, then using this intermediate frame as tune Picture frame after whole, and the picture frame after described adjustment is shown, alternatively, at described second image Reason unit generates according to the picture frame in the current location information of described VR equipment and described shared memory space Intermediate frame, including: described second graphics processing unit determine described VR equipment from described a position to institute State rotation amount and the translational movement of current location, according to described rotation amount and described translational movement, described picture frame is entered Row rotates and translation, obtains described intermediate frame.
For example, user is when putting on VR equipment, and head current location is A, when user has done one When the action of quick rotation head arrives B, cause the first graphics processing unit owing to user's head rotation is too fast Having little time to render out by a up-to-date two field picture frame, now the second graphics processing unit is according to the present bit of user Put an A and upper position B, obtain rotation amount and the translational movement of user's (namely VR equipment), thus base In the rotation amount obtained and translational movement, to the picture frame in shared memory space, (this picture frame is showing Showed at least one times) rotate accordingly and translation, thus obtain intermediate frame.
Owing to, in reality, a two field picture may be bigger than the display screen of VR equipment, it is also possible to sets with VR Standby display screen size is identical.
When a two field picture is bigger than the display screen of VR equipment, the most only partial information is displayed on VR equipment On, when generating intermediate frame, actually see is the image information not shown before of picture frame, Such as, in a two field picture, left position shows river, shows a personage in centre position, on the right side Limit position display has an animal, then only may can show on VR equipment and see a personage, and left The river of position, limit and the animal of location right will not be simultaneously displayed on VR equipment, when raw by said method When becoming intermediate frame, if user's head is on the left of turning to, then the intermediate frame of generation actually shows Content is exactly river, if user's head turns to right side, then the intermediate frame of generation actually shows Content is exactly animal.I.e. intermediate frame obtains after carrying out rotating and translating based on existing picture frame;When When one two field picture is equal in magnitude with the display screen of VR equipment, then the intermediate frame of generation can be previous frame figure The partial content of picture, then refills part black image, generates an intermediate frame.
Alternatively, described first graphics processing unit is created by first thread, described second graphics processing unit By the second thread creation;After the first graphics processing unit generates picture frame, by first thread by first Picture frame to be shown is copied to shared memory space by graphics processing unit, and will be altogether by the second thread Enjoy the picture frame in memory space and be sent to the second graphics processing unit.
In actual applications, the first graphics processing unit and the second image procossing unit can be to have at image The unit of reason ability, such as, can be some image processing software modules etc., alternatively, described second thread Created by described first thread;And described first graphics processing unit is DirectX equipment, and/or institute Stating the second graphics processing unit is DirectX equipment.
Wherein, DirectX (Direct eXtension is called for short DX) is that the multimedia created by Microsoft is compiled Journey interface.Being realized by C++ programming language, be widely used in electronic game exploitation, DirectX is so One group of technology: they are intended to make computer based on Windows become operation and display has abundant multimedia The ideal platform of the application program of element (the most panchromatic figure, video, three-dimensional animation and abundant audio frequency).
With reference to Fig. 3, the display packing schematic diagram provided for the embodiment of the present invention, wherein by the first image procossing Unit is a DirectX equipment, comprises the first pinup picture and the second pinup picture, and wherein, the second pinup picture is The shared memory space stated;The picture frame to be shown rendering generation is stored in by the first graphics processing unit In one pinup picture, then by first thread, the picture frame in the first pinup picture is copied in the second pinup picture.
In Fig. 3, first thread rendered by game engine and obtain picture frame, then picture frame is exported Pinup picture 1 (the i.e. first pinup picture) in DirectX equipment, then by first thread by the picture frame in pinup picture 1 It is copied in pinup picture 2 (the i.e. second pinup picture), the shared memory space that wherein the second pinup picture is in Fig. 1, Then from pinup picture 2, obtained shared picture frame by the second thread, be sent to the second graphics processing unit, by The picture frame got is shown on VR equipment by the second graphics processing unit, or obtains through process After intermediate frame, intermediate frame is shown on VR equipment.Wherein, the first pinup picture and the second pinup picture are appreciated that It is a memory space, picture frame can be stored.
Additionally, the DirectX equipment (the i.e. first graphics processing unit) in first thread and the second thread In the version of the 2nd DirectX equipment (the i.e. second graphics processing unit) can be identical, it is also possible to Be different, such as the DirectX device version in first thread is DirectX11, in the second thread DirectX device version be the DirectX device version in 11, or first thread be DirectX9, DirectX device version in second thread is 11 etc., is not construed as limiting this.
The method that the embodiment of the present invention provides, the first graphics processing unit in target device is according to getting Virtual Reality device location information, renders and generates picture frame to be shown, and by described figure to be shown As frame is copied to share memory space;The second graphics processing unit in described target device is according to display time institute State the current location information of VR equipment and adjust the picture frame in described shared memory space, and after adjusting Picture frame shows at described VR equipment.The method achieve after being rendered by the first graphics processing unit generation Picture frame is also stored in shared memory space, then by the second graphics processing unit according to VR equipment during display Current location information the picture frame in the communal space is adjusted so that in VR equipment display image Frame is corresponding with current location, thus does not results in user because of the picture frame seen and the image of a upper position Frame is identical and causes motion blur phenomenon occur and cause spinning sensation, and therefore the method can realize user's head and quickly transports Time dynamic, it is also possible to see image and do not have spinning sensation clearly.
The display packing provided the embodiment of the present invention below is described in detail, as shown in Figure 4, for the present invention The display packing detail flowchart that embodiment provides, including:
The first graphics processing unit in step 401, target device sets according to the Virtual Reality got Standby positional information, renders and generates picture frame to be shown, and be copied to share by described picture frame to be shown Memory space.
The second graphics processing unit in step 402, target device is according to the current location of described VR equipment Information, determines that described current location renders generation according to the picture frame in described shared memory space is whether , the most then forward step 403 to, if it is not, then forward step 404 to.
Step 403, described second graphics processing unit using the picture frame in described shared memory space as tune Picture frame after whole.
Step 404, described second graphics processing unit determine described VR equipment from a upper position to present bit The rotation amount put and translational movement, carry out described picture frame rotating according to described rotation amount and described translational movement and Translation, obtains intermediate frame, and using described intermediate frame as the picture frame after adjustment.
The method that the embodiment of the present invention provides, the first graphics processing unit in target device is according to getting Virtual Reality device location information, renders and generates picture frame to be shown, and by described figure to be shown As frame is copied to share memory space;The second graphics processing unit in described target device is according to display time institute State the current location information of VR equipment and adjust the picture frame in described shared memory space, and after adjusting Picture frame shows at described VR equipment.The method achieve after being rendered by the first graphics processing unit generation Picture frame is also stored in shared memory space, then by the second graphics processing unit according to VR equipment during display Current location information the picture frame in the communal space is adjusted so that in VR equipment display image Frame is corresponding with current location, thus does not results in user because of the picture frame seen and the image of a upper position Frame is identical and causes motion blur phenomenon occur and cause spinning sensation, and therefore the method can realize user's head and quickly transports Time dynamic, it is also possible to see image and do not have spinning sensation clearly.
Based on identical technology design, the embodiment of the present invention also provides for a kind of target device.The embodiment of the present invention The target device provided is as it is shown in figure 5, include:
First graphics processing unit 501, according to the Virtual Reality device location information got, renders Generate picture frame to be shown, and be copied to described picture frame to be shown share memory space;
Second graphics processing unit 502, adjusts institute according to the current location information of described VR equipment during display State the picture frame in shared memory space, and the picture frame after adjusting shows at described VR equipment.
Alternatively, described second graphics processing unit 502, specifically for:
According to the current location information of described VR equipment, determine that the picture frame in described shared memory space is According to no, described current location renders generation;
If it is determined that the picture frame in described shared memory space renders generation according to described current location, then Using the picture frame in described shared memory space as the picture frame after adjustment;
If it is determined that the picture frame in described shared memory space does not renders generation according to described current location, In the middle of then generating according to the picture frame in the current location information of described VR equipment and described shared memory space Frame, and using described intermediate frame as the picture frame after adjustment.
Alternatively, described second graphics processing unit 502, specifically for:
Determine described VR equipment from described a position to the rotation amount of described current location and translational movement, root According to described rotation amount and described translational movement, described picture frame is rotated and translation, obtain described centre Frame.
Alternatively, described first graphics processing unit 501 is created by first thread, described second image procossing Unit 502 is by the second thread creation;
Described picture frame to be shown is replicated by described first thread by described first graphics processing unit 501 To described shared memory space;
Picture frame in described shared memory space is sent to described second image procossing by described second thread Unit 502.
Alternatively, described first graphics processing unit 501 includes the first pinup picture and the second pinup picture, described second Pinup picture is described shared memory space;
Described first graphics processing unit 501 is additionally operable to: described first thread passes through described first image procossing Before described picture frame to be shown is copied to described shared memory space by unit 501, generation will be rendered Picture frame to be shown is stored in described first pinup picture;
Described first thread specifically for: the described picture frame in described first pinup picture is copied to described second Pinup picture.
Alternatively, described second thread is created by described first thread;
Described first graphics processing unit 501 is DirectX equipment, and/or described second graphics processing unit 502 is DirectX equipment.
The embodiment of the present invention, the first graphics processing unit in target device is according to the virtual reality got VR device location information, renders and generates picture frame to be shown, and is replicated by described picture frame to be shown To sharing memory space;The second graphics processing unit in described target device sets according to described VR during display Standby current location information adjusts the picture frame in described shared memory space, and the picture frame after adjusting shows Show at described VR equipment.The embodiment of the present invention achieves and is generated the figure after rendering by the first graphics processing unit As frame and be stored in shared memory space, then by the second graphics processing unit according to VR equipment during display Picture frame in the communal space is adjusted by current location information so that the picture frame of display in VR equipment It is corresponding with current location, thus does not results in user because of the picture frame seen and the picture frame of a upper position Identical and cause motion blur phenomenon occur and cause spinning sensation, therefore the method can realize user's head rapid movement Time, it is also possible to see image and do not have spinning sensation clearly.
The present invention is with reference to method, equipment (system) and computer program product according to embodiments of the present invention The flow chart of product and/or block diagram describe.It should be understood that can by computer program instructions flowchart and / or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/ Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embedding The processor of formula datatron or other programmable data processing device is to produce a machine so that by calculating The instruction that the processor of machine or other programmable data processing device performs produces for realizing at flow chart one The device of the function specified in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or the process of other programmable datas can be guided to set In the standby computer-readable memory worked in a specific way so that be stored in this computer-readable memory Instruction produce and include the manufacture of command device, this command device realizes in one flow process or multiple of flow chart The function specified in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes Sequence of operations step must be performed to produce computer implemented place on computer or other programmable devices Reason, thus the instruction performed on computer or other programmable devices provides for realizing flow chart one The step of the function specified in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know base This creativeness concept, then can make other change and amendment to these embodiments.So, appended right is wanted Ask and be intended to be construed to include preferred embodiment and fall into all changes and the amendment of the scope of the invention.
Obviously, those skilled in the art can carry out various change and modification without deviating from this to the present invention Bright spirit and scope.So, if the present invention these amendment and modification belong to the claims in the present invention and Within the scope of its equivalent technologies, then the present invention is also intended to comprise these change and modification.

Claims (12)

1. a display packing, it is characterised in that including:
The first graphics processing unit in target device is according to the Virtual Reality device location letter got Breath, renders and generates picture frame to be shown, and is copied to described picture frame to be shown share memory space;
The second graphics processing unit in described target device is according to the current location of described VR equipment during display Information adjusts the picture frame in described shared memory space, and the picture frame after adjusting shows at described VR Equipment.
2. the method for claim 1, it is characterised in that the second image in described target device Processing unit adjusts in described shared memory space according to the current location information of described VR equipment during display Picture frame, including:
Described second graphics processing unit, according to the current location information of described VR equipment, determines described sharing Picture frame in memory space whether according to described current location render generation;
If described second graphics processing unit determines that the picture frame in described shared memory space is according to described Current location renders generation, then using the picture frame in described shared memory space as the image after adjustment Frame;
If described second graphics processing unit determines that the picture frame in described shared memory space is not according to institute State current location and render generation, then according to current location information and the described shared storage of described VR equipment Picture frame in space generates intermediate frame, and using described intermediate frame as the picture frame after adjustment.
3. method as claimed in claim 2, it is characterised in that described second graphics processing unit according to Picture frame in the current location information of described VR equipment and described shared memory space generates intermediate frame, bag Include:
Described second graphics processing unit determine described VR equipment from described a position to described current location Rotation amount and translational movement, carry out rotating peace to described picture frame according to described rotation amount and described translational movement Move operation, obtain described intermediate frame.
4. the method as according to any one of claim 1-3, it is characterised in that at described first image Reason unit is created by first thread, and described second graphics processing unit is by the second thread creation;
Described being copied to by described picture frame to be shown shares memory space, including:
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Described shared memory space;
The second graphics processing unit in described target device is according to the current location of described VR equipment during display Before information adjusts the picture frame in described shared memory space, also include:
Picture frame in described shared memory space is sent to described second image procossing by described second thread Unit.
5. method as claimed in claim 4, it is characterised in that described first graphics processing unit includes First pinup picture and the second pinup picture, described second pinup picture is described shared memory space;
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Before described shared memory space, also include:
The picture frame to be shown rendering generation is stored in described first patch by described first graphics processing unit In figure;
Described picture frame to be shown is copied to share memory space by described first thread, including:
Described picture frame in described first pinup picture is copied to described second pinup picture by described first thread.
6. method as claimed in claim 5, it is characterised in that described second thread is by described first Thread creation;
Described first graphics processing unit is DirectX equipment, and/or described second graphics processing unit is DirectX equipment.
7. a target device, it is characterised in that including:
First graphics processing unit, according to the Virtual Reality device location information got, renders generation Picture frame to be shown, and be copied to described picture frame to be shown share memory space;
Second graphics processing unit, adjusts described common according to the current location information of described VR equipment during display Enjoy the picture frame in memory space, and the picture frame after adjusting shows at described VR equipment.
8. target device as claimed in claim 7, it is characterised in that described second graphics processing unit, Specifically for:
According to the current location information of described VR equipment, determine that the picture frame in described shared memory space is According to no, described current location renders generation;
If it is determined that the picture frame in described shared memory space renders generation according to described current location, then Using the picture frame in described shared memory space as the picture frame after adjustment;
If it is determined that the picture frame in described shared memory space does not renders generation according to described current location, In the middle of then generating according to the picture frame in the current location information of described VR equipment and described shared memory space Frame, and using described intermediate frame as the picture frame after adjustment.
9. target device as claimed in claim 8, it is characterised in that described second graphics processing unit, Specifically for:
Determine described VR equipment from described a position to the rotation amount of described current location and translational movement, root According to described rotation amount and described translational movement, described picture frame is rotated and translation, obtain described centre Frame.
10. target device as claimed in any one of claims 7-9, it is characterised in that described first figure As processing unit is created by first thread, described second graphics processing unit is by the second thread creation;
Described picture frame to be shown is copied to by described first thread by described first graphics processing unit Described shared memory space;
Picture frame in described shared memory space is sent to described second image procossing by described second thread Unit.
11. target devices as claimed in claim 10, it is characterised in that described first image procossing list Unit includes that the first pinup picture and the second pinup picture, described second pinup picture are described shared memory space;
Described first graphics processing unit is additionally operable to: described first thread passes through described first graphics processing unit Before described picture frame to be shown is copied to described shared memory space, the to be shown of generation will be rendered Picture frame is stored in described first pinup picture;
Described first thread specifically for: the described picture frame in described first pinup picture is copied to described second Pinup picture.
12. target devices as claimed in claim 11, it is characterised in that described second thread is by institute State what first thread created;
Described first graphics processing unit is DirectX equipment, and/or described second graphics processing unit is DirectX equipment.
CN201610285647.2A 2016-04-29 2016-04-29 Display method and target equipment Pending CN105892683A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610285647.2A CN105892683A (en) 2016-04-29 2016-04-29 Display method and target equipment
PCT/CN2016/100180 WO2017185622A1 (en) 2016-04-29 2016-09-26 Display method and target device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610285647.2A CN105892683A (en) 2016-04-29 2016-04-29 Display method and target equipment

Publications (1)

Publication Number Publication Date
CN105892683A true CN105892683A (en) 2016-08-24

Family

ID=56703219

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610285647.2A Pending CN105892683A (en) 2016-04-29 2016-04-29 Display method and target equipment

Country Status (2)

Country Link
CN (1) CN105892683A (en)
WO (1) WO2017185622A1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106373537A (en) * 2016-09-12 2017-02-01 上海乐相科技有限公司 Method and apparatus for reducing display image streaking
CN106385625A (en) * 2016-09-29 2017-02-08 宇龙计算机通信科技(深圳)有限公司 Image intermediate frame generation method and device
CN106445139A (en) * 2016-09-22 2017-02-22 乐视控股(北京)有限公司 Data display method, device and system
CN106598252A (en) * 2016-12-23 2017-04-26 深圳超多维科技有限公司 Image display adjustment method and apparatus, storage medium and electronic device
CN106658170A (en) * 2016-12-20 2017-05-10 福州瑞芯微电子股份有限公司 Method and device for reducing virtual reality latency
WO2017185622A1 (en) * 2016-04-29 2017-11-02 上海乐相科技有限公司 Display method and target device
CN107943287A (en) * 2017-11-16 2018-04-20 烽火通信科技股份有限公司 A kind of system and method that VR floats are solved based on Android set top box system
CN107945138A (en) * 2017-12-08 2018-04-20 京东方科技集团股份有限公司 A kind of image processing method and device
CN107979763A (en) * 2016-10-21 2018-05-01 阿里巴巴集团控股有限公司 A kind of virtual reality device generation video, playback method, apparatus and system
CN108289175A (en) * 2018-02-05 2018-07-17 黄淮学院 A kind of low latency virtual reality display methods and display system
CN108295469A (en) * 2017-12-04 2018-07-20 成都思悟革科技有限公司 Game visual angle effect method based on motion capture technology
WO2018205152A1 (en) * 2017-05-09 2018-11-15 华为技术有限公司 Vr drawing method, device and system
WO2019056904A1 (en) * 2017-09-25 2019-03-28 中兴通讯股份有限公司 Video transmission method, server, vr playback terminal and computer-readable storage medium
CN109725956A (en) * 2017-10-26 2019-05-07 腾讯科技(深圳)有限公司 A kind of method and relevant apparatus of scene rendering
CN111131865A (en) * 2018-10-30 2020-05-08 中国电信股份有限公司 Method, device and system for improving VR video playing fluency and set top box
WO2020140720A1 (en) * 2019-01-02 2020-07-09 京东方科技集团股份有限公司 Rendering method and apparatus for virtual reality scene, and device
CN112150586A (en) * 2019-06-11 2020-12-29 腾讯科技(深圳)有限公司 Animation processing method, animation processing device, computer readable storage medium and computer equipment
CN112230776A (en) * 2020-10-29 2021-01-15 北京京东方光电科技有限公司 Virtual reality display method, device and storage medium
WO2023000547A1 (en) * 2021-07-22 2023-01-26 歌尔股份有限公司 Image processing method and device, and computer-readable storage medium
WO2023240550A1 (en) * 2022-06-16 2023-12-21 北京小米移动软件有限公司 Image signal transmission method and apparatus, and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140204235A1 (en) * 2013-01-23 2014-07-24 Orcam Technologies Ltd. Apparatus for processing images to prolong battery life
CN105103034A (en) * 2013-03-25 2015-11-25 索尼电脑娱乐欧洲有限公司 Display
CN105530533A (en) * 2014-10-21 2016-04-27 霍尼韦尔国际公司 Low latency augmented reality display

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3745117B2 (en) * 1998-05-08 2006-02-15 キヤノン株式会社 Image processing apparatus and image processing method
US9240069B1 (en) * 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system
CN105892683A (en) * 2016-04-29 2016-08-24 上海乐相科技有限公司 Display method and target equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140204235A1 (en) * 2013-01-23 2014-07-24 Orcam Technologies Ltd. Apparatus for processing images to prolong battery life
CN105103034A (en) * 2013-03-25 2015-11-25 索尼电脑娱乐欧洲有限公司 Display
CN105530533A (en) * 2014-10-21 2016-04-27 霍尼韦尔国际公司 Low latency augmented reality display

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017185622A1 (en) * 2016-04-29 2017-11-02 上海乐相科技有限公司 Display method and target device
CN106373537A (en) * 2016-09-12 2017-02-01 上海乐相科技有限公司 Method and apparatus for reducing display image streaking
CN106445139A (en) * 2016-09-22 2017-02-22 乐视控股(北京)有限公司 Data display method, device and system
CN106385625A (en) * 2016-09-29 2017-02-08 宇龙计算机通信科技(深圳)有限公司 Image intermediate frame generation method and device
CN107979763A (en) * 2016-10-21 2018-05-01 阿里巴巴集团控股有限公司 A kind of virtual reality device generation video, playback method, apparatus and system
CN106658170A (en) * 2016-12-20 2017-05-10 福州瑞芯微电子股份有限公司 Method and device for reducing virtual reality latency
CN106598252A (en) * 2016-12-23 2017-04-26 深圳超多维科技有限公司 Image display adjustment method and apparatus, storage medium and electronic device
WO2018205152A1 (en) * 2017-05-09 2018-11-15 华为技术有限公司 Vr drawing method, device and system
WO2019056904A1 (en) * 2017-09-25 2019-03-28 中兴通讯股份有限公司 Video transmission method, server, vr playback terminal and computer-readable storage medium
CN109725956B (en) * 2017-10-26 2022-02-01 腾讯科技(深圳)有限公司 Scene rendering method and related device
CN109725956A (en) * 2017-10-26 2019-05-07 腾讯科技(深圳)有限公司 A kind of method and relevant apparatus of scene rendering
CN107943287A (en) * 2017-11-16 2018-04-20 烽火通信科技股份有限公司 A kind of system and method that VR floats are solved based on Android set top box system
CN108295469A (en) * 2017-12-04 2018-07-20 成都思悟革科技有限公司 Game visual angle effect method based on motion capture technology
CN107945138A (en) * 2017-12-08 2018-04-20 京东方科技集团股份有限公司 A kind of image processing method and device
WO2019109699A1 (en) * 2017-12-08 2019-06-13 京东方科技集团股份有限公司 Picture processing method and apparatus
CN107945138B (en) * 2017-12-08 2020-04-03 京东方科技集团股份有限公司 Picture processing method and device
US11615509B2 (en) 2017-12-08 2023-03-28 Beijing Boe Optoelectronics Technology Co., Ltd. Picture processing method and device
CN108289175B (en) * 2018-02-05 2020-12-08 黄淮学院 Low-delay virtual reality display method and display system
CN108289175A (en) * 2018-02-05 2018-07-17 黄淮学院 A kind of low latency virtual reality display methods and display system
CN111131865A (en) * 2018-10-30 2020-05-08 中国电信股份有限公司 Method, device and system for improving VR video playing fluency and set top box
WO2020140720A1 (en) * 2019-01-02 2020-07-09 京东方科技集团股份有限公司 Rendering method and apparatus for virtual reality scene, and device
US11263803B2 (en) 2019-01-02 2022-03-01 Beijing Boe Optoelectronics Technology Co., Ltd. Virtual reality scene rendering method, apparatus and device
CN112150586A (en) * 2019-06-11 2020-12-29 腾讯科技(深圳)有限公司 Animation processing method, animation processing device, computer readable storage medium and computer equipment
CN112230776A (en) * 2020-10-29 2021-01-15 北京京东方光电科技有限公司 Virtual reality display method, device and storage medium
WO2023000547A1 (en) * 2021-07-22 2023-01-26 歌尔股份有限公司 Image processing method and device, and computer-readable storage medium
WO2023240550A1 (en) * 2022-06-16 2023-12-21 北京小米移动软件有限公司 Image signal transmission method and apparatus, and storage medium

Also Published As

Publication number Publication date
WO2017185622A1 (en) 2017-11-02

Similar Documents

Publication Publication Date Title
CN105892683A (en) Display method and target equipment
CN110869884B (en) Temporal supersampling for gaze point rendering systems
US20230039100A1 (en) Multi-layer reprojection techniques for augmented reality
US10559276B2 (en) Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
CN109729365A (en) A kind of method for processing video frequency, device and intelligent terminal, storage medium
US20140302930A1 (en) Rendering system, rendering server, control method thereof, program, and recording medium
CN111368137A (en) Video generation method and device, electronic equipment and readable storage medium
CN105389846B (en) A kind of methods of exhibiting of threedimensional model
US12100106B2 (en) Stereoscopic rendering of virtual 3D objects
CN106210856A (en) Internet video live broadcasting platform is watched the method and system of 3D panoramic video
JP7425196B2 (en) hybrid streaming
US10706813B1 (en) Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
US20220277510A1 (en) Latency-Resilient Cloud Rendering
EP3521899A1 (en) Apparatus, system, and method for achieving intraframe image processing in head-mounted displays
EP3522150A2 (en) Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
WO2018086960A1 (en) Method and device for transmitting data representative of an image
US20220139026A1 (en) Latency-Resilient Cloud Rendering
CN107230243A (en) A kind of consistent speed change interpolating method of space-time based on 2 D animation
EP3330839A1 (en) Method and device for adapting an immersive content to the field of view of a user
CN114051089B (en) Method for releasing resources in panoramic video and display equipment
US20220326527A1 (en) Display System Optimization
WO2023000598A1 (en) Frame rate adjustment method and system for augmented reality device, and device and storage medium
CN115861500A (en) Method and device for generating 2D model collision body
CN117992200A (en) Display interface switching method and device and computer readable storage medium
CN116578226A (en) Image processing method, apparatus, device, storage medium, and program product

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160824

RJ01 Rejection of invention patent application after publication