Summary of the invention
Embodiment of the present invention proposes a kind of head-mounted display apparatus, automatically can identify the vision condition of user, makes user clearly can see the display image of head mounted display.
Embodiment of the present invention also proposed a kind of picture adjustment methods being applied to head-mounted display apparatus, automatically can identify the vision condition of user, makes user clearly can see the display image of head mounted display.
The technical scheme of embodiment of the present invention comprises:
A kind of head-mounted display apparatus, comprises vision detection module, image adjustment module and display module, wherein:
Vision detection module, for taking the fundus imaging of user, sends image adjustment order based on captured fundus imaging state to image adjustment module; And in the display properties Dynamic Regulating Process of display module, determine the optimum focusing parameter of the fundus imaging of user;
Image adjustment module, for carrying out dynamic adjustments according to described image adjustment order to the display properties of display module;
Display module, for receiving picture signal, and presents described picture signal based on display properties during described optimum focusing parameter to this user.
Described vision detection module comprises miniature fundus photography unit and image microprocessing unit, wherein:
Miniature fundus photography unit, for taking the fundus imaging of user;
Image microprocessing unit, whether clear for the fundus imaging analyzing this user, if unintelligible, send image adjustment order to image adjustment module; And in the display properties Dynamic Regulating Process of display module, utilize automatic focus mode to determine the optimum focusing parameter of the fundus imaging of user.
Described display module comprises variable lens;
Image adjustment module, for adjusting according to the curvature of described image adjustment order to described variable lens, and/or regulates the number of the variable lens in display module.
Comprise iris identification module further; This iris identification module comprises miniature imaging unit and operation processing unit;
Miniature imaging unit, for taking the iris feature information of user;
Operation processing unit, for preserving the iris feature of user, and carries out matching operation, to identify the identity of user to the iris feature information captured by miniature imaging unit and the client iris feature of preserving.
Display module, is further used for sending vision detected image signal to vision detection module;
Vision detection module, for taking this imaging of vision detected image signal on user optical fundus, and sends image adjustment order based on the image formation state of this vision detected image signal on user optical fundus to image adjustment module.
Image microprocessing unit, for determining the optimum focusing parameter of user's fundus imaging according to grey scale change relation between the pixel of the fundus imaging of this user in the display properties Dynamic Regulating Process of display module, or determine the optimum focusing parameter of user's fundus imaging according to assessment view data power spectrum of this user's fundus imaging in the display properties Dynamic Regulating Process of display module.
Operation processing unit, is further used for the display properties of display module during described optimum focusing parameter to carry out associating with captured client iris characteristic information to preserve;
Iris identification module, is further used for after identifying the identity of this user, and the display properties of display module when corresponding to the optimum focusing parameter of this user is sent to image adjustment module.
Be applied to a picture adjustment methods for head-mounted display apparatus, the method comprises:
The fundus imaging of shooting user, carries out dynamic adjustments based on captured fundus imaging state to the display properties of display module, and determine the optimum focusing parameter of the fundus imaging of user in the display properties Dynamic Regulating Process of display module;
Receive picture signal;
Described picture signal is presented based on the display properties of display module during described optimum focusing parameter.
Describedly based on captured fundus imaging state, dynamic adjustments is carried out to the display properties of display module, and in the display properties Dynamic Regulating Process of display module, determines that the optimum focusing parameter of the fundus imaging of user comprises:
Whether the fundus imaging analyzing this user is clear, if unintelligible, carries out dynamic adjustments to the display properties of display module; And in the display properties adjustment process of display module, utilize automatic focus mode to determine the optimum focusing parameter of the fundus imaging of user.
The method comprises further:
The iris feature information of shooting user;
With the client iris feature of preserving, matching operation is carried out to the iris feature information of shooting, to identify the identity of this user, and the display properties of display module during described optimum focusing parameter is carried out associating with captured client iris characteristic information preserve.
Describedly in the display properties Dynamic Regulating Process of display module, determine that the optimum focusing parameter of the fundus imaging of user comprises:
Determine the optimum focusing parameter of user's fundus imaging according to grey scale change relation between the pixel of the fundus imaging of this user in the display properties Dynamic Regulating Process of display module, or determine the optimum focusing parameter of user's fundus imaging according to assessment view data power spectrum of this user's fundus imaging in the display properties Dynamic Regulating Process of display module.
Display module sends vision detected image signal in advance;
The fundus imaging of described shooting user, carries out dynamic adjustments based on captured fundus imaging state to the display properties of display module and comprises:
Take this imaging of vision detected image signal on user optical fundus, and based on the image formation state of this vision detected image signal on user optical fundus, dynamic adjustments is carried out to the display properties of display module.
As can be seen from technique scheme, in embodiments of the present invention, head-mounted display apparatus comprises vision detection module, image adjustment module and display module, wherein: vision detection module, for taking the fundus imaging of user, send image adjustment order based on captured fundus imaging state to image adjustment module; And in the display properties Dynamic Regulating Process of display module, determine the optimum focusing parameter of the fundus imaging of user; Image adjustment module, for carrying out dynamic adjustments according to described image adjustment order to the display properties of display module; Display module, for receiving picture signal, and presents described picture signal based on display properties during described optimum focusing parameter to this user.As can be seen here, after application embodiment of the present invention, automatically can identify the vision condition of user, make user clearly can see the display image of head mounted display, the self adaptation achieved for user's eyesight status shows.
And, convenience and the ease for use of head-mounted display apparatus can be significantly improved, make different vision level user all can use embodiment of the present invention easily.
In addition, embodiment of the present invention stores the system parameter settings information of user by the mode of iris match cognization, and carry out system initialization according to the system parameter settings information stored, and when user initially uses, display situation can be corrected according to user's vision condition to carry out mating storage system set information with iris, thus without the need to correcting user's vision condition again in follow-up use.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, the present invention is described in further detail.
In embodiments of the present invention, a kind of solution of head mounted display of adaptive user vision is proposed.The program will realize the wearing type glasses formula product adapting to user's vision by eye ground camera technique and Techniques of Automatic Focusing regulation technology.
The present invention proposes a kind of technic relization scheme of novelty, enable the head mounted display of user automatically identify the vision condition of user, make user clearly can see the display image of head mounted display.
Fig. 1 is the head-mounted display apparatus structure chart according to embodiment of the present invention.
As shown in Figure 1, this device comprises vision detection module 101, image adjustment module 102 and display module 103, wherein:
Vision detection module 101, for taking the fundus imaging of user, sends image adjustment order based on captured fundus imaging state to image adjustment module; And in the display properties Dynamic Regulating Process of display module, determine the optimum focusing parameter of the fundus imaging of user;
Image adjustment module 102, for carrying out dynamic adjustments according to described image adjustment order to the display properties of display module;
Display module 103, for receiving picture signal, and presents described picture signal based on display properties during described optimum focusing parameter to this user.
Vision detection module 101 detects the vision state of user by the fundus imaging of shooting user, and sends image adjustment order based on captured fundus imaging state to image adjustment module 102.
The image adjustment order that image adjustment module 102 provides by receiving user's vision detection module 101, by the display properties of dynamic adjustments display module 103, the display image that display module 103 provides is regulated accordingly, display module 103 is shown to user by through adjusted display image, thus enables user see displaying contents clearly.
Particularly, vision detection module 101 can comprise miniature fundus photography unit and image microprocessing unit.
Miniature fundus photography unit, for taking the fundus imaging of user;
Image microprocessing unit, whether clear for the fundus imaging analyzing this user, if unintelligible, send image adjustment order to image adjustment module 102; And in the display properties Dynamic Regulating Process of display module 103, utilize automatic focus mode to determine the optimum focusing parameter of the fundus imaging of user.
The realization of the passive type Techniques of Automatic Focusing at present in camera field is operated with the focal adjustment controlling camera by the definition of software analysis method evaluation image.Typical automatic focus sensor is charge-coupled image sensor (Charge-Coupled Device, CCD), provides data for the contrast for calculating real screen element.The wall scroll pixel strips that CCD is normally made up of 100 or 200 pixels.As long as the light of scene is irradiated to this pixel strips, namely microprocessor checks the value of each pixel, and checks the strength difference between neighbor.If scene is outside focus, then neighbor has closely similar intensity.Microprocessor moving lens, checks that the pixel of CCD is increase or diminish with the strength difference understood between neighbor again.Then, microprocessor can search for the focusing parameter between neighbor with the intensity difference different time, i.e. optimum focusing parameter.
Particularly, first display module 103 presents vision detected image signal to user, and this vision detected image signal of the miniature fundus photography unit photographs then in vision detection module 101 is at the fundus imaging of user.
Whether this image of image microprocessing unit real-time analysis in vision detection module 101 is clear, sends image adjustment order if do not known to image adjustment module 102.Driver element in image adjustment module 102 carries out corresponding adjustment according to this image adjustment order to the display properties of display module 103, thus realizes carrying out dynamic adjustments to the display image definition of display module 103.
In the display properties dynamic adjustment process of display module 103, this vision detected image signal at the definition of the fundus imaging of user also at dynamic conditioning.When image microprocessing unit utilizes self-focusing principle, when searching optimum focusing parameter (this vision detected image signal is when the definition of the fundus imaging of user is the highest), the display properties of display module 103 is also adjusted to the optimum state being suitable for user's viewing by image adjustment module 102 simultaneously, thus achieves the wear-type display of adaptive user vision.
Display module 103 can receive and show image display signal.Display module 103 can comprise left eye display unit and right eye display unit, corresponds respectively to the right and left eyes of user.The picture signal of reception is left eye shows signal and right eye shows signal according to the form dividing processing of agreement by display module 103, and respectively left eye shows signal and right eye shows signal is shown to the right and left eyes of user respectively respectively by left eye display unit and right eye display unit.
In embodiments of the present invention, can, by controlling the nuance of left eye shows signal and right eye shows signal, make user produce the effect at viewing 3 D stereo interface, thus realize 3 D stereo display.
Miniature fundus photography unit in vision detection module 101 can be similar to a computerized optometry system, by launching a branch of specific optical signal to human eye retina, through cornea, crystalline lens, the eyeball organs such as aqueous humor, finally project eyeball retina, then are reflected back in the respective optical system of instrument, received by CCD, and optical signal is converted into the signal of telecommunication.Whether vision detection module 101 can adopt various optometry means clear to the fundus imaging analyzing user.Optometry checks the retrobulbar gathering situation of light, and it for standard, measures the poly-loose difference degree between eye subject and emmetropia with emmetropia state.
Image microprocessing unit in vision detection module 101 analyzes the eye fundus image that CCD receives, specific analytical method is similar to the automatic focus principle in photographic art, whether the eye fundus image received by software algorithm evaluation is clear, as unintelligible, driven the change of the optical texture of display module 103 to carry out feedback regulation by image adjustment unit 102.The image that image ratio exists certain fuzzy quantity clearly has better picture contrast, and algorithm can utilize the grey scale change relation between each pixel carry out analysis chart similarly is noly reach good focusing.Also the power spectrum of view data can be evaluated, piece image present clearly structure and edge time, its autocorrelator trace top is narrow and high, if image blurring, then autocorrelator trace top is wide and low, therefore can by finding the most sharp-pointed state of image autocorrelator trace as the best optics configuration state of system.
Such as: when the eye fundus image that vision detection module 101 receives is evaluated as fuzzy, then display light line structure can be driven to occur slightly to change, then eye fundus image is evaluated, and the fog-level of twice image in contrast front and back.If fog-level increases, then drive the change of display light line structure in the other direction, until find optimal light line structure, and record is carried out to optimal light line structure relevant parameter.
Display module 103 preferably includes variable lens;
Image adjustment module 102, for adjusting according to the curvature of described image adjustment order to described variable lens, and/or regulates the number of the variable lens in display module 103.
Preferably, this device may further include iris identification module.
This iris identification module comprises miniature imaging unit and operation processing unit;
Miniature imaging unit, for taking the iris feature information of user;
Operation processing unit, for preserving the iris feature of user, and carries out matching operation, to identify the identity of user to the iris feature information captured by miniature imaging unit and the client iris feature of preserving.
Iris recognition technology is a kind of human-body biological recognition technology.The outside drawing of eye is made up of sclera, iris, pupil three part.The white portion of sclera and eyeball periphery, accounts for 30% of the gross area; Eye center is pupil portion, accounts for 5%; Iris, between sclera and pupil, contains the abundantest texture information, occupies 65%.Seeing in appearance, be made up of many gland nests, gauffer, pigmented spots etc., is one of structure unique in human body.The formation of iris is determined by gene, and human body gene expresses the form, physiology, color and the total outward appearance that determine iris.People grows by about eight months, and iris is just substantially grown and arrived sufficient size, enters metastable period.Unless the anomalous condition of seldom seeing, health or wound large mentally just may cause outside the change on appearance of iris, iris pattern can keep the few of change of many decades.On the other hand, iris is outside visible, but belongs to interior tissue again simultaneously, is positioned at facies posterior corneae.Change appearance of iris, need very meticulous surgical operation, and VI danger will be emitted.The height of iris is unique, stability and not modifiable feature, is the material base that iris can be used as identity verify.In all biological identification technologies comprising fingerprint, iris identification is that current application is the most convenient and accurate a kind of.
Iris recognition technology is widely regarded as the rising biometrics of 21st century most, the application of following multiple fields such as security protection, national defence, ecommerce, and also inevitable meeting is attached most importance to iris recognition technology.This trend, start gradually to display in the various application of all parts of the world now, market application foreground is boundless.
Iris identification foreign study mechanism mainly contains the company such as Iridian, Iriteck of the U.S. and the Jiris of Korea S.Iridian company grasps iris identification core algorithm, is the maximum professional iris recognition technology in the current whole world and product supplier, it and the enterprise such as LG, Panasonic, OKI, NEC cooperate (as
bM-ET300,
deng product), provide iris identification core algorithm with authorization, support that affiliate produces iris authentication system.The core technology of Iridian also comprises image processing protocol and data standard
identified server
developing instrument and iris recognition camera first-class.
Preferably, operation processing unit, is further used for the display properties of display module during described optimum focusing parameter to carry out associating with captured client iris characteristic information to preserve;
Iris identification module, is further used for after identifying the identity of this user, and the display properties of display module when corresponding to the optimum focusing parameter of this user is sent to image adjustment module.
Fig. 2 is the head-mounted display apparatus operation chart according to embodiment of the present invention.
As shown in Figure 2, user brings this head-mounted display apparatus, opening power, and first iris identification module starts working, and takes the iris feature of user and carries out the matching analysis, to search the related setting information whether having this user.
Suppose that user uses this head-mounted display apparatus for the first time, then system will create new user's operation parameter information automatically, and starts to guide user to carry out the display of self adaptation vision and correct flow process.Now user's vision detection module is started working, miniature fundus photography unit starts Real-time Obtaining fundus imaging information and passes to image microprocessing unit in real time to analyze, image microprocessing unit Harmonious Graph carries out image adjustment in real time as the driver module in adjustment module, when image microprocessing unit finds optimum focusing parameter (namely image is the most clear at user's fundus imaging) by algorithm, regulating system stops, and record the state parameter of now system and the iris feature information of this user, the parameters as this specific user stores.At this moment, user's vision detection module and image adjustment module from service, display module starts normal reception and display image signals.
User upper once use this headset equipment time, iris identification module identifies the iris information of user and recalls its exclusive system default parameter, and the initializing set of system is carried out according to this parameter, then start as user shows image information clearly, thus without the need to correcting user's vision condition again in follow-up use.
This head-mounted display apparatus can provide equipment combined effect with multiple picture signal, realize browsing video signal, these equipment can include, but are not limited to: functional mobile phone, smart mobile phone, palm PC, PC (PC), panel computer or PDA(Personal Digital Assistant), high in the clouds processor, etc.
Although enumerate the instantiation that picture signal provides equipment above in detail, those skilled in the art can recognize, these are enumerated is only purposes of illustration, is not intended to limit the present invention the protection domain of embodiment.
Based on above-mentioned labor, embodiment of the present invention also proposed a kind of picture adjustment methods being applied to head-mounted display apparatus.
Fig. 3 is the picture adjustment methods flow chart being applied to head-mounted display apparatus according to embodiment of the present invention.
As shown in Figure 3, the method comprises:
Step 301: the fundus imaging of shooting user, carries out dynamic adjustments based on captured fundus imaging state to the display properties of display module, and determine the optimum focusing parameter of the fundus imaging of user in the display properties Dynamic Regulating Process of display module.
Here be correct step for the self adaptation vision display of user.User can receive vision detected image signal from display module, then take this imaging of vision detected image signal on user optical fundus, and based on the image formation state of this vision detected image signal on user optical fundus, dynamic adjustments is carried out to the display properties of display module.
Here, whether the fundus imaging can analyzing this user is clear, if unintelligible, carries out dynamic adjustments to the display properties of display module.In the display properties dynamic adjustment process of display module, this vision detected image signal at the definition of the fundus imaging of user also at dynamic conditioning.In the display properties adjustment process of display module, automatic focus mode can be utilized to determine the optimum focusing parameter of the fundus imaging of user.
Particularly, can according in the display properties Dynamic Regulating Process of display module, between the pixel of the fundus imaging of this user, grey scale change relation determines the optimum focusing parameter of user's fundus imaging, or determine the optimum focusing parameter (namely this vision detected image signal is the highest at the definition of the fundus imaging of user) of user's fundus imaging according to assessment view data power spectrum of this user's fundus imaging in the display properties Dynamic Regulating Process of display module, now the display properties of display module is adjusted to the optimum state being suitable for user's viewing, thus achieve the wear-type display of adaptive user vision.
Step 302: receive picture signal.
Here, start to user's normal play picture signal (such as video signal).Display module can receive picture signal from various image signal source.
Step 303: present described picture signal based on the display properties of display module during described optimum focusing parameter.
Display module, from after various image signal source receives picture signal, can present picture signal based on the display properties of the display module when optimum focusing parameter.
The method comprises further:
The iris feature information of shooting user;
With the client iris feature of preserving, matching operation is carried out to the iris feature information of shooting, to identify the identity of this user, and the display properties of display module during described optimum focusing parameter is carried out associating with captured client iris characteristic information preserve.
In fact, can specifically implement by various ways the head-mounted display apparatus that embodiment of the present invention proposes.
In sum, in embodiments of the present invention, head-mounted display apparatus comprises vision detection module, image adjustment module and display module, wherein: vision detection module, for taking the fundus imaging of user, send image adjustment order based on captured fundus imaging state to image adjustment module; And in the display properties Dynamic Regulating Process of display module, determine the optimum focusing parameter of the fundus imaging of user; Image adjustment module, for carrying out dynamic adjustments according to described image adjustment order to the display properties of display module; Display module, for receiving picture signal, and presents described picture signal based on display properties during described optimum focusing parameter to this user.As can be seen here, after application embodiment of the present invention, automatically can identify the vision condition of user, make user clearly can see the display image of head mounted display, the self adaptation achieved for user's eyesight status shows.
And, convenience and the ease for use of head-mounted display apparatus can be significantly improved, make the use of different vision level can use embodiment of the present invention easily per family.
In addition, embodiment of the present invention stores the system parameter settings information of user by the mode of iris match cognization, and carry out system initialization according to the system parameter settings information stored, and when user initially uses, display situation can be corrected according to user's vision condition to carry out mating storage system set information with iris, thus without the need to correcting user's vision condition again in follow-up use.
The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.