JPH0938038A - Sight line detection device and optical instrument therewith - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable to more correctly estimate a pupil diameter and to correctly eliminate unnecessary detection data by calculating an eyeball signal obtained by a light receiving means based on a prescribed estimated pupil diameter. SOLUTION: A CPU 100 reads out a signal in a light measuring center 10 to measure the quantity of incoming light to a finder optical system and estimates a pupil diameter by reading out pupil diameter information of an user corresponding to a measured light value of the finder optical system from an EEPROM 100a. The CPU 100 transmits a signal to a sight line detection circuit 101 to store CCD 14 for a prescribed time and to output the signal and reads out the pupil diameter information of the user corresponding to the light output value of an image sensor (CCD 14) from the EEPROM 100 to estimate the pupil diameter. One pupil diameter estimated based on the light quantity incoming to the finder optical system and the other pupil diameter estimated based on the anterior brightness of a user are compared and the smaller pupil diameter is to be the prescribed value.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a line-of-sight detection device for detecting line-of-sight information of a user or a subject, and more particularly to a line-of-sight detection device that enables accurate line-of-sight detection by utilizing brightness information.

[0002]

2. Description of the Related Art Conventionally, a camera is commercially available which detects the line of sight of a user or a subject looking through a finder and controls functions such as automatic focusing of a photographing lens based on the line-of-sight information.

In this type of camera, the line-of-sight information of the photographer is detected from the deviation between the position of the corneal reflection image due to the illumination light that illuminates the eyeball of the photographer and the center position of the pupil. A method of detecting line-of-sight information is disclosed in JP-A-2-264633.

According to Japanese Patent Laid-Open No. 2-264633,
The center position of the pupil is obtained by detecting the boundary between the pupil and the iris, but in reality, the position where the light intensity difference is large is detected as the boundary between the pupil and the iris.
Therefore, the boundary between the eyelid and the eyeball, the boundary between the sclera and the iris,
Alternatively, there is a case where there is a large difference in light intensity even in a portion with eyelashes, and a false boundary may be detected.

Therefore, the applicant of the present application has filed Japanese Patent Application Laid-Open No. 2-6583.
No. 6 discloses a method of efficiently extracting the boundary between the pupil and the iris by estimating the pupil diameter of the user or the subject from the brightness of external light, eliminating the detection data largely deviated from the pupil diameter. are doing.

Further, the applicant of the present application has filed Japanese Patent Application Laid-Open No. 6-1485.
Japanese Patent Laid-Open No. 07-2007 discloses a method of eliminating false detection data by presetting the pupil diameter of the eyeball of the user or the subject and setting the range where the boundary between the pupil and the iris on the sensor exists.

[0007]

However, as disclosed in Japanese Patent Application Laid-Open No. 2-65836, the pupil diameter of the user or the subject looking through the finder can be estimated by the brightness of external light. Since the pupil diameter does not take into consideration the imaging magnification of the eyeball image, there is a drawback in that it is not possible to accurately estimate the actual size of the pupil on the light receiving sensor.

Further, when the pupil diameter of the user or the subject is estimated by the amount of light incident on the finder, when observing, for example, a bright outdoors from a dark room, the user or Since the pupil of the subject's eye becomes smaller due to the surrounding brightness, the estimated pupil diameter becomes larger than the actual pupil diameter, and unnecessary detection data cannot be accurately excluded, and the pupil-iris boundary is reduced. Sometimes could not be detected accurately.

[0009]

According to the invention described in claim 1 of the present application, the photometric means for substantially measuring the amount of light incident on the eyeball of the user or the subject and the image of the eye of the user or the subject are provided. In a visual axis detection device having a light receiving means for receiving light and an arithmetic processing means for arithmetically processing eyeball image signals obtained by the light receiving means to obtain visual axis information of a user or a subject, estimation based on the output of the photometric means Estimated pupil for setting the estimated pupil diameter of the user's or subject's eye using at least one of the pupil diameter of the user or the subject and the pupil diameter of the user or subject estimated based on the output of the light receiving means. A diameter setting means is provided, and the arithmetic processing means arithmetically processes the eyeball image signal obtained by the light receiving means based on the set estimated pupil diameter, thereby estimating the pupil diameter more accurately. Since it is Rukoto, it is possible to accurately eliminate an unnecessary detection data in detecting a boundary between the pupil and iris.

Further, in the visual line detecting device according to the invention described in claim 5 of the present application, a light receiving means having a light receiving surface for receiving the eyeball image of the user or the subject, and substantially incident on the eyeball of the user or the subject. A photometric means for measuring the amount of light to be emitted,
A pupil diameter estimating means for estimating a pupil diameter of the user or the subject based on the output of the photometric means, and a distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, From the pupil diameter of the user or the subject estimated by the pupil diameter estimating means and the distance information obtained by the distance information detecting means, the pupil diameter of the user or subject forming an image on the light receiving surface of the light receiving means is calculated. Based on the pupil diameter calculation means and the calculation result of the pupil diameter calculation means,
And an arithmetic processing unit that obtains the line-of-sight information of the user or the subject by performing arithmetic processing on the eyeball image information obtained by the light receiving unit. With such a configuration, an image is formed on the light receiving surface of the light receiving unit. Since it is possible to obtain the pupil diameter that can be calculated and to estimate the pupil diameter more accurately, it becomes possible to accurately exclude unnecessary detection data when detecting the boundary between the pupil and the iris.

[0011]

1 to 5 show an embodiment of the present invention, and FIG. 1 is a schematic view of a main part of a single-lens reflex camera which is an optical device with a visual axis detection device.

In the figure, reference numeral 1 denotes a taking lens, which is illustrated as two lenses 1a and 1b for convenience, but is actually composed of a large number of lenses. Reference numeral 2 denotes a main mirror which is inclined or retreated to a photographing optical path according to an observation state and a photographing state. A sub-mirror 3 reflects a light beam transmitted through the main mirror 2 toward the lower side of the camera body. Reference numeral 4 is a shutter, and 5 is a photosensitive member, which is composed of a silver salt film, a CCD or MOS type solid-state image pickup element, or an image pickup tube such as a vidicon.

Reference numeral 6 denotes a focus detection device, which is a field lens 6a and reflection mirrors 6b and 6 arranged near the image plane.
The well-known phase difference method, which includes a secondary imaging lens 6d, a diaphragm 6e, a line sensor 6f including a plurality of CCDs, and the like, is used. The focus detection device 6 in FIG. 1 is configured to be able to detect a focus in a plurality of regions in an observation screen.

Reference numeral 7 is a focusing plate arranged on the planned image forming surface of the taking lens 1, 8 is a penta roof prism which is a finder optical path changing means, and 9 and 10 are image forming lenses for measuring the brightness of an object in the observation screen. In the photometric sensor, the imaging lens 9 conjugately connects the focusing plate 7 and the photometric sensor 10 via the reflected light path in the penta roof prism 8.

Next, behind the exit surface of the penta roof prism 8, a dichroic mirror 16 which is a light splitting means and an eyepiece lens 11 are arranged, and the focusing plate 7 by the eye 15 of the photographer.
Used to observe. The dichroic mirror 16, which is a light splitting means, has a characteristic of transmitting visible light and reflecting infrared light. Reference numeral 12 is a light-receiving lens, and 14 is an image sensor in which photoelectric element arrays such as CCDs are two-dimensionally arranged so as to be conjugated with the vicinity of the iris of the photographer's eye 15 at a predetermined position with respect to the light-receiving lens 12. .

Reference numerals 13a to 13d denote infrared light emitting diodes (IREDs), which are illumination light sources for the eyes 15 of the photographer.
And is disposed below the eyepiece lens 11.

Reference numeral 31 denotes an aperture provided in the taking lens 1, 32
Is an aperture drive device including the aperture drive circuit 107, 33 is a lens drive motor, 34 is a lens drive member including a drive gear, and 35 is a photocoupler that detects the rotation of the pulse plate 36 interlocked with the lens drive member 34. It is transmitted to the lens drive circuit 110. The lens driving circuit 110 drives the lens driving motor by a predetermined amount based on this information and the information on the lens driving amount from the camera side to move the focusing lens 1a of the taking lens 1 to the focusing position. A mount contact 37 serves as an interface between a known camera and lens.

FIG. 2 is a block diagram of an essential part of an electric circuit built in the main body of the camera embodying the present invention. In the figure, the same parts as those in FIG. 1 are designated by the same reference numerals. A central processing unit (hereinafter, CPU) 100 of a microcomputer built in the camera body includes a visual axis detection circuit 101, a photometric circuit 102, a focus detection circuit 103, and a signal input circuit 10.
4, aperture drive circuit 107, shutter control circuit 108,
The lens drive circuit 110 is connected. Further, signals are transmitted between the diaphragm drive circuit 107 and the lens drive circuit 110 arranged in the photographing lens via the mount contact 37 shown in FIG.

The CPU 100 has an EEP as a storage means.
A ROM 100a is attached.

The line-of-sight detection circuit 101 includes IRED 13a-
13 d is turned on to illuminate the eyeball 15 of the photographer, the output of the eyeball image from the image sensor 14 is A / D converted, and this image information is transmitted to the CPU 100. The CPU 100 image-processes the eyeball image to extract the boundary between the corneal reflection image, the iris, and the pupil, and further calculates the line-of-sight information of the photographer from the deviation between the corneal reflection image and the central position of the pupil.

The photometric circuit 102, after amplifying the output from the photometric sensor 10, performs logarithmic compression and A / D conversion, and sends it to the CPU 100 as brightness information of each sensor.

The line sensor 6f is a known CCD line sensor corresponding to a plurality of focus detection areas on the screen. The focus detection circuit 103 A / D converts the voltage obtained from these line sensors 6f and sends it to the CPU 100.

The signal input circuit 104 has a first stroke (switch SW-) of a shutter release button (not shown).
The signal input of 1) and the second stroke (switch SW-2) is detected and the signal is transmitted to the CPU 100.

The diaphragm driving circuit 107 controls the diaphragm driving device 32 so that the diaphragm 31 of the taking lens 1 has a predetermined size.

When the shutter control circuit 108 is energized, the shutter curtain runs and exposes the photosensitive member with a predetermined amount of light.

Here, the visual axis detection device of the present invention comprises the IREDs 13a to 13d constituting the illumination means, the visual axis detection circuit 101 for driving the IRED, the eyepiece lens 11 constituting the light receiving means, the dichroic mirror 16, the light receiving lens 12, the image sensor. 14, a line-of-sight detection circuit 101 for controlling the image sensor 14, a line-of-sight detection circuit 101 and a CPU 100 that form an arithmetic processing unit, and an EEPR that is a storage unit.
The OM 100a, the imaging lens 9 that constitutes the photometric means, the photometric sensor 10, and the photometric circuit 102 that controls the photometric sensor.
It is composed of

Next, FIG. 3 shows a flowchart of the operation of the camera, which is an optical device equipped with the visual axis detection device. The camera of the present invention can select the focus detection area and weight the photometric value using the line-of-sight information of the user or the subject.

When the photographer activates the camera, the CPU 1
00 confirms the setting state of a mode selection switch (not shown) for setting the operating state of the visual axis detection device via the signal input circuit 104 (# 100).

If the mode selection switch is set to the sight line calibration mode (# 100), the CPU
100 executes calibration of the line of sight for matching the line of sight of the photographer with the gaze target (# 101). Regarding the sight line calibration method, see Japanese Patent Laid-Open No. 6-86.
Since it is described in detail in Japanese Patent No. 759, the description is omitted here.

If the mode selection switch is set to the normal photographing mode, the CPU 100 recognizes that it is not set to the mode for performing the sight line calibration (CAL mode) (# 100), and further inputs the signal. The state of the first stroke of the shutter release button and the switch SW-1 is confirmed via the circuit 104 (# 10).
2). If the switch SW-1 is in the OFF state, the CPU
100 stands by until switch SW-1 is turned on (# 102).

When the switch SW-1 is turned on by the photographer (# 102), the CPU 100 confirms the setting state of the previously detected mode selection switch (# 103) and controls without using the line-of-sight information of the photographer. If the mode for controlling the means is not set, the CPU 100 is the storage means E
Calibration data of the line of sight of the photographer is read from the EPROM 100a (# 105).

Further, the CPU 100 has a line-of-sight detection circuit 10
A signal is sent to 1 to illuminate the eyeball 15 of the photographer with the IRED 13, and the reflected light is imaged with the image sensor 14 via the eyepiece lens 11, the dichroic mirror 16, and the light receiving lens 12. The CPU 100 is a visual axis detection circuit 1
The eyeball image obtained from the image sensor 14 is processed through 01 to extract the corneal reflection image and the boundary between the iris and the pupil,
The line-of-sight information of the photographer is calculated from the deviation between the corneal reflection image and the center position of the pupil (# 106). The flow of calculating the line-of-sight information will be described later.

Further, the CPU 100 calculates the gazing point on the focus plate 7 based on the detected sight line information of the photographer and the sight line calibration data (# 107).

If the mode in which the photographer's line-of-sight information is used to control the automatic focus adjustment means is set, the CPU
100 selects the closest focus detection area from the gazing point coordinates (# 109).

Subsequently, the CPU 100 is the focus detection circuit 10
Then, a signal is transmitted to No. 3 to perform focus detection of the focus detection area selected based on the line-of-sight information of the photographer (# 110).
If the focus state of the selected focus detection area is not in focus (# 111), the CPU 100 causes the lens drive circuit 110
Then, a focus adjustment signal is transmitted to drive the photographic lens 1 lens (# 120). When the lens drive corresponding to the focus adjustment signal is executed (# 120), focus detection is executed again (# 120).
121).

If the focus state of the selected focus detection area is in focus (# 111), focus display is performed in the viewfinder (# 112). Since the in-focus display is performed within the field of view of the finder, the photographer can recognize that the taking lens is in focus in a desired focus detection area.

If the mode in which the photographer's line-of-sight information is used to determine the exposure value is set (# 113), the CPU
100 transmits a signal to the photometry circuit 102 to perform photometry. At this time, the exposure value is determined by weighting the photometric values of the divided areas in the shooting screen based on the line-of-sight information of the photographer (# 114).

If the switch SW-1 is continuously turned on (# 115), the state of the switch SW-2 of the shutter release button is confirmed (# 116). If the switch SW-2 is in the OFF state (# 116), the state of the switch SW-1 is confirmed again (# 115). If the switch SW-1 is in the OFF state (# 115), it returns to the initial state.

If the switch SW-2 is turned on (# 116), the CPU 100 sends a signal to the diaphragm drive circuit 107 to set the diaphragm 31 to a predetermined aperture, and also sends a signal to the shutter control circuit 108. The image is transmitted and the shutter curtain is run to take an image (# 117).

When the shutter release operation of the camera is completed (# 117), the initial state is restored.

On the other hand, when the switch SW-1 is turned on by the photographer (# 102), the CPU 100 confirms the setting state of the previously detected mode selection switch, and controls the control means using the line-of-sight information of the photographer. If it is not set to the mode to be controlled, the control means is controlled independently (# 10
3).

The CPU 100 sends a signal to the focus detection circuit 103 to detect the focus of all the focus detection areas (# 118). Further, the CPU 100 compares the focus detection information of all the detected focus detection areas, and determines the focus detection area having the shortest subject distance as the area for performing focus adjustment of the photographing lens (# 119).

If the determined focus detection area is in focus (# 111), focus display is performed (# 112).

The exposure value is also determined without using the line-of-sight information of the photographer (# 113). CPU 100 is a photometric circuit 1
A signal is transmitted to 02 to perform photometry. At this time, the exposure value is determined by performing evaluation so that the area where the main subject is supposed to be present has an appropriate exposure amount (# 123).

If the switch SW-1 is continuously turned on (# 115), the state of the switch SW-2 of the shutter release button is confirmed (# 116). If the switch SW-2 is in the OFF state (# 116), the state of the switch SW-1 is confirmed again (# 115). If the switch SW-1 is in the OFF state (# 115), it returns to the initial state.

When the switch SW-2 is turned on (# 116), the CPU 100 sends a signal to the diaphragm drive circuit 107 to set the diaphragm 31 to a predetermined aperture and to send a signal to the shutter control circuit 108. The image is transmitted and the shutter curtain is run to take an image (# 117).

When the shutter release operation of the camera is completed (# 117), the initial state is restored.

FIG. 4 is a flow of calculation of line-of-sight information, which will be described below with reference to FIG.

When execution of line-of-sight detection is instructed (# 10
6), the CPU 100 sends a signal to the photometric circuit 102 which is the photometric means to read the signal of the photometric sensor 10 and measure the amount of light incident on the finder optical system (# 1).
30). The EEPROM 100a, which is a storage means, stores information on the pupil diameter of the user or the subject with respect to the photometric value of the finder optical system.
The pupil diameter information of the user or the subject corresponding to the photometric value of the finder optical system measured from the EPROM 100a is read and estimated as the pupil diameter r1 (# 131). At this time, if the photometric value of the finder optical system is bright, the pupil diameter r
1 is a small value, and if the photometric value of the finder optical system is dark, the pupil diameter r1 is a large value.

Further, the CPU 100 transmits a signal to the line-of-sight detection circuit 101 which is a light receiving means to accumulate the CCD 14 which is an image sensor for a predetermined time and outputs the signal (# 132). Since the EEPROM 100a serving as a storage unit stores the pupil diameter information of the user or the subject with respect to the output of the image sensor 14, the CPU 100
Reads the pupil diameter information of the user or the subject corresponding to the light output value of the image sensor 14 measured from the EEPROM 100a and estimates it as the pupil diameter r2 (# 13).
3). At this time, if the anterior segment of the user or the subject is bright, the pupil diameter r2 is small, and if the anterior segment of the user or the subject is dark, the pupil size r2 is large.
When the brightness of the anterior ocular segment of the user or the subject is measured using the light receiving unit, it is desirable that the illumination unit does not illuminate the eyeball of the user or the subject.

The CPU 100 compares the pupil diameter r1 estimated on the basis of the amount of light incident on the finder optical system with the pupil diameter r2 estimated on the basis of the brightness of the anterior segment of the user or the subject. The smaller pupil diameter is set as the final set value (# 134). For example, if the user or subject is observing from dark indoors to bright outdoors,
Since r1 <r2, the pupil diameter is set to r1.
Conversely, when observing a dark room or the like from bright outdoors under sunlight, r1> r2, so the pupil diameter is set to r2. In this way, the estimated pupil diameter can be brought closer to the actual pupil diameter by making the smaller pupil diameter the final set value. Therefore, unnecessary data can be accurately excluded in any case.

When the pupil diameter of the user or subject is set based on the amount of light incident on the finder optical system and the brightness of the anterior segment of the user or subject (# 134), the CPU
100 transmits a signal to a visual axis detection circuit 101 which is an illuminating means to illuminate an eyeball of a user or a subject by an IRED 13 and receives reflected light from the eyeball by an image sensor 14 which is a light receiving means (# 135). . C
The PU 100 performs A / D conversion of the eyeball image captured by the image sensor 14 through the line-of-sight detection circuit 101 to perform image processing, and extracts the corneal reflection image and the boundary between the pupil and the iris (# 136).

FIG. 5 shows the eyeball image of the user or the subject formed on the image sensor 14 and the image processing result. In the figure, two black circles (•) are corneal reflection images. The corneal reflection image is detected almost accurately because the light intensity is strong. In addition, the marks X and □ in the figure are the ones extracted as the boundary between the pupil and the iris due to the large difference in light intensity.

Further, the CPU 100 obtains the distance of the user's or subject's eye to the light receiving means from the interval between the two corneal reflection images, and calculates the imaging magnification β of the user's or subject's eye from the distance (# 137). . The imaging magnification β is, assuming that the interval between two corneal reflection images is ΔP,

[0055]

[Outside 1] It is expressed as However, a, b, c and d are constants determined by the setting states of the illumination means and the light receiving means.

The size of the pupil on the image sensor 14 is obtained from the previously set pupil diameter r of the user's or subject's eye and the imaging magnification β of the user's or subject's eye. Furthermore, the position of the two corneal reflection images and the image sensor 14
The existence range of the pupil is set based on the size of the pupil above (# 138). In the eyeball image shown in FIG. 5, the dotted line shows the range of existence of the pupil.

The CPU 100 eliminates false extraction data regarding the boundary between the pupil and the iris based on the range of existence of the pupil (# 139). At this time, in FIG. 5, the data extracted at the boundary between the eyelid and the eyeball indicated by X and the data extracted at the boundary between the sclera and the iris are excluded. Furthermore C
The PU 100 calculates the center position of the pupil based on the remaining data (data indicated by □ in FIG. 5) extracted as the boundary between the pupil and the iris (# 140).

When the center position of the pupil is obtained, the rotation angle of the user's or subject's eye is calculated from the difference in position from the corneal reflection image (# 141).

In the present embodiment, it goes without saying that the setting of the existence range of the pupil based on the diameter of the pupil is set somewhat larger in consideration of the rotation of the eye of the user or the subject.

In this embodiment, the method of excluding the false extraction data by setting the existence range of the pupil after extracting the corneal reflection image and the boundary between the pupil and the iris has been exemplified. First, the corneal reflection image is extracted. Then, after setting the existence range of the pupil, the boundary between the pupil and the iris may be extracted.

[0061]

As described above, according to the invention described in claim 1 of the present application, the photometric means that substantially measures the amount of light incident on the eyeball of the user or the subject, and the eye of the user or the subject. In a visual axis detection device having a light receiving means for receiving an image, and an arithmetic processing means for arithmetically processing an eyeball image signal obtained by the light receiving means to obtain visual line information of a user or a subject, based on the output of the photometric means. The estimated pupil diameter of the eye of the user or the subject using at least one of the pupil diameter of the user or the subject estimated based on the output of the light receiving means and the pupil diameter of the user or the subject estimated by It has a pupil diameter setting means for setting, and the arithmetic processing means can estimate the pupil diameter more accurately by arithmetically processing the eyeball image signal based on the set estimated pupil diameter. That. Therefore, it becomes possible to more accurately eliminate unnecessary detection data when detecting the boundary between the pupil and the iris, and the pupil shape can be detected accurately in a short time. Higher accuracy can be achieved.

Further, the line-of-sight detection apparatus according to the invention described in claim 5 of the present application has a light-receiving means having a light-receiving surface for receiving an eyeball image of the user or the subject, and substantially incident on the eyeball of the user or the subject. A photometric means for measuring the amount of light to be emitted,
A pupil diameter estimating means for estimating a pupil diameter of the user or the subject based on the output of the photometric means, and a distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, From the pupil diameter of the user or the subject estimated by the pupil diameter estimating means and the distance information obtained by the distance information detecting means, the pupil diameter of the user or subject forming an image on the light receiving surface of the light receiving means is calculated. Based on the pupil diameter calculation means and the calculation result of the pupil diameter calculation means,
Estimating on the light-receiving surface of the light-receiving means by such a configuration, characterized by having an arithmetic processing means for calculating the line-of-sight information of the user or the subject by arithmetically processing the eyeball image information obtained by the light-receiving means. The pupil diameter can be obtained, and the pupil diameter can be estimated more accurately. Therefore, it becomes possible to more accurately eliminate unnecessary detection data when detecting the boundary between the pupil and the iris, and the pupil shape can be detected accurately in a short time. Higher accuracy can be achieved.

[Brief description of drawings]

FIG. 1 is a schematic view of a main part of a single lens reflex camera.

FIG. 2 is a block diagram of an electric circuit of the camera.

FIG. 3 is an operation flow explanatory diagram of the camera.

FIG. 4 is an explanatory diagram of a gaze calculation flow.

FIG. 5 is an explanatory diagram of an eyeball image.

[Explanation of symbols]

 1 Photographic Lens 2 Main Mirror 3 Sub Mirror 4 Shutter 5 Film 6 Focus Detection Device 7 Focus Plate 8 Penta-Dach Prism 9 Imaging Lens 10 Photometric Sensor 11 Eyepiece 12 Photoreceptive Lens 13 Infrared Light Emitting Diode 14 CCD 15 Eyeball 32 Aperture Drive 100 CPU 101 Line-of-sight detection circuit 102 Photometric circuit 103 Focus detection circuit 104 Signal input circuit 107 Aperture drive circuit 108 Shutter control circuit 110 Lens drive circuit

Claims (14)

[Claims] 1. A photometric means for photometrically measuring the amount of light incident on an eyeball of a user or a subject, a light receiving means for receiving an image of the eye of the user or a subject, and an eyeball image signal obtained by the light receiving means. In a line-of-sight detection device having an arithmetic processing unit for performing arithmetic processing to obtain user's or subject's line-of-sight information, based on the user's or subject's pupil diameter estimated based on the output of the photometric unit, and the output of the light receiving unit. Has an estimated pupil diameter setting means for setting an estimated pupil diameter of the user's or subject's eye by using at least one of the estimated pupil diameters of the user or the subject, and the arithmetic processing means has the set estimation. A line-of-sight detection device, which calculates an eyeball image signal obtained by the light-receiving means based on a pupil diameter. 2. The estimated pupil diameter setting means compares the pupil diameter of the user or the subject estimated based on the output of the photometric means with the pupil diameter of the user or the subject estimated based on the output of the light receiving means. The visual axis detection device according to claim 1, wherein a smaller pupil diameter is set as the estimated pupil diameter. 3. A photometric means for photometrically measuring the amount of light incident on the eyeball of the user or the subject, and a first for estimating the pupil diameter of the user or the subject based on the output of the photometric means.
A pupil diameter estimating means, a light receiving means for receiving an eyeball image of the user or the subject, and a second pupil diameter estimating means for estimating the pupil diameter of the user or the subject based on the output of the light receiving means. Setting means for setting the estimated pupil diameter of the user or the subject by using at least one of the estimation result of the first pupil diameter estimating means and the estimation result of the second pupil diameter estimating means; A line-of-sight including a calculation processing unit for calculating the line-of-sight information of the user or the subject by calculating the eyeball image information obtained by the light-receiving unit based on the estimated pupil diameter set by the setting unit. Detection device. 4. The setting means compares the estimation result of the first pupil diameter estimating means with the estimation result of the second pupil diameter estimating means, and sets a smaller pupil diameter as the estimated pupil diameter. The line-of-sight detection device according to claim 3. 5. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, a light measuring means for substantially measuring the amount of light incident on the eyeball of the user or the subject, and an output of the light measuring means. A pupil diameter estimating means for estimating the pupil diameter of the user or the subject based on the distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, and the pupil diameter estimating means. A pupil diameter calculating means for calculating the pupil diameter of the user or the subject imaged on the light receiving surface of the light receiving means from the estimated pupil diameter of the user or the subject and the distance information obtained by the distance information detecting means; And a calculation processing unit for calculating the eye-gaze information of the user or the subject by calculating the eyeball image information obtained by the light receiving unit based on the calculation result of the pupil diameter calculation unit. Line-of-sight detection device. 6. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, a pupil diameter estimating means for estimating a pupil diameter of the user or the subject based on an output of the light receiving means, Distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, and the pupil diameter of the user or subject estimated by the pupil diameter estimating means and the distance information detecting means A pupil diameter calculating means for calculating the pupil diameter of the user or the subject to be imaged on the light receiving surface of the light receiving means from the distance information, and an eyeball obtained by the light receiving means on the basis of the calculation result of the pupil diameter calculating means. A line-of-sight detection apparatus, comprising: an arithmetic processing unit that obtains line-of-sight information of a user or a subject by arithmetically processing image information. 7. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, and a distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means. Light measuring means for photometrically measuring the amount of light incident on the eyeball of the user or subject, first pupil diameter estimating means for estimating the pupil diameter of the user or subject based on the output of the light measuring means, and the light receiving means. At least the second pupil diameter estimating means for estimating the pupil diameter of the user or the subject based on the output of, the estimation result of the first pupil diameter estimating means, and the estimation result of the second pupil diameter estimating means. Estimated pupil diameter setting means for setting the estimated pupil diameter of the user or subject using either one, and the use for forming an image on the light receiving surface of the light receiving means based on the distance information and the estimated pupil diameter Person or subject's pupil diameter A pupil diameter calculating means for calculating and eyeball image information obtained by the light receiving means are calculated on the basis of the output of the pupil diameter calculating means to obtain the line-of-sight information of the user or the subject. Eye gaze detection device. 8. The distance information detecting means has an illuminating means for illuminating an eyeball of a user or a subject with a pair of parallel light beams, and a pair of reflected images of the illuminating means generated in an eyeball image received by the light receiving means. 6. The distance information between the eyeball of the user or the subject and the light receiving means is obtained.
The visual line detection device according to 6 or 7. 9. The pupil diameter computing means obtains an imaging magnification of an eyeball of the user or the subject who forms an image on the light receiving surface of the light receiving means from the distance information, and forms an image on the light receiving surface of the light receiving means. 9. The visual line detection device according to claim 8, wherein the pupil diameter of the eyeball is calculated. 10. A photometric means for photometrically measuring the amount of light incident on the eyeball of the user or the subject, a light receiving means for receiving the image of the eye of the user or the subject, and an eyeball image signal obtained by the light receiving means. In a line-of-sight detection device having an arithmetic processing unit for performing arithmetic processing to obtain user's or subject's line-of-sight information, based on the user's or subject's pupil diameter estimated based on the output of the photometric unit, and the output of the light receiving unit. Has an estimated pupil diameter setting means for setting an estimated pupil diameter of the user's or subject's eye by using at least one of the estimated pupil diameters of the user or the subject, and the arithmetic processing means has the set estimation. An optical apparatus having a line-of-sight detection device, which calculates an eyeball image signal obtained by the light-receiving means based on a pupil diameter. 11. A first pupil diameter estimation for estimating a pupil diameter of the user or the subject based on an output of the photometry means, which substantially measures the amount of light incident on the eyeball of the user or the subject. Means, light receiving means for receiving an eyeball image of the user or subject, second pupil diameter estimating means for estimating a pupil diameter of the user or subject based on an output of the light receiving means, and the first The estimation result of the pupil diameter estimation means and the second
Setting means for setting the estimated pupil diameter of the user or the subject using at least one of the estimation result of the pupil diameter estimation means, and the estimated pupil diameter set by the setting means, An optical device having a line-of-sight detection device, which comprises an arithmetic processing unit for performing arithmetic processing on eyeball image information obtained by the light-receiving unit to obtain visual line information of a user or a subject. 12. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, a light measuring means for substantially measuring the amount of light incident on the eyeball of the user or the subject, and an output of the light measuring means. A pupil diameter estimating means for estimating the pupil diameter of the user or the subject based on the distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, and the pupil diameter estimating means. A pupil diameter calculating means for calculating the pupil diameter of the user or the subject imaged on the light receiving surface of the light receiving means from the estimated pupil diameter of the user or the subject and the distance information obtained by the distance information detecting means; And a calculation processing unit for calculating the eye-gaze information of the user or the subject by calculating the eyeball image information obtained by the light receiving unit based on the calculation result of the pupil diameter calculation unit. An optical device having a characteristic line-of-sight detection device. 13. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, a pupil diameter estimating means for estimating a pupil diameter of the user or the subject based on an output of the light receiving means, Distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means, and the pupil diameter of the user or subject estimated by the pupil diameter estimating means and the distance information detecting means A pupil diameter calculating means for calculating the pupil diameter of the user or the subject to be imaged on the light receiving surface of the light receiving means from the distance information, and an eyeball obtained by the light receiving means on the basis of the calculation result of the pupil diameter calculating means. An optical device having a line-of-sight detection device, which has an arithmetic processing unit that obtains line-of-sight information of a user or a subject by arithmetically processing image information. 14. A light receiving means having a light receiving surface for receiving an eyeball image of the user or the subject, and a distance information detecting means for obtaining distance information between the eyeball of the user or the subject and the light receiving surface of the light receiving means. First, a photometric means for photometrically measuring the amount of light incident on the eyeball of the user or the subject, and a pupil diameter of the user or the subject being estimated based on the output of the photometric means.
Pupil diameter estimating means, second pupil diameter estimating means for estimating the pupil diameter of the user or subject based on the output of the light receiving means, the estimation result of the first pupil diameter estimating means, and the second pupil diameter estimating means. Estimated pupil diameter setting means for setting the estimated pupil diameter of the user or the subject by using at least one of the estimation results of the pupil diameter estimation means, and the light receiving based on the distance information and the estimated pupil diameter. And a pupil diameter calculation means for calculating the pupil diameter of the user or the subject who forms an image on the light receiving surface of the means, and eyeball image information obtained by the light receiving means is calculated and used based on the output of the pupil diameter calculation means. An optical device having a line-of-sight detection device, comprising: an arithmetic processing unit for obtaining line-of-sight information of a person or a subject.