CN112526801B

CN112526801B - Double-lens imaging module and extraction method thereof

Info

Publication number: CN112526801B
Application number: CN201910827078.3A
Authority: CN
Inventors: 陈昱翰; 张忠翔; 黄弘凯
Original assignee: HTC Corp
Current assignee: HTC Corp
Priority date: 2019-09-03
Filing date: 2019-09-03
Publication date: 2022-01-25
Anticipated expiration: 2039-09-03
Also published as: CN112526801A

Abstract

The invention discloses a double-lens imaging module and an extraction method thereof, wherein the double-lens imaging module is suitable for an electronic device. The double-lens imaging module comprises a first lens, a second lens and a moving module. The moving module is connected to the second lens and is suitable for moving or inclining the second lens, wherein the first lens is a lens with an automatic focusing function, and the working distance of the double-lens imaging module is suitable for changing according to the distance between the first lens and the second lens.

Description

Double-lens imaging module and extraction method thereof

Technical Field

The present invention relates to an optical imaging module and an extraction method thereof, and more particularly, to a dual lens imaging module and an extraction method thereof.

Background

In recent years, with the continuous progress of display technology, the demands of viewers on the display quality (such as image resolution, color saturation, etc.) of the display are also increasing. However, in addition to high image resolution and high color saturation, it is becoming one of the purchasing considerations for viewers to determine whether a display is capable of displaying stereoscopic images. However, in current mobile phones, tablet or head-mounted displays, the working distance for lens imaging or photography is often limited due to the size limitation of the device.

In addition, many image information can be displayed as stereoscopic images with depth information. However, in the current technology, it is impossible to perform stereoscopic imaging or stereoscopic photography by a simple means and perform depth sensing simultaneously to obtain depth information and optimize the stereoscopic image display effect.

Disclosure of Invention

The invention provides a double-lens imaging module which can improve the range of the working distance and enable three-dimensional imaging to obtain a good display effect.

The invention provides a double-lens imaging module which is suitable for an electronic device and comprises a first lens, a second lens and a moving module. The moving module is connected to the second lens and is suitable for moving or inclining the second lens, wherein the first lens is a lens with an automatic focusing function, and the working distance of the double-lens imaging module is suitable for changing according to the distance between the first lens and the second lens.

In an embodiment of the invention, the dual lens imaging module further includes a transparent substrate configured to cover the first lens and the second lens.

In an embodiment of the invention, a surface of the transparent substrate is aligned with a surface of an exterior of the electronic device.

In an embodiment of the invention, the dual-lens imaging module further includes an optical element detachably disposed on the transparent substrate. The second lens is adapted to be moved onto an effective optical path of the optical element by the moving module.

In an embodiment of the invention, the optical element is at least one lens with diopter, a neutral gray filter, a color filter or a polarizer.

In an embodiment of the invention, the moving module includes a driving element and a carrying element. The driving element is connected to the carrying element, and the second lens is arranged on the carrying element. The driving element is suitable for driving the carrying element to move or incline the second lens.

In an embodiment of the invention, the moving module is a linear motor driving module, a voice coil motor driving module, a shape memory alloy component, a piezoelectric material module, or a hall sensor.

In an embodiment of the invention, the moving module includes a first moving module and a second moving module. The first moving module and the second moving module are respectively connected to the first lens and the second lens. The first moving module is suitable for moving or tilting the first lens, and the second moving module is suitable for moving or tilting the second lens.

In an embodiment of the invention, the dual-lens imaging module further includes a depth recognition module disposed on the first lens. The depth recognition module comprises a first aperture, a second aperture and a switching element. The switching element is suitable for switching the first diaphragm and the second diaphragm to the effective optical path of the first lens or the second lens. The first aperture has a light blocking pattern.

In an embodiment of the invention, the first lens further includes an auto-focus element, and the auto-focus element is electrically connected to the depth recognition module.

In an embodiment of the invention, the light-shielding pattern is formed by a light-shielding film.

In an embodiment of the invention, the light shielding pattern is an asymmetric pattern.

The invention further provides a method for extracting a dual-lens imaging module, wherein the dual-lens imaging module comprises a first lens and a second lens, and the method for extracting the dual-lens imaging module comprises the following steps: respectively extracting a first image and a second image through a first lens and a second lens; forming a three-dimensional image according to the first image and the second image; regulating and controlling the first lens or the second lens to obtain optimized data; and forming an optimized stereoscopic image according to the optimized data and the stereoscopic image.

In an embodiment of the invention, the step of adjusting the first lens or the second lens to obtain the optimized data includes: changing a focal length of the first lens; extracting out-of-focus images by using a first lens; and obtaining optimized data according to the defocused image.

In an embodiment of the invention, the step of adjusting the first lens or the second lens to obtain the optimized data includes: switching the diaphragm to an effective optical path of the first lens; extracting out-of-focus images by using a first lens; and identifying pattern variations of the out-of-focus image to obtain optimized data, wherein the aperture has a shading pattern.

In an embodiment of the invention, the step of forming the optimized stereoscopic image according to the optimization data and the stereoscopic image includes: obtaining depth data according to the stereoscopic image; and modifying the depth data according to the optimization data to form an optimized stereoscopic image.

Based on the above, in the dual-lens imaging module and the extracting method thereof of the present invention, the first lens is a lens having an auto-focusing function, and the second lens is connected to the moving module to move or tilt so as to change a distance between the second lens and the first lens. Therefore, the double-lens imaging module can shoot objects with a short or long working distance and is suitable for users with different distances between eyes. In addition, the dual-lens imaging module can also intercept a plurality of images at different positions by moving the second lens so as to obtain a stereoscopic image or a stereoscopic image capable of displaying a stereoscopic effect. Therefore, the range of the working distance of the double-lens imaging module can be enlarged, and the three-dimensional imaging can obtain a good display effect.

In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.

Drawings

Fig. 1 is a rear view of an electronic device according to an embodiment of the invention;

fig. 2A and 2B are schematic side views of a dual-lens imaging module moving lens according to an embodiment of the invention;

FIG. 3 is a schematic side view of a dual lens imaging module according to another embodiment of the present invention;

FIG. 4 is a schematic side view of a dual lens imaging module according to another embodiment of the present invention;

FIG. 5 is a schematic side view of a dual lens imaging module according to another embodiment of the invention;

FIGS. 6A and 6B are schematic top views of a partial depth recognition module in FIG. 5;

FIG. 7 is a schematic diagram of the first lens of FIG. 5 according to the present invention when out of focus;

fig. 8 is a flowchart illustrating steps of a method for extracting an image of a dual lens module according to an embodiment of the invention.

Description of the symbols

10: electronic device

100. 100A, 100B, 100C: double-lens imaging module

110: first lens

120: second lens

130: mobile module

132: driving element

134: mounting component

140: light-transmitting substrate

150. 150A: optical element

160: depth recognition module

162: first diaphragm

164: second diaphragm

166: switching element

A: shading pattern

D1, D2: distance between each other

S200 to S230: step (ii) of

Detailed Description

Fig. 1 is a rear view of an electronic device according to an embodiment of the invention. Please refer to fig. 1. The present embodiment provides a dual lens imaging module 100 that can be mounted on an electronic device 10, such as a smart phone, a tablet, a head-mounted display device, and can be applied to technologies such as stereoscopic imaging, stereoscopic photography, panoramic photography, Virtual Reality (VR) and Augmented Reality (AR). In the embodiment, the electronic device 10 is an example of a smart phone, but the invention is not limited thereto. In the present embodiment, the dual lens imaging module 100 can be mounted on a side of the electronic device 10 opposite to the display surface, as shown in fig. 1. In the present embodiment, the dual-lens imaging module 100 includes a first lens 110, a second lens 120, and a moving module 130.

Fig. 2A and 2B are schematic side views of a dual-lens imaging module moving lens according to an embodiment of the invention. Please refer to fig. 1 and fig. 2A. In the present embodiment, the dual-lens imaging module 100 further includes a transparent substrate 140 configured to cover the first lens 110 and the second lens 120, wherein the first lens 110 is a lens with an auto-focus function. In the present embodiment, the surface of the transparent substrate 140 is aligned with the surface of the electronic device 10. For example, the transparent substrate 140 is a plastic cover plate, and the surface of the transparent substrate is aligned with the surface of the housing of the smart phone, but the invention is not limited thereto.

The moving module 130 is connected to the second lens 120. In detail, the moving module 130 includes a driving element 132 and a mounting element 134. The driving element 132 is connected to the mounting element 134, and the second lens 120 is disposed on the mounting element 134. In the present embodiment, the moving module 130 is a linear motor driving module. However, in other embodiments, the moving module 130 may be a Voice Coil Motor (VCM) driving module, a Shape Memory Alloy (SMA) component, a piezoelectric material module, or a Hall sensor (Hall effect sensor), but the invention is not limited thereto.

Please refer to fig. 1 to fig. 2B. In the embodiment, the moving module 130 can move the second lens 120, so that the distance between the second lens 120 and the first lens 110 is changed from the distance D1 before the movement to the distance D2 after the movement, as shown in fig. 2A and 2B. Specifically, in the present embodiment, the driving element 132 is adapted to drive the mounting element 134 to move the second lens 120. Therefore, the distance between the first lens 110 and the second lens 120 is changed, so that the dual-lens imaging module 100 can shoot an object with a short or long working distance, and is suitable for users with different eye distances. In addition, the dual lens imaging module 100 can also capture a plurality of images at different positions by moving the second lens 120, so as to obtain a stereoscopic image or a stereoscopic image capable of displaying a stereoscopic effect. Therefore, the range of the working distance of the dual-lens imaging module 100 can be increased, and the stereoscopic imaging can obtain a good display effect.

It should be noted that, in the embodiment, an algorithm may be used to further obtain an optimized stereoscopic image. In detail, the first lens 110 with auto-focus function can be adjusted to extract the out-of-focus image at the non-focus position, and then an algorithm is used to compare the out-of-focus image with the previously obtained in-focus image at the focus position to obtain the optimized data. Finally, an algorithm is used to combine the optimized data with the previous three-dimensional image to obtain an optimized three-dimensional image with better depth information. Therefore, the optimized three-dimensional imaging with better depth information can be obtained through the calculation of the defocusing extraction image matching algorithm.

In some embodiments, the second lens 120 may be tilted to change the optical axis angle thereof according to different types of the moving module 130, so as to improve the display effect of the stereoscopic imaging, but the invention is not limited thereto. In addition, in other embodiments, the moving module 130 may include a first moving module and a second moving module (not shown). The first moving module and the second moving module are respectively connected to the first lens 110 and the second lens 120. The first moving module is adapted to move or tilt the first lens 110, and the second moving module is adapted to move or tilt the second lens 120. In other words, in these embodiments, the additional moving module 130 may be configured to move the first lens 110 such that both lenses can move or tilt, but the invention is not limited thereto.

Fig. 3 is a schematic side view of a dual-lens imaging module according to another embodiment of the invention. Please refer to fig. 3. The dual-lens imaging module 100A of the present embodiment is similar to the dual-lens imaging module 100 shown in fig. 1. The difference between the two is that in the present embodiment, the dual-lens imaging module 100A further includes an optical element 150, which is detachably disposed on the transparent substrate 140. The second lens 120 is adapted to be moved to an effective optical path of the optical element 140 by the moving module 130. In the present embodiment, the optical element 140 is, for example, a Neutral Density filter (ND filter). Therefore, when the second lens 120 is moved to the position below the optical element 150 by the moving module 130, the light received by the second lens 120 can generate the filter effect by passing through the optical element 150.

Fig. 4 is a schematic side view of a dual-lens imaging module according to another embodiment of the invention. Please refer to fig. 4. The dual-lens imaging module 100B of the present embodiment is similar to the dual-lens imaging module 100A shown in fig. 3. The difference between the two is that in the present embodiment, the optical element 150A is, for example, at least one lens with diopter. Therefore, when the second lens 120 is moved below the optical element 150A by the moving module 130, the light received by the second lens 120 can pass through the optical element 150A to generate an effect with different fields of View (FOV). In this embodiment, the optical element 150A may further select a color filter or a polarizer to achieve different optical imaging effects, but the invention is not limited thereto. And in these embodiments, the optical element 150A may be simply replaced via manipulation. Thus, the optical element 150A can be simply replaced as required to obtain various optical imaging effects.

Fig. 5 is a schematic side view of a dual-lens imaging module according to another embodiment of the invention. Fig. 6A and 6B are schematic top views of a part of the depth recognition module in fig. 5. FIG. 7 is a schematic diagram of the first lens in FIG. 5 when out of focus according to the present invention. Please refer to fig. 5 to fig. 7. The dual-lens imaging module 100C of the present embodiment is similar to the dual-lens imaging module 100 shown in fig. 2A. The difference between the two is that in the present embodiment, the dual-lens imaging module 100C further includes a depth recognition module 160 disposed on the first lens 110. In the present embodiment, the depth recognition module 160 is a plurality of aperture switching modules for switching different apertures to change the first lens 110 to a photographing function or a depth sensing function. Specifically, the depth recognition module 160 includes a first aperture 162, a second aperture 164, and a switching element 166. The first aperture 162 is a special aperture having a light-shielding pattern a, as shown in fig. 6A. In the present embodiment, the light-shielding pattern a is an asymmetric pattern, and the light-shielding pattern a is composed of a light-shielding film, but the present invention does not limit the forming material, shape, size or number of the light-shielding pattern a.

The second aperture 164 is an aperture used in general photography, as shown in fig. 6B. The switching element 166 is suitable for switching the first aperture 162 and the second aperture 164 to the effective optical path of the first lens 110, but the form and kind of the switching element 166 are not limited in the present invention. When the switching element 166 switches the first aperture 162 having the light shielding pattern a to the effective optical path of the first lens 110, the first lens 110 may be defocused by the auto-focus system of the first lens 110 to extract an image. Since the first aperture 162 has the light shielding pattern a, the image extracted in the out-of-focus state will show the light shielding pattern a, as shown in fig. 7. The size of the pattern displayed by the extracted image is different according to different defocus positions. In other words, when the first diaphragm 162 is switched to the effective optical path of the first lens 110, the first lens 110 can be used as a depth sensor. Therefore, the depth information of the image can be obtained by changing the focusing state of the single lens, and the stereo image is further optimized. In one embodiment, the auto-focus element of the first lens 110 can be electrically connected to the depth recognition module 160 to passively measure the depth. Therefore, the power saving effect can be further achieved.

Fig. 8 is a flowchart illustrating steps of a method for extracting an image of a dual lens module according to an embodiment of the invention. Please refer to fig. 2B and fig. 8. The present embodiment provides a method for extracting a dual lens imaging module, which can be at least applied to the dual lens imaging module 100 shown in fig. 2B, so the following description will take the dual lens imaging module 100 shown in fig. 2B as an example, but the present invention is not limited thereto. In the present embodiment, step 200 is first executed to extract a first image and a second image through the first lens 110 and the second lens 120, respectively. Then, after the above steps, step S210 is executed to form a stereoscopic image according to the first image and the second image. That is, after the images extracted by the first lens 110 and the second lens 120 are respectively used as the left image and the right image, the left image and the right image are combined into a stereoscopic image with depth information.

Next, after the above steps, step S220 is executed to adjust and control the first lens 110 to obtain the optimized data. For example, in one embodiment, the focal length of the first lens 110 may be changed, and then the out-of-focus image is extracted by the first lens 110. And finally, acquiring optimized data according to the out-of-focus image. In some embodiments, the second lens 120 can also be operated to extract the out-of-focus image in the same manner, but the invention is not limited thereto. For another example, in another embodiment, the aperture with the light-shielding pattern can be switched to the effective optical path of the first lens 110, and then the first lens 110 is used to extract the out-of-focus image. Finally, pattern variations of the out-of-focus image are identified to measure optimized data.

Then, after the above steps, step S230 is executed to form an optimized stereoscopic image according to the optimized data and the stereoscopic image. Specifically, in the present embodiment, the depth data is first obtained according to the stereoscopic image, and then the depth data is modified according to the optimized data to form the optimized stereoscopic image. The method for obtaining depth data according to the stereoscopic image can obtain sufficient teaching in the manner of moving the second lens 120, and thus is not described herein again.

In summary, in the dual-lens imaging module and the extracting method thereof of the present invention, the first lens is a lens with an auto-focusing function, and the second lens is connected to the moving module to move or tilt to change a distance between the second lens and the first lens. Therefore, the double-lens imaging module can shoot objects with a short or long working distance and is suitable for users with different distances between eyes. In addition, the dual-lens imaging module can also intercept a plurality of images at different positions by moving the second lens so as to obtain a stereoscopic image or a stereoscopic image capable of displaying a stereoscopic effect. Therefore, the range of the working distance of the double-lens imaging module can be enlarged, and the three-dimensional imaging can obtain a good display effect.

Although the present invention has been described with reference to the above embodiments, it should be understood that the invention is not limited thereto, and that various changes and modifications can be made by those skilled in the art without departing from the spirit and scope of the invention.

Claims

1. A dual lens imaging module adapted for use in an electronic device, the dual lens imaging module comprising:

a first lens;

a second lens;

a moving module connected to the second lens and adapted to move or tilt the second lens, wherein the first lens is a lens with an auto-focusing function, a working distance of the dual-lens imaging module is adapted to change according to a distance between the first lens and the second lens, the moving module includes a first moving module and a second moving module, the first moving module and the second moving module are respectively connected to the first lens and the second lens, the first moving module is adapted to move or tilt the first lens, and the second moving module is adapted to move or tilt the second lens;

a light-transmitting substrate configured to cover the first lens and the second lens; and

the second lens is suitable for moving to an effective optical path of the optical element through the moving module.

2. The dual lens imaging module of claim 1, wherein a surface of the transparent substrate is aligned with a surface of the exterior of the electronic device.

3. The dual lens imaging module of claim 1, wherein the optical element is at least one lens having diopter, a neutral gray filter, a color filter, or a polarizer.

4. The dual lens imaging module of claim 1, wherein the moving module includes a driving element and a mount element, the driving element is connected to the mount element, and the second lens is disposed on the mount element, the driving element is adapted to drive the mount element to move or tilt the second lens.

5. The dual lens imaging module of claim 1, wherein the moving module is a linear motor driving module, a voice coil motor driving module, a shape memory alloy assembly, a piezoelectric material module, or a hall sensor.

6. The dual lens imaging module of claim 1, further comprising:

the depth recognition module is configured on the first lens and comprises a first aperture, a second aperture and a switching element, the switching element is suitable for switching the first aperture and the second aperture to the effective optical path of the first lens or the second lens, and the first aperture is provided with a shading pattern.

7. The dual lens imaging module of claim 6, wherein the first lens further comprises an auto focus element, and the auto focus element is electrically connected to the depth recognition module.

8. The dual lens imaging module of claim 6, wherein the light blocking pattern is formed of a light blocking film.

9. The dual lens imaging module of claim 6, wherein the light blocking pattern is an asymmetric pattern.

10. A method for extracting a dual-lens imaging module, wherein the dual-lens imaging module comprises a first lens and a second lens, and the method for extracting the dual-lens imaging module comprises the following steps:

respectively extracting a first image and a second image through the first lens and the second lens;

forming a stereoscopic image according to the first image and the second image;

adjusting the first shot or the second shot to obtain optimized data, wherein the step of adjusting the first shot or the second shot to obtain the optimized data comprises:

switching an aperture to an effective optical path of the first lens;

extracting out-of-focus images by using the first lens; and

identifying pattern variations of the out-of-focus image to measure the optimized data, wherein the aperture has a shading pattern; and

and forming an optimized stereoscopic image according to the optimized data and the stereoscopic image.

11. The method of claim 10, wherein the step of forming the optimized stereoscopic image according to the optimized data and the stereoscopic image comprises:

obtaining depth data according to the three-dimensional image; and

and modifying the depth data according to the optimization data to form the optimized stereoscopic image.