WO2020085873A1

WO2020085873A1 - Camera and terminal having same

Info

Publication number: WO2020085873A1
Application number: PCT/KR2019/014212
Authority: WO
Inventors: 이지은; 신윤섭; 정용우
Original assignee: 엘지전자 주식회사
Priority date: 2018-10-26
Filing date: 2019-10-25
Publication date: 2020-04-30
Also published as: KR20200046861A; KR102553487B1

Abstract

The present invention relates to a camera and a terminal having same. A camera according to an embodiment of the present invention comprises: a light source unit having a plurality of light sources and outputting first pattern light; a light conversion unit for converting the first pattern light from the light source unit to generate second pattern light different from the first pattern light, and outputting any one of the first pattern light and the second pattern light; a light detection unit for detecting first reflected light received from a subject in response to the first pattern light outputted from the light conversion unit and second reflected light received from the subject in response to the second pattern light; and a processor for controlling the first pattern light to be outputted at a first point in time, and controlling the second pattern light to be outputted at a second point in time after the first point in time, and generating depth information about the subject on the basis of the first reflected light and the second reflected light. Due to these features, heat generation and size can be reduced by using one light source unit.

Description

Camera and terminal having the same

The present invention relates to a camera and a terminal having the same, and more particularly, to a slim camera capable of reducing heat generation and size using a single light source unit, and a terminal having the same.

The camera is a device for photographing images. Recently, as a camera is employed in a mobile terminal, research on miniaturization of the camera has been conducted.

Recently, a depth camera is mounted on a mobile terminal, and a method of simultaneously outputting a plurality of pattern lights from a plurality of light source units and calculating the depth information of the subject has been implemented for calculating the depth information of the subject.

However, according to this method, since a plurality of pattern lights must be output at the same time, the size of the camera has to be increased, and there is a disadvantage in that heat generation is severe.

An object of the present invention is to provide a camera capable of reducing heat generation and size using a single light source unit, and a terminal having the same.

Another object of the present invention is to provide a camera capable of calculating depth information with high resolution by alternately outputting a plurality of pattern lights, and a terminal having the same.

Another object of the present invention is to provide a camera capable of changing the output period of pattern light according to temperature, and a terminal having the same.

A camera and a terminal having the same according to an embodiment of the present invention for achieving the above object include a plurality of light sources, a light source unit for outputting the first pattern light, and a first pattern light from the light source unit to convert A light conversion unit that generates a second pattern light different from the one pattern light and outputs one of the first pattern light and the second pattern light, and is received from the subject in correspondence with the first pattern light output from the light conversion unit A light detector for detecting the first reflected light and the second reflected light received from the subject in response to the second pattern light, the first pattern light is controlled to be output, and the second time point after the first time point is controlled. 2 controls to output pattern light, and includes a processor that generates depth information on the subject based on the first reflected light and the second reflected light.

Meanwhile, the light conversion unit may transmit and output the first pattern light at the first time point and output the second pattern light that is converted and generated at the second time point.

On the other hand, the optical patterns of the first pattern light and the second pattern light do not overlap.

Meanwhile, the light conversion unit may include a micro lens or a liquid lens.

Meanwhile, the camera and the terminal having the same may further include a lens projecting outside the first pattern light or the second pattern light output from the light conversion unit.

Meanwhile, the processor can control the first pattern light and the second pattern light to be alternately output at regular intervals.

Meanwhile, the camera and the terminal having the same, further include a temperature detector, and the processor may control the output periods of the first pattern light and the second pattern light to vary according to the detected temperature.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases.

Meanwhile, the processor may control the higher the detected temperature, the lower the resolution of the first pattern light output from the light source unit.

Meanwhile, the processor may control the plurality of light sources to change the resolution of the first pattern light output from the light source unit.

Meanwhile, the processor may control the resolution of the first pattern light to decrease as the amount of movement of the camera increases.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the amount of movement of the camera increases.

Meanwhile, when the light conversion unit includes a liquid lens, the processor may apply a first electric signal to the liquid lens at a first time point and a second electric signal to the liquid lens at a second time point.

Meanwhile, the light conversion unit may include a lens driver for applying an electrical signal to the liquid lens, and a sensor unit for sensing the curvature of the liquid lens formed based on the electrical signal.

On the other hand, the sensor unit can detect a change in size or area of the area of the boundary between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution.

Meanwhile, the sensor unit may sense the capacitance formed by the electrically conductive aqueous solution and the electrode in response to a change in the size or area of the area of the boundary region between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution.

Meanwhile, the light conversion unit may further include a plurality of conductive lines that supply a plurality of electrical signals output from the lens driving unit to a liquid lens, one of the plurality of conductive lines, and a switching element disposed between the sensor unit. .

Meanwhile, the processor may calculate the curvature of the liquid lens based on the capacitance sensed by the sensor unit, and output a pulse width variable signal to the lens driver based on the calculated curvature and target curvature.

Meanwhile, when the calculated curvature becomes smaller than the target curvature, the processor may control to increase the duty of the pulse width variable signal.

A camera and a terminal having the same according to an embodiment of the present invention include a plurality of light sources, a light source unit outputting the first pattern light, and a first pattern light different from the first pattern light by converting the first pattern light from the light source unit. 2 A light conversion unit that generates pattern light and outputs one of the first pattern light and the second pattern light, and the first reflected light received from the subject corresponding to the first pattern light output from the light conversion unit, and 2 A light detection unit that detects the second reflected light received from the subject in response to the pattern light, and controls to output the first pattern light at a first time point, and outputs a second pattern light at a second time point after the first time point And a processor that generates depth information on the subject based on the first reflected light and the second reflected light. Accordingly, it is possible to reduce heat generation and size using one light source unit.

In particular, by outputting different pattern light for each viewpoint, the light conversion unit can form a wider light gap in the first pattern light, thereby reducing heat generation and making the camera size compact.

On the other hand, by outputting a plurality of pattern light alternately, the resolution of the light pattern by the synthesis of the first reflected light and the second reflected light increases, and, finally, it is possible to calculate high-depth information of the resolution.

Meanwhile, the light conversion unit may transmit and output the first pattern light at the first time point and output the second pattern light that is converted and generated at the second time point. Accordingly, since the light gap in the first pattern light can be formed wide, heat generation can be reduced, and the size of the camera can be configured compactly.

On the other hand, the optical patterns of the first pattern light and the second pattern light do not overlap. Accordingly, since the light gap in the first pattern light can be formed wide, heat generation can be reduced, and the size of the camera can be configured compactly.

Meanwhile, the light conversion unit may include a micro lens or a liquid lens. Accordingly, it is possible to easily implement the second pattern light in which the first pattern light and the light pattern do not overlap.

Meanwhile, the camera and the terminal having the same may further include a lens projecting outside the first pattern light or the second pattern light output from the light conversion unit. Accordingly, the quality of the pattern light projected to the outside can be improved.

Meanwhile, the camera and the terminal having the same, further include a temperature detector, and the processor may control the output periods of the first pattern light and the second pattern light to vary according to the detected temperature. Accordingly, it is possible to reduce the heat generation of the camera.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, it is possible to reduce the heat generation of the camera.

Meanwhile, the processor may control the higher the detected temperature, the lower the resolution of the first pattern light output from the light source unit. Accordingly, it is possible to reduce the heat generation of the camera.

Meanwhile, the processor may control the plurality of light sources to change the resolution of the first pattern light output from the light source unit. Accordingly, the resolution of the depth information can be varied while reducing the heat generation of the camera.

Meanwhile, the processor may control the resolution of the first pattern light to decrease as the amount of movement of the camera increases. Accordingly, the accuracy of depth information can be improved.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the amount of movement of the camera increases. Accordingly, the accuracy of depth information can be improved.

Meanwhile, when the light conversion unit includes a liquid lens, the processor may apply a first electric signal to the liquid lens at a first time point and a second electric signal to the liquid lens at a second time point. Accordingly, the liquid lens can be easily driven.

Meanwhile, the light conversion unit may include a lens driver for applying an electrical signal to the liquid lens, and a sensor unit for sensing the curvature of the liquid lens formed based on the electrical signal. Accordingly, the curvature of the liquid lens can be easily calculated.

On the other hand, the sensor unit can detect a change in size or area of the area of the boundary between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution. Accordingly, the curvature of the liquid lens can be easily calculated.

Meanwhile, the sensor unit may sense the capacitance formed by the electrically conductive aqueous solution and the electrode in response to a change in the size or area of the area of the boundary region between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution. Accordingly, the curvature of the liquid lens can be easily calculated.

Meanwhile, the light conversion unit may further include a plurality of conductive lines supplying a plurality of electrical signals output from the lens driving unit to a liquid lens, one of the plurality of conductive lines, and a switching element disposed between the sensor unit. . Accordingly, the curvature of the liquid lens can be easily calculated.

Meanwhile, the processor may calculate the curvature of the liquid lens based on the capacitance sensed by the sensor unit, and output a pulse width variable signal to the lens driver based on the calculated curvature and target curvature. Accordingly, the liquid lens can be implemented to have a desired target curvature.

Meanwhile, when the calculated curvature becomes smaller than the target curvature, the processor may control to increase the duty of the pulse width variable signal. Accordingly, the liquid lens can be implemented to have a desired target curvature.

1A is a perspective view of a mobile terminal, which is one example of a terminal according to an embodiment of the present invention, viewed from the front.

1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

FIG. 2 is a block diagram of the mobile terminal of FIG. 1.

3A is an internal cross-sectional view of the RGB camera of FIG. 1B.

3B is an internal block diagram of the RGB camera of FIG. 1B.

4 is an internal convex view of the depth camera of FIG. 1B.

FIG. 5A is a view referred to for describing an operation of the depth camera of FIG. 1B.

5B illustrates a depth image generated based on the calculated distance information.

6 is an internal structure diagram of the light output unit of FIG. 4.

7 is a flowchart illustrating a method of operating a depth camera according to an embodiment of the present invention.

8A to 11 are views referred to for explaining the operation method of FIG. 7.

12A to 12B are views illustrating a driving method of a liquid lens.

13A to 13C are views showing the structure of the liquid lens.

14A to 14E are views for explaining a variable lens curvature of a liquid lens.

15A to 15B are various examples of internal block diagrams of the light conversion unit.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are given simply by considering the ease of writing the present specification, and do not give meanings or roles particularly important in themselves. Therefore, the "module" and the "unit" may be used interchangeably.

1A is a perspective view of a mobile terminal, which is an example of a terminal according to an embodiment of the present invention, viewed from the front, and FIG. 1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

Referring to Figure 1a, the case forming the appearance of the mobile terminal 100 is formed by the front case (100-1) and the rear case (100-2). Various electronic components may be embedded in the space formed by the front case 100-1 and the rear case 100-2.

Specifically, the display 180, the first sound output module 153a, the first camera 195a, and the first to third

user input units

130a, 130b, and 130c may be disposed on the front case 100-1. have. In addition, a fourth user input unit 130d, a fifth user input unit 130e, and first to third microphones 123a, 123b, and 123c may be disposed on the side surfaces of the rear case 100-2.

The display 180 may overlap the touch pad in a layer structure, so that the display 180 may operate as a touch screen.

The first sound output module 153a may be implemented in the form of a receiver or speaker. The first camera 195a may be embodied in a form suitable for taking an image or video for a user. Further, the microphone 123 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fifth

user input units

130a, 130b, 130c, 130d, and 130e, and the sixth and seventh

user input units

130f and 130g, which will be described later, may be collectively referred to as a user input unit 130.

The first to second microphones 123a and 123b are arranged to collect audio signals on the upper side of the rear case 100-2, that is, on the upper side of the mobile terminal 100, and the third microphone 123c is The lower case 100-2, that is, the lower side of the mobile terminal 100, may be arranged for audio signal collection.

Referring to FIG. 1B, a second camera 195b, a third camera 195c, and a fourth microphone (not shown) may be additionally mounted on the rear surface of the rear case 100-2, and the rear case 100 On the side of -2), the sixth and seventh

user input units

130f and 130g and the interface unit 175 may be disposed.

The second camera 195b has a shooting direction substantially opposite to the first camera 195a, and may have different pixels from the first camera 195a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 195b.

Meanwhile, the second camera 195b may be an RGB camera, and the third camera 195c may be a depth camera for calculating a distance from the subject.

A second sound output module (not shown) may be additionally disposed in the rear case 100-2. The second audio output module may implement a stereo function together with the first audio output module 153a, and may be used for a call in speakerphone mode.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2 side. The power supply unit 190 may be detachably coupled to the rear case 100-2 for charging, for example, as a rechargeable battery.

The fourth microphone 123d may be disposed in front of the rear case 100-2, that is, on the back of the mobile terminal 100, for collecting audio signals.

FIG. 2 is a block diagram of the mobile terminal of FIG. 1.

Referring to FIG. 2, the mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, and a memory 160, an interface unit 175, a control unit 170, and a power supply unit 190. These components may be configured by combining two or more components into one component, or when one component is subdivided into two or more components, when implemented in an actual application.

The wireless communication unit 110 may include a broadcast reception module 111, a mobile communication module 113, a wireless Internet module 115, a short-range communication module 117, and a GPS module 119.

The broadcast receiving module 111 may receive at least one of a broadcast signal and broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast signal and / or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 can transmit and receive a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission / reception of text / multimedia messages.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 may be built in or external to the mobile terminal 100.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, Near Field Communication (NFC) may be used as the short-range communication technology.

The Global Position System (GPS) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 195 and a microphone 123.

The camera 195 may process a video frame such as a still image or video obtained by an image sensor in a video call mode or a shooting mode. Then, the processed image frame may be displayed on the display 180.

The image frames processed by the camera 195 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 195 may be provided according to a configuration aspect of the terminal.

The microphone 123 may receive an external audio signal by a microphone in a display off mode, for example, a call mode, a recording mode, or a voice recognition mode, and process it as electrical voice data.

Meanwhile, a plurality of microphones 123 may be arranged at different positions. The audio signal received from each microphone may be processed by the control unit 170 or the like.

The user input unit 130 generates key input data input by the user to control the operation of the terminal. The user input unit 130 may be configured with a key pad, a dome switch, a touch pad (static pressure / power outage), and the like, through which a user may receive commands or information by pressing or touching a user. In particular, when the touch pad forms a mutual layer structure with the display 180, which will be described later, it may be referred to as a touch screen.

The sensing unit 140 detects the current state of the mobile terminal 100, such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, or a user contact, to control the operation of the mobile terminal 100 Sensing signals can be generated.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, a touch sensor 146, and the like.

The proximity sensor 141 may detect the presence or absence of an object approaching the mobile terminal 100 or an object present in the vicinity of the mobile terminal 100 without mechanical contact. In particular, the proximity sensor 141 may detect a proximity object using a change in an alternating magnetic field, a change in a static magnetic field, or a rate of change in capacitance.

The pressure sensor 143 may detect whether pressure is applied to the mobile terminal 100 and the size of the pressure.

The motion sensor 145 may detect the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like.

The touch sensor 146 may detect a touch input by a user's finger or a touch input by a specific pen. For example, when a touch screen panel is disposed on the display 180, the touch screen panel may include a touch sensor 146 for detecting location information, intensity information, and the like of the touch input. The sensing signal sensed by the touch sensor 146 may be transmitted to the controller 170.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display 180, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display 180 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. In addition, when the mobile terminal 100 is in a video call mode or a shooting mode, the captured or received video may be displayed respectively or simultaneously, and a UI and GUI are displayed.

On the other hand, as described above, when the display 180 and the touch pad are configured as a touch screen by forming a mutual layer structure, the display 180 may be used as an input device capable of inputting information by a user's touch in addition to an output device. You can.

The audio output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. In addition, the audio output module 153 outputs an audio signal related to a function performed in the mobile terminal 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, a signal can be output in the form of vibration.

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a tactile effect, the intensity and pattern of vibration generated by the haptic module 157 are convertible, and different vibrations can be synthesized and output or sequentially output.

The memory 160 may store a program for processing and control of the control unit 170 and provide a function for temporarily storing input or output data (eg, a phone book, a message, a still image, a video, etc.). You can also do

The interface unit 175 serves as an interface with all external devices connected to the mobile terminal 100. The interface unit 175 may receive data from an external device or receive power and transmit it to each component inside the mobile terminal 100, and allow data inside the mobile terminal 100 to be transmitted to the external device.

The control unit 170 controls the overall operation of the mobile terminal 100 by generally controlling the operation of each part. For example, it may perform related control and processing for voice calls, data communication, video calls, and the like. Also, the control unit 170 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured with hardware in the control unit 170 or may be configured with software separately from the control unit 170. Meanwhile, the control unit 170 may include an application processor (not shown) for driving an application. Alternatively, the application processor (not shown) may be provided separately from the control unit 170.

In addition, the power supply unit 190 may receive external power or internal power under the control of the control unit 170 to supply power required for the operation of each component.

3A is an internal cross-sectional view of the RGB camera of FIG. 1B.

Referring to the drawings, FIG. 3A is an example of a cross-sectional view of the camera 195b.

The camera 195b may include an aperture 194, a lens device 193, and an image sensor 820.

The aperture 194 can open and close the light incident to the lens device 193.

The lens device 193 may include a plurality of lenses adjusted for variable focus.

The image sensor 820 may include an RGb filter 915b and a sensor array 911b that converts an optical signal into an electrical signal to sense RGB color.

Accordingly, the image sensors 820 may sense and output RGB images, respectively.

3B is an internal block diagram of the RGB camera of FIG. 1B.

Referring to the drawings, FIG. 3B is an example of a block diagram for the camera 195b.

The camera 195b may include a lens device 193, an image sensor 820, and an image processor 830.

The lens device 193 may receive incident light incident, and may include a plurality of lenses adjusted for variable focus.

The image processor 830 may generate an RGB image based on an electrical signal from the image sensor 820.

In particular, the image processor 830 may generate an image signal based on incident light that has passed through the lens device 193. Accordingly, according to this, an image signal may be generated using the image sensor 820 when photographing the rear side.

Meanwhile, the exposure time of the image sensor 820 may be adjusted based on an electrical signal.

Meanwhile, the RGB image from the image processor 830 may be transferred to the control unit 170 of the mobile terminal 100.

Meanwhile, the control unit 170 of the mobile terminal 100 may output a control signal to the lens device 193 for the movement of the lens in the lens device 193 or the like. For example, a control signal for auto focusing may be output to the lens device 193.

Meanwhile, the control unit 170 of the mobile terminal 100 may output an aperture control signal for adjusting the light transmittance of the aperture 194 to the aperture 194.

For example, the control unit 170 of the mobile terminal 100 may control the aperture 194 to be opened in the first period and the aperture 194 to be closed in the second period.

4 is an internal convex view of the depth camera of FIG. 1B.

Referring to the drawings, the depth camera 195c of FIG. 4 may include an optical output unit 210, an optical photodetector 280, a temperature detector 260, and a processor 270.

The processor 270 may output a sinusoidal drive signal Tx of a predetermined frequency to the optical output unit 210.

The optical output unit 210 may output the first pattern light or the second pattern light to the external subject 40 based on the sinusoidal wave driving signal, that is, the transmission signal Tx.

In particular, the light output unit 210 may output a first pattern light at a first time point and output a second pattern light at a second time point after the first time point.

That is, the light output unit 210 may alternately output the first pattern light and the second pattern light.

The first pattern light or the second pattern light output to the external subject 40 is scattered or reflected by the external subject 40. Accordingly, the first reception light or the second reception light that is scattered or reflected by the external subject 40 may be received by the depth camera 195c.

The photodetector 280 may receive the first received light or the second received light, and convert it into a received signal that is an electrical signal.

Meanwhile, the electrical signal Rx converted by the photodetector 280 may be transmitted to the processor 270.

The processor 270 may calculate distance information on an external subject based on the transmission signal Tx and the transmission signal Tx.

In particular, the processor 270 may synthesize the first received light and the second received light, and calculate distance information on an external subject based on the synthesized light.

Meanwhile, the processor 270 may calculate distance information on the external subject based on the difference between the first pattern light and the second pattern light, and the light in which the first and second received lights are synthesized.

Meanwhile, the distance information calculated by the depth camera 195c may be transmitted to the control unit 170 of the mobile terminal 100.

In addition, the controller 170 of the mobile terminal 100 may generate a depth image based on the distance information calculated by the depth camera 195c.

Alternatively, the processor 270 in the depth camera 195c may generate a depth image based on the calculated distance information.

Meanwhile, the light output unit 210 outputs the first pattern light to the external subject 40 at the first time point, and the second pattern light to the external subject 40 at the second time point after the first time point. Can print

In particular, the second pattern light is a pattern light generated by replicating the first pattern light, and it is preferable that the light pattern of the second pattern light does not overlap with the light pattern of the first pattern light.

Accordingly, since the light output unit 210 uses a single light source unit, it is possible to reduce heat and size of the depth camera 195c.

In particular, the light conversion unit 320, by outputting different pattern light for each viewpoint, it is possible to form a wide light gap in the first pattern light, it is possible to reduce heat generation, the size of the depth camera 195c is also compact Can be configured.

Meanwhile, the temperature detection unit 260 can detect the temperature of the light output unit 210. The detected temperature information T may be input to the processor 270.

Meanwhile, the processor 270 may control the first pattern light and the second pattern light to be alternately output at regular intervals.

Meanwhile, the processor 270 may control the output periods of the first pattern light and the second pattern light to vary according to the detected temperature. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

Meanwhile, the processor 270 may control the output periods of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

Meanwhile, the processor 270 may control the higher the detected temperature, the lower the resolution of the first pattern light output from the light source unit 310. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

Meanwhile, the processor 270 may control the plurality of light sources to vary the resolution of the first pattern light output from the light source unit 310. Accordingly, it is possible to change the resolution of the depth information while reducing the heat generated by the depth camera 195c.

Meanwhile, as the amount of movement of the depth camera 195c increases, the processor 270 may control the resolution of the first pattern light to decrease. Accordingly, the accuracy of depth information can be improved.

Meanwhile, the processor 270 may control the output period of the first pattern light and the second pattern light to increase as the amount of movement of the depth camera 195c increases. Accordingly, the accuracy of depth information can be improved.

Referring to the drawings, the depth camera 195c selectively outputs the first pattern light or the second pattern light to the external subject 40, and the first reflected light or the second reflected light scattered or reflected by the external subject 40 The distance information may be calculated using the difference between the first patterned light or the second patterned light and the first reflected light or the second reflected light.

Referring to the drawings, in the depth camera 195c, the calculated distance information may be represented as the luminance image 65, as shown in FIG. 5B. Various distance information values of the external subject can be displayed as corresponding luminance levels. When the distance information is close, the luminance level may be large (brightness may be bright), and when the depth is far, the luminance level may be small (brightness may be dark).

6 is an internal structure diagram of the light output unit of FIG. 4.

Referring to the drawing, the light output unit 210 includes a plurality of light sources, and converts the first pattern light from the light source unit 310 and the light source unit 310 to output the first pattern light, the first pattern light A light conversion unit 320 may be provided to generate a second pattern light different from each other and to output any one of the first pattern light and the second pattern light.

According to this, the light conversion unit 320 outputs the first pattern light to the external subject 40 at the first time point, and outputs the second pattern light to the external subject 40 at the second time point after the first time point. Can be output to

Meanwhile, the light output unit 210 may further include a lens 330 projecting outside the first pattern light or the second pattern light output from the light conversion unit 320. Accordingly, the quality of the pattern light projected to the outside can be improved.

Meanwhile, the lens 330 may change a direction in which light travels, and a condensing lens or the like may be used for this purpose.

Meanwhile, the light conversion unit 320 may duplicate the first pattern light from the light source unit 310 to generate a second pattern light different from the first pattern light and output it.

In particular, the light conversion unit 320 may transmit and output the first pattern light at the first time point and output the second pattern light generated by being converted at the second time point. Accordingly, since the light gap in the first pattern light can be formed wide, heat generation can be reduced, and the size of the depth camera 195c can be configured compactly.

On the other hand, the optical patterns of the first pattern light and the second pattern light do not overlap. Accordingly, since the light gap in the first pattern light can be formed wide, heat generation can be reduced, and the size of the depth camera 195c can be configured compactly.

To this end, the light conversion unit 320 may include a micro lens or a liquid lens. Accordingly, it is possible to easily implement the second pattern light in which the first pattern light and the light pattern do not overlap.

Meanwhile, when the light conversion unit 320 includes the liquid lens 500, the processor 270 applies a first electrical signal to the liquid lens 500 at a first time point and at a second time point, The second electrical signal may be applied to the liquid lens 500. Accordingly, the liquid lens 500 can be easily driven.

7 is a flowchart illustrating an operation method of a depth camera according to an embodiment of the present invention, and FIGS. 8A to 11 are views referred to for describing the operation method of FIG.

Referring to the drawing, the processor 270 in the depth camera 195c determines whether it is the first viewpoint (S705) and, if applicable, controls to output the first pattern light (S710).

The light source unit 310 in the light output unit 210 includes a plurality of light sources and can output a first pattern light based on the plurality of light sources.

For example, the light source unit 310 includes a plurality of vertical resonant surface emitting laser diodes (VSCEL), and as shown in FIG. 8A, at the first time point T1m, the first pattern light PTa is used as a surface light source. Can print

On the other hand, the light conversion unit 320 receives the first pattern light (PTa) from the light source unit 310, as shown in Figure 8a, at a first time point (T1m), without a separate light conversion, the first pattern light (PTa) ) Can be output.

For example, when the light conversion unit 320 includes a liquid lens 500, as shown in FIG. 12A (b), the liquid lens 500 may not change the light traveling direction.

Accordingly, the lens 330 may output the first pattern light PTa to the outside at the first time point T1m, as shown in FIG. 8A.

Meanwhile, in step 705 (S705), if it is not the first time point, the processor 270 determines whether it is the second time point (S707), and if so, controls the second pattern light to be output (S715). ).

For example, as illustrated in FIG. 8B, the light source unit 310 may output the first pattern light PTa as the surface light source at the second time point T2m.

Meanwhile, the light conversion unit 320 that receives the first pattern light PTa from the light source unit 310 performs light conversion at a second time point T2m, as shown in FIG. 8B, so that the first pattern light PTa ) May be converted into the second pattern light PTb and output.

It is preferable that the light patterns of the first pattern light PTa and the second pattern light PTb do not overlap in order to increase the optical resolution.

To this end, the light conversion unit 320 may shift the first pattern light PTa in a constant direction or the like.

For example, when the light conversion unit 320 includes a liquid lens 500, as shown in (a) or (c) of FIG. 12A or (b) of FIG. 12B, the liquid lens 500 Can change the direction of light travel.

Accordingly, the lens 330 may output the second pattern light PTb to the outside at the second time point T2m, as shown in FIG. 8B (S710).

As a result, when the light conversion unit 320 includes a liquid lens 500, the processor 270 applies a first electrical signal to the liquid lens 500 at a first time point, and at a second time point, The second electrical signal may be applied to the liquid lens 500. Accordingly, the liquid lens 500 can be easily driven.

Next, after outputting the first pattern light, the photodetector 280 may receive and detect the first received light reflected from the external object in response to the first pattern light (S720).

Next, after the second pattern light, the photodetector 280 may receive and detect the second received light reflected from the external object in response to the second pattern light (S725).

The processor 270 may receive an electrical signal corresponding to the first reflected light from the photodetector 280 and an electrical signal corresponding to the second reflected light from the first time point and the second time point, and synthesize them ( S730),

That is, the processor 270 may synthesize the first reflected light and the second reflected light from the photodetector 280 after the first time point and the second time point.

Then, the processor 270 may calculate depth information based on the synthesized signal or the synthesized light (S735).

8C (a) illustrates the first pattern light PTa, FIG. 8C (b) illustrates the second pattern light PTb, and FIG. 8C (c) shows the first pattern light The composite light PTc in which (PTa) and the second pattern light PTb are synthesized is exemplified.

As described above, when the first pattern light PTa and the second pattern light PTb do not overlap, the optical pattern resolution of the composite light PTc is the first pattern light PTa or the second pattern light PTb. It is approximately twice the resolution of the optical pattern.

Accordingly, heat generation can be reduced, and the optical pattern resolution can be equal to or higher than the conventional method of simultaneously outputting a plurality of pattern lights.

Similar to FIG. 8C, the processor 270 may synthesize the first reflected light and the second reflected light, and calculate distance information based on the synthesized light.

Accordingly, it is possible to calculate the distance information based on the optical pattern resolution of approximately twice the optical pattern resolution of the first reflected light or the second reflected light. Therefore, it is possible to accurately calculate the distance to the external subject.

8D illustrates the first composite light PTam and the second composite light PTBm projected on the first surface SFa and the second surface SFb.

The first synthetic light PTam may be obtained by combining the first pattern light PTa and the second pattern light PTb of FIG. 8C.

Depending on the distance or angle difference between the first surface SFa and the second surface SFb, the distance difference between the adjacent first light Pa and the second light Pb in the first composite light PTam is d, , The distance difference between the adjacent first light Pa 'and the second light Pb' in the second synthetic light PTBm may be represented by d1.

The processor 270 may calculate distance information on the external subject according to the difference between d and d1.

On the other hand, in the present invention, in order to reduce heat generation and reduce size in the depth camera 195c that outputs pattern light, it is assumed that pattern light from one light source unit is copied and used.

In another embodiment of the present invention, the temperature detection unit 260 may reduce heat generation of the depth camera 195c based on the sensed temperature information.

To this end, on the other hand, the depth camera 195c and the mobile terminal 100 having the same, further include a temperature detector 260, and the processor 270, according to the detected temperature, the first pattern light and the second The output period of the pattern light can be controlled to be variable. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

Meanwhile, as illustrated in FIG. 9A, the processor 270 may control the output periods of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

10A illustrates that when the temperature is Ta, the output periods of the first pattern light PTa and the second pattern light PTb are 2T1, respectively.

On the other hand, (a) of FIG. 10 illustrates that when the temperature is Ta, the output intervals of the first pattern light PTa and the second pattern light PTb alternately output are T1.

10B illustrates that when the temperature is Tb higher than Ta, the output periods of the first pattern light PTa and the second pattern light PTb are 2T2, respectively. At this time, T2 is preferably larger than T1.

On the other hand, (b) of FIG. 10 illustrates that when the temperature is Tb higher than Ta, the output intervals of the first pattern light PTa and the second pattern light PTb alternately output are T2. . Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

Meanwhile, as illustrated in FIG. 9B, the processor 270 may control the higher the detected temperature, the lower the resolution of the first pattern light output from the light source unit 310. Accordingly, it is possible to reduce the heat generated by the depth camera 195c.

To this end, the processor 270 may perform control on a plurality of light sources to change the resolution of the first pattern light output from the light source unit 310. Accordingly, it is possible to change the resolution of the depth information while reducing the heat generated by the depth camera 195c.

Similarly, when moving the depth camera 195c and the mobile terminal 100 having the same, it is also possible to vary the output period of the pattern light or the resolution of the pattern light in order to improve the accuracy of the depth information calculation.

For example, as illustrated in FIG. 9C, the processor 270 may control the output periods of the first pattern light and the second pattern light to increase as the amount of movement of the depth camera 195c increases. Accordingly, the accuracy of depth information can be improved.

Meanwhile, as illustrated in FIG. 9D, the processor 270 may control the resolution of the first pattern light to decrease as the movement amount of the depth camera 195c increases. Accordingly, the accuracy of depth information can be improved.

11A illustrates that when the temperature is Ta1, the output periods of the first pattern light PTam and the second pattern light PTbm are 2T1, respectively.

On the other hand, (a) of FIG. 11 illustrates that when the temperature is Ta1, the output intervals of the first pattern light PTam and the second pattern light PTbm alternately output are T1.

11B illustrates that when the temperature is Tb1 higher than Ta1, the output periods of the first pattern light PTa and the second pattern light PTb are 2T1, respectively.

On the other hand, (b) of FIG. 11 illustrates that when the temperature is Tb1 higher than Ta1, the output intervals of the first pattern light PTa and the second pattern light PTb alternately output are T1. .

On the other hand, the amount of the pattern of the first pattern light PTa and the second pattern light PTb in FIG. 11 (b) compared to FIG. 11 (a) is the first pattern light in FIG. 11 (a). It is preferable that it is smaller than the amount of the pattern of (PTam) and the 2nd pattern light PTbm.

That is, in the case of FIG. 11 (b) where the temperature is higher, the pattern light resolution of the outputted pattern light may be lower. Accordingly, while reducing the heat generated by the depth camera 195c, it is possible to calculate the depth information for the external subject.

12A to 12B are views illustrating a driving method of a liquid lens.

First, FIG. 12A (a) illustrates that the first voltage V1 is applied to the liquid lens 500, and the liquid lens operates like a concave lens.

Next, FIG. 12A (b) illustrates that the liquid lens 500 is applied with a second voltage V2 that is greater than the first voltage V1, so that the liquid lens does not change the traveling direction of light.

Next, FIG. 12A (c) illustrates that the liquid lens 500 is applied with a third voltage V3 greater than the second voltage V2, so that the liquid lens operates like a convex lens.

Meanwhile, in FIG. 12A, although the curvature or diopter of the liquid lens is changed according to the level of the applied voltage, it is not limited thereto, and the curvature or diopter of the liquid lens may be changed according to the pulse width of the applied pulse. Do.

Next, FIG. 12B (a) illustrates that the liquid in the liquid lens 500 has the same curvature and thus operates like a convex lens.

That is, according to (a) of FIG. 12B, the incident light Lpaa is concentrated and the corresponding output light Lpab is output.

Next, FIG. 12B (b) illustrates that as the liquid in the liquid lens 500 has an asymmetrical curved surface, the traveling direction of light is changed upward.

That is, according to (b) of FIG. 12B, the incident light Lpaa is concentrated upward and the corresponding output light Lpac is output.

13A to 13C are views showing the structure of the liquid lens. In particular, FIG. 13A shows a top view of the liquid lens, FIG. 13B shows a bottom view of the liquid lens, and FIG. 13C shows a cross-sectional view of I-I 'of FIGS. 13A and 13C.

In particular, FIG. 13A is a view corresponding to the right side of the liquid lens 500 of FIGS. 12A to 12B, and FIG. 13B may be a view corresponding to the left side of the liquid lens 500 of FIGS. 12A to 12B.

Referring to the drawings, the liquid lens 500 may have a common electrode (COM) 520 disposed thereon, as illustrated in FIG. 13A. In this case, the common electrode (COM) 520 may be disposed in a tube shape, and the liquid 530 may be disposed in a lower region of the common electrode (COM) 520, particularly in a region corresponding to hollow. have.

On the other hand, although not shown in the drawing, for insulation of the common electrode (COM) 520, an insulator (not shown) may be disposed between the common electrode (COM) 520 and the liquid.

In addition, as illustrated in FIG. 13B, a plurality of electrodes LA to LD 540a to 540d may be disposed under the common electrode COM 520, particularly under the liquid 530. The plurality of electrodes LA to LD 540a to 540d, in particular, may be disposed in a form surrounding the liquid 530.

Also, a plurality of insulators 550a to 550d for insulation may be disposed between the plurality of electrodes LA to LD 540a to 540d and the liquid 530.

That is, the liquid lens 500 includes a common electrode (COM) 520, a plurality of electrodes (LA to LD) 540a to 540d spaced apart from the common electrode (COM) 520, and the common electrode A liquid 530 and an electrically conductive aqueous solution (595 in FIG. 13C) disposed between the (COM) 520 and the plurality of electrodes LA to LD (540a to 540d) may be provided.

Referring to FIG. 13C, the liquid lens 500 insulates a plurality of electrodes LA to LD 540a to 540d and a plurality of electrodes LA to LD 540a to 540d on the first substrate 510. For the plurality of insulators (550a ~ 550d), a plurality of electrodes (LA ~ LD) (540a ~ 540d) on the liquid 530, the liquid 530 on the electrically conductive aqueous solution (electroconductive aqueous solution) 595, and the liquid A common electrode (COM) 520 that is spaced apart from the 530 and a second substrate 515 on the common electrode (COM) 520 may be provided.

The common electrode 520 may have a hollow shape and be formed in a tube shape. In addition, the liquid 530 and the electrically conductive aqueous solution 595 may be disposed in the hollow region. The liquid 530 may be arranged in a circular shape, as shown in FIGS. 13A to 13B. The liquid 530 at this time may be a non-conductive liquid such as oil.

On the other hand, as it goes from the lower portion to the upper portion of the hollow region, the size may be increased, and accordingly, the plurality of electrodes LA to LD (540a to 540d) may be smaller in size from the lower portion to the upper portion.

In FIG. 13C, the first electrode LA (540a) and the second electrode (LB) 540b among the plurality of electrodes LA to LD (540a to 540d) are formed to be inclined. It is illustrated that the size becomes small.

Meanwhile, unlike FIGS. 13A to 13C, a plurality of electrodes LA to LD 540a to 540d are formed at an upper portion of the common electrode 520 and a common electrode 520 is formed at a lower portion. Do.

Meanwhile, FIGS. 13A to 13C illustrate four electrodes as a plurality of electrodes, but are not limited thereto, and it is possible that two or more different numbers of electrodes are formed.

Meanwhile, in FIG. 13C, after a pulse-type electric signal is applied to the common electrode 520, after a predetermined time, the first electrode (LA) 540a and the second electrode (LB) 540b are pulsed. When an electrical signal is applied, a potential difference between the common electrode 520 and the first electrode (LA) 540a and the second electrode (LB) 540b occurs, and accordingly, an electrically conductive aqueous solution having electrical conductivity The shape of 595 changes, and in response to the shape change of the electrically conductive aqueous solution 595, the shape of the liquid 530 inside the liquid 530 changes.

On the other hand, in the present invention, the plurality of electrodes (LA to LD) (540a to 540d), and the common electrode 520 according to the electric signal applied to each, the liquid 530 formed curvature of the simple and quick detection Suggests.

To this end, the sensor unit 962 in the present invention is the area of the boundary region Ac0 between the first insulator 550a on the first electrode 540a in the liquid lens 500 and the electrically conductive aqueous solution 595. Detect changes in size or area.

In Fig. 13C, AM0 is exemplified as the area of the boundary area Ac0. In particular, it is exemplified that the area of the boundary region Ac0 in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AM0.

In FIG. 13C, it is illustrated that the liquid 530 is not concave or convex, and is parallel to the first substrate 510 and the like. The curvature at this time can be defined as 0, for example.

Meanwhile, as shown in FIG. 13C, for the boundary region Ac0 in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a, the capacitance is represented by Equation 1 below. (C) may be formed.

Equation 1

At this time, ε may represent the dielectric constant of the dielectric 550a, A may represent the area of the boundary region Ac0, and d may indicate the thickness of the first dielectric 550a.

Here, assuming that ε and d are fixed values, it may be the area of the boundary area Ac0 that greatly affects the capacitance C.

That is, the larger the area of the boundary area Ac0, the larger the capacitance C formed in the boundary area Ac0 may be.

On the other hand, as the curvature of the liquid 530 varies, the area of the boundary area Ac0 varies. In the present invention, the area of the boundary area Ac0 is sensed by using the sensor unit 962 or the boundary area It is assumed that the capacitance C formed in (Ac0) is sensed.

Meanwhile, the capacitance of FIG. 13C can be defined as CAc0.

14A to 14E are diagrams illustrating various curvatures of the liquid lens 500.

First, FIG. 14A illustrates that the first curvature Ria is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14A, as the first curvature Ria is formed in the liquid 530, AMa (> AM0) is illustrated as the area of the boundary area Aaa. In particular, it is illustrated that the area of the boundary region Aaa in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMa.

According to Equation 1, since the area of the boundary area Aaa in FIG. 14A is larger than that of FIG. 13C, the capacitance of the boundary area Aaa is greater. Meanwhile, the capacitance of FIG. 14A can be defined as CAaa, and has a larger value than the capacitance CAc0 of FIG. 13C.

At this time, the first curvature Ri may be defined as having a positive polarity value. For example, it may be defined that the first curvature Ria has a +2 level.

Next, FIG. 14B illustrates that a second curvature Rib is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14B, as the second curvature Rib is formed in the liquid 530, AMb (> AMa) is illustrated as the area of the boundary area Abba. In particular, it is illustrated that the area of the boundary region Aba in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMb.

According to Equation 1, since the area of the boundary area Aba in FIG. 14B is larger than that of FIG. 14A, the capacitance of the boundary area Aba is greater. Meanwhile, the capacitance of FIG. 14B can be defined as CAba, and has a larger value than the capacitance of CAaa of FIG. 14A.

At this time, the second curvature Rib and the first curvature Ria may be defined as having a smaller positive polarity value. For example, it may be defined that the second curvature Rib has a +4 level.

Meanwhile, according to FIGS. 14A and 14B, the liquid lens 500 operates as a convex lens, and accordingly, the output light LP1a in which the incident light LP1 is concentrated is output.

Next, FIG. 14C illustrates that a third curvature Ric is formed in the liquid 530 according to the application of an electric signal to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In particular, in FIG. 14C, AMa is illustrated as the area of the left boundary region Aca, and AMb (> AMa) is illustrated as the area of the right boundary region Akb.

In particular, the area of the boundary region Aca in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMa, and the second insulator on the second electrode 540b It is exemplified that the area of the boundary region Acb in contact with the electrically conductive aqueous solution 595 among the inclined portions of 550b is AMb.

Accordingly, the capacitance of the left boundary region Aca may be CAaa, and the capacitance of the right boundary region Acb may be CAba.

At this time, the third curvature Ric may be defined as having a positive polarity value. For example, it may be defined that the third curvature Ric has a +3 level.

Meanwhile, according to FIG. 14C, the liquid lens 500 operates as a convex lens, and accordingly, the output light LP1b in which the incident light LP1 is more concentrated toward one side is output.

Next, FIG. 14D illustrates that a fourth curvature Rid is formed in the liquid 530 according to the application of an electrical signal to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14D, as the fourth curvature Rid is formed in the liquid 530, AMd (<AM0) is illustrated as the area of the boundary region Ada. In particular, it is illustrated that the area of the boundary region Ada in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMd.

According to Equation 1, since the area of the boundary area Ada in FIG. 14D is smaller than that of FIG. 13C, the capacitance of the boundary area Ada is smaller. Meanwhile, the capacitance of FIG. 14D can be defined as CAda, and has a smaller value than the capacitance CAc0 of FIG. 13C.

At this time, the fourth curvature Rid may be defined as having a negative polarity value. For example, it may be defined that the fourth curvature Rid has a -2 level.

Next, FIG. 14E illustrates that a fifth curvature Rie is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14E, as the fifth curvature Rie is formed in the liquid 530, AMe (<AMd) is illustrated as the area of the boundary area Aea. In particular, it is illustrated that the area of the boundary region (Aea) in contact with the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMe.

According to Equation 1, compared to FIG. 14D, since the area of the boundary area Aea in FIG. 14E is smaller, the capacitance of the boundary area Aea is smaller. Meanwhile, the capacitance of FIG. 14E can be defined as CAea, and has a smaller value than the capacitance of CAda of FIG. 14D.

At this time, the fifth curvature Ri may be defined as having a negative polarity value. For example, it can be defined that the fifth curvature Rie has a -4 level.

Meanwhile, according to FIGS. 14D and 14E, the liquid lens 500 operates as a concave lens, and accordingly, the output light LP1c from which the incident light LP1 is emitted is output.

First, FIG. 15A is an example of an internal block diagram of a light conversion unit.

Referring to the drawings, the light conversion unit 320a of FIG. 15A may include a lens driving unit 860, a pulse width variable control unit 840, a power supply unit 890, and a liquid lens 500.

Referring to the operation of the light conversion unit 320a of FIG. 15A, the pulse width variable control unit 840 outputs a pulse width variable signal V in response to a target curvature, and the lens driver 860 outputs a pulse width variable signal. The voltage may be output to a plurality of electrodes and a common electrode of the liquid lens 500 using (V) and the voltage Vx of the power supply 890.

That is, the light conversion unit 320a of FIG. 15A may operate as an open loop system to vary the curvature of the liquid lens.

15B is another example of an internal block diagram of a light conversion unit.

Referring to the drawings, the light conversion unit 320b according to an embodiment of the present invention includes a liquid lens 500, a lens driving unit 960 applying an electric signal to the liquid lens 500, and an electric signal A sensor unit 962 for detecting the curvature of the formed liquid lens 500 and a processor 970 for controlling the lens driver 960 to form a target curvature of the liquid lens 500 based on the sensed curvature. It can contain.

Meanwhile, unlike the drawing, the light conversion unit 320b may not include the processor 970, and the processor 970 may be provided in the processor 270 of FIG. 4.

On the other hand, the sensor unit 962 may detect a change in size or area of the area of the boundary region Ac0 between the insulator on the electrode in the liquid lens 500 and the electrically conductive aqueous solution 595. Accordingly, it is possible to quickly and accurately sense the curvature of the lens.

On the other hand, the light conversion unit 320b according to an embodiment of the present invention, a power supply unit 990 for supplying power, and an AD converter 967 converting a signal related to the capacitance detected by the sensor unit 962 into a digital signal ) May be further provided.

Meanwhile, the light conversion unit 320b includes a plurality of conductive lines CA1 and CA2 for supplying electric signals to each electrode (common electrode, plurality of electrodes) in the liquid lens 500 in the lens driving unit 960. , A switching element SWL disposed between any one of the plurality of conductive lines CA2 and the sensor unit 962 may be further included.

In the drawing, it is illustrated that the switching element SWL is disposed between the conductive line CA2 for applying an electrical signal to any one of the plurality of electrodes in the liquid lens 500 and the sensor unit 962. In this case, the contact point between the conductive line CA2 and one end of the switching element SWL or the liquid lens 500 may be referred to as node A.

On the other hand, in the present invention, for detecting the curvature of the liquid lens 500, electric signals are applied to each electrode (common electrode, multiple electrodes) in the liquid lens 500 through a plurality of conductive lines CA1 and CA2. can do.

For example, during the first period, the switching element SWL may be turned on.

At this time, in the state where the switching element SWL is turned on and in communication with the sensor unit 962, when an electric signal is applied to the electrode in the liquid lens 500, a curvature is formed in the liquid lens 500 and curvature is formed. The electrical signal corresponding to may be supplied to the sensor unit 962 via the switching element SWL.

Accordingly, the sensor unit 962, during the on period of the switching element SWL, based on the electrical signal from the liquid lens 500, the insulator on the electrode in the liquid lens 500 of the liquid lens 500, The size or area of the area of the boundary area Ac0 between the electrically conductive aqueous solutions 595 may be detected, or the capacitance of the boundary area Ac0 may be sensed.

Next, during the second period, the switching element SWL is turned off, and an electrical signal may be continuously applied to the electrodes in the liquid lens 500. Accordingly, a curvature may be formed in the liquid 530.

Next, during the third period, the switching element SWL is turned off, and an electrical signal is not applied to an electrode in the liquid lens 500 or a low-level electrical signal is applied.

Next, during the fourth period, the switching element SWL may be turned on.

Meanwhile, when the curvature calculated based on the capacitance sensed during the first period is less than the target curvature, the processor 970 pulses the pulse width variable control signal supplied to the driver 960 to reach the target curvature. It can be controlled to increase the width.

Accordingly, a time difference between pulses applied to the common electrode 530 and the plurality of electrodes may be increased, and accordingly, the curvature formed in the liquid 530 may be increased.

During the fourth period, when the switching element SWL is turned on and in contact with the sensor unit 962, when an electric signal is applied to the electrode in the liquid lens 500, a curvature is formed in the liquid lens 500, , The electrical signal corresponding to the curvature formation may be supplied to the sensor unit 962 through the switching element SWL.

Accordingly, the processor 970 may calculate the curvature based on the sensed capacitance and determine whether the target curvature has been reached. On the other hand, when the target curvature is reached, the processor 970 may control to supply a corresponding electrical signal to each electrode.

According to this, according to the electrical signal supply, the curvature of the liquid 530 is formed, and the curvature of the liquid can be sensed immediately. Therefore, it is possible to quickly and accurately grasp the curvature of the liquid lens 500.

Meanwhile, in the drawing, the lens driving unit 960 and the sensor unit 962 may be formed as one module 965.

On the other hand, in the drawing, the lens driving unit 960 and the sensor unit 962, the processor 970, the power supply unit 990, the AD converter 967, the switching element (SWL), system on chip (system on chip, SOC), it may be implemented as a single chip (chip).

Meanwhile, in order to increase the curvature of the liquid lens 500, the processor 970 may control the level of the voltage applied to the liquid lens 500 to increase or the pulse width to increase.

Meanwhile, the processor 970 may calculate a curvature of the liquid lens 500 based on the capacitance sensed by the sensor unit 962.

In this case, the processor 970 may calculate that as the capacitance sensed by the sensor unit 962 increases, the curvature of the liquid lens 500 increases.

In addition, the processor 970 may control the liquid lens 500 to have a target curvature.

On the other hand, the processor 970 calculates the curvature of the liquid lens 500 based on the capacitance detected by the sensor unit 962, and based on the calculated curvature and target curvature, the pulse width variable signal V It can be output to the lens driving unit 960.

Accordingly, the lens driving unit 960 uses the pulse width variable signal V and the voltages Lv1 and Lv2 of the power supply unit 990 to use a plurality of electrodes LA to LD 540a to 540d. , And a corresponding electrical signal to the common electrode 520.

As described above, by sensing the capacitance of the liquid lens 500 and feeding it back, an electric signal is applied to the liquid lens 500 so that the curvature of the lens is variable, so that the curvature of the lens can be changed quickly and accurately.

Meanwhile, the processor 970 generates a pulse width variable signal V based on the calculated curvature and the target curvature, an equalizer 972 for calculating a curvature error, and a calculated curvature error Φ. A pulse width variable control unit 940 to be output may be included.

Accordingly, when the calculated curvature becomes larger than the target curvature, the processor 970 may control the duty of the pulse width variable signal V to increase based on the calculated curvature error Φ. Accordingly, the curvature of the liquid lens 500 can be changed quickly and accurately.

Meanwhile, the processor 970 receives focus information AF from the image processing unit 930 and shake information OIS from a gyro sensor (not shown), and focus information AF and shake information (OIS). Based on this, a target curvature can be determined.

In this case, the determined update period of the target curvature is preferably longer than the update period of the calculated curvature based on the sensed capacitance of the liquid lens 500.

As a result, since the calculated update period of the curvature is smaller than the update period of the target curvature, it is possible to rapidly change the curvature of the liquid lens 500 and change it to a desired curvature.

Meanwhile, the camera 195c described with reference to FIGS. 4 to 15B may be employed in various electronic devices such as the mobile terminal 100 of FIG. 2, a vehicle, a TV, a drone, a robot, a robot cleaner, and a door.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

Claims

A light source unit having a plurality of light sources and outputting a first pattern light;

A light conversion unit that converts the first pattern light from the light source unit to generate a second pattern light different from the first pattern light, and outputs one of the first pattern light and the second pattern light;

A light detection unit configured to detect a first reflected light received from an object corresponding to the first pattern light output from the light conversion unit and a second reflected light received from the object corresponding to the second pattern light;

Control so that the first pattern light is output at a first time point, and control so that the second pattern light is output at a second time point after the first time point, and based on the first reflected light and the second reflected light, the And a processor that generates depth information about the subject.
According to claim 1,

The light conversion unit,

At the first time point, the first pattern light is transmitted and output,

And outputting the converted second pattern light at the second time point.
According to claim 1,

A camera characterized in that the light patterns of the first pattern light and the second pattern light do not overlap.
According to claim 1,

The light conversion unit,

A camera comprising a micro lens or a liquid lens.
According to claim 1,

And a lens projecting to the outside of the first pattern light or the second pattern light output from the light conversion unit.
According to claim 1,

The processor,

And controlling the first pattern light and the second pattern light to be alternately output at regular intervals.
According to claim 1,

Further comprising a temperature detector;

The processor,

A camera characterized in that the output period of the first pattern light and the second pattern light is controlled to vary according to the temperature detected by the temperature detector.
The method of claim 7,

The processor,

A camera characterized in that the higher the detected temperature, the larger the output period of the first pattern light and the second pattern light.
The method of claim 7,

The processor,

The higher the detected temperature, the camera characterized in that the control to lower the resolution of the first pattern light output from the light source unit.
According to claim 1,

The processor,

And performing a control on the plurality of light sources to vary the resolution of the first pattern light output from the light source unit.
The method of claim 10,

The processor,

A camera characterized in that the higher the movement amount of the camera is, the lower the resolution of the first pattern light is.
According to claim 1,

The processor,

A camera characterized in that the larger the movement amount of the camera is, the larger the output period of the first pattern light and the second pattern light is.
According to claim 1,

When the light conversion unit is provided with a liquid lens,

The processor,

A camera characterized by applying a first electrical signal to the liquid lens at the first time point and applying a second electrical signal to the liquid lens at the second time point.
The method of claim 13,

The light conversion unit,

A lens driver applying the electrical signal to the liquid lens;

And a sensor unit configured to sense a curvature of the liquid lens formed based on the electrical signal.
The method of claim 14,

The sensor unit,

A camera characterized in that the size of the area or a change in the area of the boundary region between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution is detected.
The method of claim 15,

The sensor unit,

In response to the size of the area of the boundary region between the insulator on the electrode in the liquid lens and the electrically conductive aqueous solution or a change in the area, the camera detects the capacitance formed by the electrically conductive aqueous solution and the electrode.
The method of claim 14,

The light conversion unit,

A plurality of conductive lines supplying a plurality of electrical signals output from the lens driver to the liquid lens; And

And a switching element disposed between any one of the plurality of conductive lines and the sensor unit.
The method of claim 14,

The processor,

A camera characterized by calculating a curvature of the liquid lens based on the capacitance detected by the sensor unit, and outputting a pulse width variable signal to the lens driver based on the calculated curvature and target curvature.
The method of claim 18,

The processor,

When the calculated curvature becomes smaller than the target curvature, the camera is characterized in that the control to increase the duty of the pulse width variable signal.
A terminal having a camera of any one of claims 1 to 19.