KR102100768B1 - User terminal device and luminance adujustment method thereof - Google Patents

Abstract

A user terminal device is disclosed. The user terminal device includes a display, a first sensor provided on the front surface of the user terminal device to detect the irradiated light, a second sensor provided on the rear surface of the user terminal device to detect the irradiated light, and detection through the first sensor And a controller that adjusts the brightness of the display based on the displayed front illumination and the rear illumination detected through the second sensor.

Description

User terminal device and its brightness adjustment method {USER TERMINAL DEVICE AND LUMINANCE ADUJUSTMENT METHOD THEREOF}

The present disclosure relates to a user terminal device and a method for adjusting its brightness, and more particularly, to a user terminal device and a method for adjusting its brightness, which support a peripheral illumination detection function.

With the development of electronic technology, various types of electronic devices have been developed and distributed. In particular, display devices such as mobile devices and TVs, which have been most widely used in recent years, have rapidly developed in recent years.

With the spread of smartphones and tablet devices, the use time of the mobile display device increases, and in particular, as a mobile display device is used in various illuminance environments due to the characteristics of the mobile device, the problem of visibility according to the display luminance becomes important. Accordingly, most mobile display devices provide a function of automatically changing luminance according to ambient illumination, but there is a problem in that it is difficult to estimate an accurate lighting environment because the illumination is measured using only a single optical sensor.

The present disclosure is in accordance with the above-described need, and the object of the present invention is to improve the visibility of the displayed image by adjusting the output luminance value of the display in consideration of not only the front illuminance but also the rear illuminance, and It is to provide a method for adjusting the brightness.

According to an embodiment for achieving the above object of the present disclosure, a user terminal device is provided on a display, a first sensor provided on the front surface of the user terminal device, and sensing light emitted from the user terminal device, provided on a rear surface of the user terminal device. And a second sensor that senses the irradiated light, and a controller that adjusts the brightness of the display based on the front illumination detected through the first sensor and the rear illumination detected through the second sensor.

In addition, the controller determines whether the illuminance space is changed based on the instantaneous change amount of the front illuminance and the instantaneous change amount of the back illuminance, and if it is determined that the illuminance space has changed, adjusts the brightness of the display to correspond to the changed illuminance space. I can adjust it.

Further, the controller determines that the illuminance space has changed when the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a preset threshold value, and that the illuminance space has changed when the increase / decrease directions coincide. The luminance of the display can be adjusted at the determined time point.

In addition, the controller determines that the illuminance space has changed from a relatively dark space to a bright space when the instantaneous change amount of the front illuminance and the back illuminance is positive, and the illuminance when the instantaneous change amount of the front illuminance and the back illuminance is negative. It can be judged that the space has changed from a relatively bright space to a dark space.

In addition, the controller may determine a backlighting situation based on a comparison result of the front and back illuminations, and if it is determined that the backlighting situation, the brightness of the display may be adjusted to correspond to the backlighting situation.

In addition, the controller may adjust the brightness of the display upwards than the current brightness when it is judged that the backlight is in progress.

In addition, when it is determined that the backlight is in the backlight state, the controller calculates the intensity of backlight and calculates an upward adjustment of luminance based on the intensity of backlight.

In addition, the controller, at least one of a predetermined mathematical operation combination of the ratio of the front illumination and the rear illumination, the difference between the front illumination and the screen illumination, and the front illumination and the rear illumination. Based on the intensity of the backlight can be determined.

In addition, when it is determined that the backlight is the backlight condition, the controller adjusts the brightness of the display based on the back illumination, or applies a higher weight than the front illumination to the back illumination to adjust the brightness of the display with the luminance value calculated. I can adjust it.

In this case, the first sensor and the second sensor may be implemented as at least one of an illuminance sensor, an RGB sensor, a white sensor, an IR sensor, an IR + RED sensor, an HRM sensor, and a camera, respectively.

Alternatively, the first sensor is implemented as an RGB sensor, the second sensor is implemented as an HRM sensor, and the controller is a sensing value sensed by the HRM sensor based on lighting characteristics of a space in which the user terminal device is located. It can be used by scaling the back illumination.

On the other hand, according to an embodiment of the present invention, the user is provided with a first sensor for sensing light irradiated on the front of the user terminal device and a user having a second sensor for sensing light irradiated on the back of the user terminal device The method for adjusting the brightness of the terminal device includes sensing light emitted through the first sensor and the second sensor, and detecting front light detected through the first sensor and back light detected through the second sensor. And adjusting the brightness of the display provided on the front surface based on the above.

In addition, the step of adjusting the brightness of the display determines whether the illuminance space is changed based on the instantaneous change amount of the front illuminance and the instantaneous change amount of the back illuminance, and if it is determined that the illuminance space has changed, corresponds to the changed illuminance space It is possible to adjust the brightness of the display.

In addition, the step of adjusting the brightness of the display may determine that the lighting environment has changed when the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a predetermined threshold value, and the increase / decrease directions match. The luminance of the display can be adjusted when it is determined that the lighting environment has changed.

In addition, in the adjusting of the brightness of the display, when the instantaneous change in the front illuminance and the back illuminance is positive, it is determined that the illuminance space has changed from a relatively dark space to a bright space, and the moment of the front illuminance and the back illuminance When the amount of change is negative, it can be determined that the illuminance space has changed from a relatively bright space to a dark space.

In addition, the adjusting the brightness of the display may determine a backlighting situation based on a comparison result of the front illumination and the rear illumination, and if it is determined that the backlighting situation, adjust the brightness of the display to correspond to the backlighting situation. have.

In addition, in the step of adjusting the brightness of the display, when it is determined that the backlight is in progress, the brightness of the display may be adjusted upward than the current brightness.

In addition, in the step of adjusting the brightness of the display, when it is determined that the backlight is the backlighting intensity, the intensity of backlighting may be calculated, and an upward adjustment of brightness may be calculated based on the intensity of backlighting.

In addition, the step of adjusting the brightness of the display may include: a ratio of the front illuminance and the rear illuminance, a difference between the front illuminance and the rear illuminance, the front illuminance, and the rear illuminance; The intensity of the backlight may be calculated based on at least one of the calculation combinations.

In addition, the step of adjusting the brightness of the display, if it is determined that the backlight conditions, the brightness value calculated by adjusting the brightness of the display based on the back light, or applying a weight higher than the front light to the back light The brightness of the display can be adjusted.

On the other hand, according to an embodiment of the present invention, the user is provided with a first sensor for sensing light irradiated on the front of the user terminal device and a user having a second sensor for sensing light irradiated on the back of the user terminal device A recording medium in which a program for performing a method for controlling luminance of a terminal device is stored, the method comprising: detecting light emitted through the first sensor and the second sensor; and through the first sensor And adjusting the brightness of the display provided on the front surface based on the sensed front light intensity and the back light intensity detected through the second sensor.

According to various embodiments of the present invention, since it is possible to accurately adjust the changed illuminance environment and adjust the output luminance suitable for the illuminance environment, it is possible to improve the visibility of the displayed image.

1A to 1C are diagrams for explaining an implementation example of a user terminal device according to an embodiment of the present invention.
2 is a view for explaining a sensing coverage range when a plurality of illuminance sensors are provided in a user terminal device according to an embodiment of the present invention.
3A is a block diagram showing the configuration of a user terminal device according to an embodiment of the present invention.
3B is a block diagram showing the detailed configuration of the user terminal device shown in FIG. 3A.
4 is a view for explaining various modules stored in the storage unit.
5A and 5B are diagrams illustrating a method of determining an illuminance space according to an embodiment of the present invention.
6 and 7 are diagrams for explaining a backlight determination method according to an embodiment of the present invention.
8A and 8B are diagrams for describing a method of adjusting luminance according to various embodiments of the present invention.
9A and 9B are diagrams for explaining a method of calculating illuminance according to an embodiment of the present invention.
10A and 10B are diagrams for describing an illuminance calculation method according to another embodiment of the present invention.
11 is a view for explaining an illuminance calculation method according to another embodiment of the present invention.
12A and 12B are diagrams for explaining an implementation example of an illuminance sensor according to an embodiment of the present invention.
13 is a view for explaining a method of estimating the illuminance in consideration of the type of a light source according to an embodiment of the present invention.
14 is a flowchart illustrating a method for adjusting luminance of a user terminal device according to an embodiment of the present invention.

Before describing the present invention in detail, the description method of the present specification and drawings will be described.

First, terms used in the present specification and claims are selected by considering general functions in various embodiments of the present invention. However, these terms may vary depending on the intention of a person skilled in the art, legal or technical interpretation, and the appearance of new technologies. Also, some terms are arbitrarily selected by the applicant. These terms may be interpreted as meanings defined in the present specification, and may be interpreted based on the general contents of the present specification and common technical common knowledge in the art without specific term definitions.

In addition, the same reference numbers or reference numerals in each drawing attached to the present specification denote parts or components that perform substantially the same function. For convenience of explanation and understanding, different embodiments are described using the same reference numbers or symbols. That is, even if all the components having the same reference number are shown in the plurality of drawings, the plurality of drawings does not mean one embodiment.

In addition, in this specification and claims, terms including ordinal numbers, such as “first” and “second”, may be used to distinguish between components. This ordinal number is used to distinguish the same or similar components from each other, and the meaning of the term should not be interpreted due to the ordinal number. For example, the components combined with the ordinal number should not be limited in the order of use or arrangement by the number. If necessary, each ordinal number may be used interchangeably.

In the present specification, a singular expression includes a plural expression unless the context clearly indicates otherwise. In this application, terms such as “comprises” or “consist of” are intended to indicate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, and that one or more other It should be understood that features or numbers, steps, operations, components, parts, or combinations thereof are not excluded in advance.

In an embodiment of the present invention, terms such as “module”, “unit”, and “part” are terms used to refer to a component that performs at least one function or operation, and the component is hardware or software. It can be implemented or can be implemented as a combination of hardware and software. In addition, a plurality of "modules", "units", "parts", etc., are integrated into at least one module or chip, except that each needs to be implemented with individual specific hardware. (Not shown).

In addition, in the embodiment of the present invention, when it is said that a part is connected to another part, this includes not only a direct connection, but also an indirect connection through another medium. In addition, the meaning that a part includes a certain component means that other components may be further included instead of excluding other components unless otherwise specified.

1A to 1C are diagrams for explaining an implementation example of a user terminal device according to an embodiment of the present invention.

1A to 1C, the user terminal device 100 may be implemented as a mobile phone such as a smart phone, but is not limited thereto, and is not limited to a tablet PC, smart watch, PMP, PDA, notebook PC, TV, HMD ( Head mounted Display), NED (Near Eye Display), etc. can be provided by the user, and any device with a display function can be applied without limitation.

The user terminal device 100 includes a liquid crystal display (LCD), organic light-emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), and quantum dot (QD) display to provide a display function It may be implemented to have various types of displays such as panels.

On the other hand, the user terminal device 100 according to an embodiment of the present invention senses the ambient light, and automatically adjusts the brightness of the display based on the sensed ambient light to provide an optimal brightness adjustment function to provide optimal display brightness. Can be prepared.

In order to execute the automatic luminance adjustment function, the user terminal device 100 according to the present invention may include illuminance sensors 10 and 20 on the front and rear surfaces, respectively, as illustrated in FIGS. 1A and 1B. For example, the illuminance sensor 10 provided on the front side may be disposed in a bezel area above the screen, and the illuminance sensor 20 provided on the back side may be disposed on the right side of the camera. However, this is an exemplary embodiment, and the illuminance sensors provided on the front and rear surfaces may be arranged at various positions within the front and rear surfaces. In some cases, it is also possible to be disposed on at least one of up, down, left, and right sides rather than the rear. Here, the side means a circumferential surface around the border where the power key shown in FIG. 1C is located. Typically, it means the side where Volume Key, Power Key, Usb Interface, Earphone Interface, etc. are located in modern mobile devices.

Accordingly, the user terminal device 100 according to an embodiment of the present invention can sense illuminances of different directions based on the user terminal device 100 as illustrated in FIG. 1C.

2 is a view for explaining a sensing coverage range when a plurality of illuminance sensors are provided in a user terminal device according to an embodiment of the present invention.

FIG. 2 shows a sensing coverage range when one illuminance sensor is disposed in a user terminal device 100 such as a mobile device and when two or more illuminance sensors are disposed. In particular, it represents a sensing coverage range when two or more illuminance sensors are arranged on the front / rear and front / side surfaces.

According to the drawing, the dark area represents an area where direct sunlight enters, and the hatched area represents a range sensed by each sensor.

In this case, the overlapping area of the dark area representing the area where sunlight enters and the hatched area representing the range sensed by each sensor is the sensing coverage area. Here, the% value means the sensing coverage ratio in each case. That is, when two or more sensors are arranged in the user terminal device 100 to sense the illuminance, when each sensor is disposed in the front / rear or front / side, it can be confirmed that the sensing coverage range is effective. However, in the case of the side surface, there may be limitations on the arrangement due to the design structure, so that the case where the illuminance sensor is disposed on the front and rear surfaces will be described below. The same algorithm and driving principle described in the present invention can be applied to the front / side.

Hereinafter, various embodiments of adjusting the brightness of the display using a plurality of illuminance sensors provided in the user terminal device 100 will be described.

3A is a block diagram showing the configuration of a user terminal device according to an embodiment of the present invention.

According to FIG. 3A, the user terminal device 100 includes a display 110, a first sensor 120, a second sensor 130, and a processor 140.

The display 110 may provide various content screens that can be provided through the user terminal device 100. Here, the content screen may include various content such as images, videos, text, and music, an application execution screen including various content, a GUI (Graphic User Interface) screen, and the like.

Meanwhile, the display 110 has various types of displays, such as a liquid crystal display, an organic light-emitting diode, liquid crystal on silicon (LCoS), and digital light processing (DLP), as described above. Can be implemented as In addition, the display 110 may be implemented with a transparent material and implemented with a transparent display for displaying information.

Meanwhile, the display 110 may be implemented in the form of a touch screen that forms a mutual layer structure with the touchpad, and in this case, the display 110 may be used as a user interface in addition to an output device.

The first sensor 120 is provided on the front of the user terminal device 100 to detect the irradiated light.

The first sensor 120 may detect at least one of various characteristics such as light intensity, intensity, color, incident direction, incident area, and distribution. Depending on the implementation example, the first sensor 120 may be an illuminance sensor, a temperature sensor, a light amount sensing layer, a camera, and the like.

In particular, the first sensor 120 may be implemented as an illuminance sensor that senses RGB light, but is not limited thereto, and any device capable of light sensing such as a white sensor, an IR sensor, or an IR + RED sensor is applicable.

In this case, the illuminance sensor may use various photocells, but it is also possible to use a photoelectric tube for measurement of very low illuminance. For example, the CDS illuminance sensor is provided in the user terminal device 100 to detect illuminance in both directions. In this case, the illuminance sensor may be installed in at least one preset region on both sides of the user terminal device 100, but it may also be installed in each pixel unit of both sides. For example, it is also possible to measure the illuminance state of each region or each pixel by installing an enlarged illuminance sensor so that the CMOS sensor corresponds to the size of the display 110.

For example, the CDS illuminance sensor detects the light around the user terminal device 100, and the A / D converter can convert the voltage obtained through the CDS illuminance sensor to a digital value and transmit it to the controller 140.

The second sensor 130 is provided on the rear surface of the user terminal device 100 to detect the irradiated light. However, according to another embodiment, the second sensor 130 may be disposed on at least one of the upper, lower, left, and right sides rather than the rear. In addition, the present invention is not limited thereto, and any other position may be applied as long as it can measure the illuminance in a different direction from the first sensor 120. For example, the second sensor 130 may be provided at a position capable of sensing illuminance in different directions of an angle that differs by more than 90 ° from the first sensor.

The second sensor 130 may detect at least one of various characteristics such as light intensity, intensity, color, incident direction, incident area, and distribution. According to the implementation example, the second sensor 130 may be an illuminance sensor, a temperature sensor, a light amount sensing layer, a camera, and the like.

In particular, the second sensor 130 may be implemented as an illuminance sensor that senses RGB light, but is not limited thereto. If the device is capable of light sensing, such as a White sensor, IR sensor, IR + RED sensor, HRM sensor, camera, etc. All are applicable.

The controller 140 controls the overall operation of the user terminal device 100.

The controller 140 adjusts the brightness of the display 110 based on the front illumination detected through the first sensor 120 and the rear illumination detected through the second sensor 130. The controller 140 may alternatively be defined in various terms such as a micro control unit, microcomputer, processor, CPU, and the like. In addition, the controller 140 may be implemented as an SoC in which an image processing algorithm is embedded, or may be implemented in the form of a field programmable gate array (FPGA). Here, the luminance adjustment method may be to change the output luminance value of the display 100 itself. That is, the brightness value of the backlight or OLED embedded in the display 110 may be adjusted. However, in some cases, a method of changing a pixel luminance value (or a digital gradation value of a pixel) by performing image processing on the displayed content itself may be used. However, in some cases, it is possible to additionally consider various surrounding environment information, such as the power state of the user terminal device 100, the state of the user (sleep, reading, etc.), place information, time information, etc. Do.

According to one embodiment, the controller 140 determines whether the illuminance space changes based on the instantaneous change amount of the front illuminance detected by the first sensor 120 and the instantaneous change amount of the rear illuminance detected by the second sensor 130. can do. When it is determined that the illuminance space has been changed, the controller 140 may adjust the brightness of the display 110 to correspond to the changed illuminance space. Here, the illuminance space may be a physically divided space. For example, it may be a physically separated space such as an office / lobby, a room / living room, indoor / outdoor. This makes the human Visual System (HVS) feel the same illuminance in the same space. For example, in the same office, it is considered to be a similar illuminance space because it is under an area with many lights or under an area with few lights. Accordingly, in one embodiment of the present invention, the same display luminance can be maintained within the same space, and the optimum luminance suitable for the space can be changed immediately or stepwise only when the space changes. However, in some cases, the illuminance space may mean a space providing a specific lighting environment. For example, if the office space in the company is very large, even in the same office space, a space that receives a lot of light because it is close to a window and a space that receives less light because it is far from the window can provide very different lighting environments. It can be a different illuminance space.

Specifically, the controller 140 determines that the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a predetermined threshold value, and that the illuminance space has changed and the illuminance space has changed if the directions of increase and decrease coincide. The brightness of the display 110 can be adjusted at a time point.

According to another embodiment, the controller 140 may determine a backlighting situation based on a comparison result of front and back illumination, and if it is determined to be backlighting, may adjust the brightness of the display to correspond to the backlighting situation.

Specifically, specifically, the controller 140 backlights based on at least one of a difference between a front illumination and a rear illumination, a ratio of the front illumination and a rear illumination, a ratio of the front illumination and a rear illumination, and a mathematical operation combination of the front illumination and the rear illumination. You can judge whether it is a situation. For example, the controller 140 may determine that the backlight is in a backlight situation when the back illumination is greater than a preset threshold than the front illumination. Alternatively, if the preset reference value for determining the backlighting condition is the front illuminance / rear illuminance = a, the controller 140 may determine that the backlight is a backlight condition when the front illuminance / rear illuminance <a. Here, the a value may be obtained by an experimental value or the like, or may be simply set to 1.

In addition, the controller 140 determines the intensity of backlight based on at least one of a ratio of front and back illumination, a difference between front and back illumination, and a mathematical combination of front and back illumination. can do. For example, the controller 140 may determine the intensity of the backlight with the value of “front illumination / rear illumination” or the intensity of the backlight with the value of “front illumination-rear illumination”.

On the other hand, if it is determined that the backlight 140 is the backlight, the controller 110 may adjust the brightness of the display 110 upward than the current brightness.

Specifically, if it is determined that the backlight condition is the backlight, the controller 140 may calculate an upward adjustment value of the luminance based on the intensity of the backlight. For example, the controller 140 may increase the upward adjustment value of luminance as the intensity of the backlight increases. This is because the greater the backlight intensity, the darker the display 110 provided on the front surface, and the more the visibility of the displayed image is reduced.

Alternatively, if it is determined that the backlight 140 is a backlighting situation, the controller 140 may adjust the brightness of the display 110 based on the back illumination. Specifically, if it is determined that the backlight 140 is in backlight, the controller 140 may calculate an upward adjustment value of luminance based only on the intensity of the back light.

Alternatively, the controller 140 may adjust the luminance of the display 110 to a luminance value calculated by applying a higher weight than the front illuminance to the back illuminance when it is determined that the backlight conditions.

In addition, the controller 140 may perform correction (eg, scaling) for the sensing value when necessary according to the implementation form of the first and second sensors. For example, when the second sensor is implemented as an HRM sensor, the controller 140 scales the sensing value sensed by the HRM sensor based on the lighting characteristics of the space in which the user terminal device 100 is located to the rear illuminance. Can be used. This will be described in detail later.

On the other hand, the controller 140 may adjust the luminance value when the ambient illuminance, that is, the front illuminance and the rear illuminance, satisfies a preset condition, and gradually increase the luminance value of the display 110 from the initial luminance value to the target luminance value. Can be adjusted to form. For example, if the display surrounding environment changes rapidly from a bright environment to a certain illuminance (for example, 100 lux) or less, when the display is switched from a dark screen to a bright screen under a certain illuminance, the ambient illuminance is less than a certain illuminance This may be the case when the display screen is switched from an inactive state to an activated state in a state.

Alternatively, the controller 140 divides the screen into at least one area and the remaining areas based on the properties of the content when the ambient light, that is, the front light and the back light, meets a preset condition, and determines the luminance value of each divided area. It can be controlled individually. Here, the luminance value of each region may include at least one of a maximum brightness value, a maximum color value, and an average brightness value of the content.

Specifically, the controller 140 may individually control the luminance of each region such that the luminance of the information displayed in at least one region is different from the luminance of the information displayed in the remaining regions. Alternatively, the controller 140 may individually control the luminance of each region such that the luminance of the information displayed in at least one region reaches the target luminance value before the luminance of the information displayed in the other regions. Here, the target luminance values of each region may be the same or different. Alternatively, the controller 140 may apply differently the shape of the gamma curve applied to at least one region and the shape of the gamma curve provided to the remaining regions. Here, the gamma curve (or gamma table) refers to a table representing a relationship between grayscale and display luminance of an image. For example, the gamma curve is an image based on when the user terminal device 100 emits light at the maximum luminance level. Means a table showing the relationship between gradation and display luminance. For example, if a gamma curve of the log type is applied to the region of interest, and an gamma curve of the exp function type is applied to the region of non-interest, the region of interest first appears first, and then the region of interest appears slowly. Lose.

Meanwhile, the controller 140 may provide a UI screen for adjusting the luminance value of the display 110 according to a preset event on one area of the display. Accordingly, when a user wishes to change the adjusted luminance value according to an embodiment of the present invention, the luminance value of the display may be manually adjusted through the UI screen. In this case, the controller 140 may provide a GUI indicating the original luminance value of the corresponding content on the UI screen. Accordingly, the user may appropriately adjust the luminance value of the display through the corresponding GUI.

On the other hand, in the above-described embodiments, it has been described that the controller 140 calculates a luminance adjustment value according to a preset formula, but this is only one embodiment, and the controller 140 calculates a luminance adjustment value based on pre-stored data. Of course you can. For example, the luminance adjustment values (eg, target luminance values or luminance values to be increased / decreased) corresponding to the number of cases according to the front illumination and the rear illumination are stored in the form of LUT, and based on the stored LUT, The corresponding luminance adjustment value can be selected.

3B is a block diagram showing the detailed configuration of the user terminal device shown in FIG. 3A.

According to FIG. 3B, the user terminal device 100 ′ includes a display 110, a first sensor 120, a second sensor 130, a controller 140, a storage unit 150, an audio processing unit 160 and video It includes a processing unit 170. Among the configurations shown in FIG. 3B, detailed descriptions of configurations overlapping with those shown in FIG. 3A will be omitted.

The controller 140 includes a RAM 141, a ROM 142, a main CPU 143, a graphics processor 144, first to n interfaces 145-1 to 135-n, and a bus 146.

The RAM 141, the ROM 142, the main CPU 143, the graphics processing unit 144, and the first to n interfaces 145-1 to 145-n may be connected to each other through the bus 146.

The first to n interfaces 145-1 to 145-n are connected to various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 143 accesses the storage unit 150 to boot using the O / S stored in the storage unit 140. Then, various operations are performed using various modules, programs, contents, data, etc. stored in the storage unit 150. In particular, an operation according to various embodiments of the present invention is performed based on the illuminance calculation module 154, the illuminance space determination module 155, the backlight situation determination module 156, and the luminance adjustment module 157 shown in FIG. can do.

The ROM 142 stores a set of instructions for booting the system. When a turn-on command is input and power is supplied, the main CPU 143 copies the O / S stored in the storage unit 150 to the RAM 141 according to the command stored in the ROM 142, and executes the O / S. Boot the system. When the booting is completed, the main CPU 143 copies various programs stored in the storage unit 150 to the RAM 141 and executes the programs copied to the RAM 141 to perform various operations.

The graphic processing unit 144 generates a screen including various objects such as icons, images, and text using an operation unit (not shown) and a rendering unit (not shown). The calculation unit (not shown) calculates attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen based on the received control command. The rendering unit (not shown) generates screens of various layouts including objects based on attribute values calculated by the calculation unit (not shown).

Meanwhile, the operation of the controller 140 described above may be performed by a program stored in the storage unit 150.

The storage unit 150 stores various data such as an O / S (Operating System) software module for driving the broadcast receiving device 200 and various multimedia contents. In particular, the storage unit 250 may store programs such as an illuminance calculation module, an illuminance space determination module, a luminance adjustment module, and luminance information according to illuminance and content characteristics. Hereinafter, detailed operations of the controller 140 using various programs stored in the storage unit 150 will be described in detail.

4 is a view for explaining various modules stored in the storage unit.

According to FIG. 4, the storage unit 130 includes a base module 151, a sensing module 152, a communication module 153, an illuminance calculation module 154, an illuminance space determination module 155, and a backlight determination module 156. And a software including a luminance adjustment module 157.

The base module 151 refers to a basic module that processes a signal transmitted from each hardware included in the user terminal device 100 ′ and transmits it to an upper layer module. The base module 141 is a storage module 141-1 that manages a database (DB) or registry, a security module that supports hardware certification, request permission, secure storage, etc. 141-2) and a network module 141-3 for supporting network connection.

The sensing module 152 is a module that collects information from various sensors and analyzes and manages the collected information. The sensing module 152 may also include an illumination detection module, a touch recognition module, a head direction recognition module, a face recognition module, a voice recognition module, a motion recognition module, and the like.

The communication module 153 is a module for performing communication with the outside. The communication module 153 is a device module used for communication with an external device, a messenger program, a messaging module such as a Short Message Service (SMS) & Multimedia Message Service (MMS) program, an email program, a Call Info Aggregator program And a telephone module including a module, a VoIP module, and the like.

The illuminance calculation module 154 is a module for calculating illuminance information according to the front illumination signal and the rear illumination signal detected through the first sensor 120 and the second sensor 130. To this end, the illuminance calculation module 154 may include a preset algorithm for converting the sensed illuminance signal into illuminance information that the controller 140 can determine.

The illuminance space determination module 155 determines a change in the illuminance space in real time based on the ambient illuminance calculated by the illuminance calculation module 154, that is, the front illuminance and the rear illuminance.

5A and 5B are diagrams illustrating a method of determining an illuminance space according to an embodiment of the present invention.

According to the illuminance space determination method of the illuminance space determination module 155 illustrated in FIG. 5A, an instantaneous change amount of illuminance measured by the first sensor 120 and an instantaneous change amount of illuminance measured by the second sensor 130 are compared. You can determine if the lighting environment has changed.

It is determined whether the lighting environment changes according to whether the instantaneous change amount of illuminance 511 measured by the first sensor 120 and the instantaneous change amount of illuminance 512 measured by the second sensor 130 satisfy a preset condition ( S520). Specifically, the controller 140 changes the instantaneous change amount of the illuminance 511 measured by the first sensor 120 and the instantaneous change amount of the illuminance 512 measured by the second sensor 130 by a certain threshold value or more, and increases or decreases. It is determined whether the direction of is coincident and whether the illuminance space is changed based on the determination result.

Particularly, when the instantaneous change amount of the illuminance 511 measured by the first sensor 120 and the instantaneous change amount of the illuminance 512 measured by the second sensor 130 change more than a specific threshold, and the direction of the increase or decrease is coincident. (530: Y) It is determined that the illuminance space has changed (550), and if not (530: N), it can be determined that the illuminance space has not changed (540).

For example, as shown in the table 520 illustrated as shown in FIG. 5B, the instantaneous change amount of the first sensor 120 increases above a certain threshold, and the instantaneous change amount of the second sensor 130 is specified. When it increases over a threshold value (if it is True in the table 520), it can be determined that the illuminance space has changed. Further, when the instantaneous change amount of the first sensor 120 decreases by a certain threshold or more, and when the instantaneous change amount of the second sensor 130 decreases by a certain threshold or more (when True in the table 520), it is determined that the illuminance space has changed. can do.

In this case, when the instantaneous change in illuminance measured by each sensor is positive, it is determined that the illuminance environment has changed from a relatively dark space to a bright space, and when the instantaneous change in illuminance measured by each sensor is negative, it is dark in a relatively bright space. It can be judged that the illuminance environment has changed with space. Here, a moment in which the instantaneous change amount is positive or negative may be a moment in which a spatial variation occurred.

As described above, when determining a change in the illuminance space using a plurality of illuminance sensors, it is possible to catch the moment when the lighting environment changes in real time. That is, although it was impossible to accurately catch the moment of change in the lighting environment only with the conventional single illuminance sensing, according to an embodiment of the present invention, it is possible to improve the sensing accuracy for the illuminance space change and shorten the measurement time. .

Returning to FIG. 4 again, the backlight determination module 156 determines the backlighting situation and the intensity of backlighting based on the ambient illumination calculated by the illumination calculation module 154, that is, front illumination and rear illumination.

6 and 7 are diagrams for explaining a backlight determination method according to an embodiment of the present invention.

As illustrated in FIG. 7, in a backlight situation, visibility of the front display is deteriorated due to light irradiated on the rear surface of the user terminal device 100. Accordingly, according to an embodiment of the present invention, the brightness of the display may be adjusted upward in a backlight situation.

According to the backlight determination method of the backlight determination module 156 shown in Figure 6, based on the size of the illuminance 611 measured by the first sensor 120 and the illuminance 612 measured by the second sensor 130 The backlight situation and backlight intensity can be determined. For example, a ratio of the illuminance 611 measured by the first sensor 120 and the illuminance 612 measured by the second sensor 130, and a mathematical calculation of the front / rear illuminance. The backlight situation and backlight intensity may be determined based on at least one of the combinations.

Specifically, the ratio of the illuminance 611 measured by the first sensor 120 to the illuminance 612 measured by the second sensor 130 is greater than a preset threshold (or is greater than or equal to a preset threshold), or the second When the value obtained by subtracting the illuminance 611 measured by the first sensor 120 from the illuminance 612 measured by the sensor 130 is greater than a preset threshold (or more than a preset threshold) 620 It can be judged as (630).

On the other hand, in this case, the intensity of the backlight is the ratio of the illuminance 611 measured by the first sensor 120 to the illuminance 612 measured by the second sensor 130 or the illuminance measured by the second sensor 130 ( It may be measured as a value obtained by subtracting the illuminance 611 measured by the first sensor 120 in 612, or a mathematical calculation combination of front / rear illumination.

The visibility of the display can be improved by calculating the luminance upward adjustment value or the target luminance value based on the calculated intensity of the backlight and adjusting the luminance upward based on the calculated value.

4, the luminance adjustment module 157 adjusts the luminance of the display 110 based on at least one of the output values of the illumination calculation module 145, the illumination space determination module 155, and the backlight determination module 156. You can.

8A and 8B are diagrams for describing a method of adjusting luminance according to various embodiments of the present invention.

8A assumes that the user moves within the office space, and in this case, the human Human Visual System (HVS) feels that the illuminance of the same space is all the same. As shown, it is considered to be under a place with many lights, under a place with few lights, or in the end it is the same office space, so it is a similar illuminance space. Accordingly, in 'the same space', homeostasis can be maintained with 'the same luminance'.

8B assumes that the user moves three different spaces. According to an embodiment of the present invention, as illustrated in FIG. 7A, the same display luminance is maintained within the same space, and only when the space changes, the luminance is optimally or stepwise changed to the optimum luminance suitable for the space.

3B, the user terminal device 100 'includes a touch sensor, a geomagnetic sensor, a gyro sensor, an acceleration sensor, a proximity sensor, and a grip sensor. Accordingly, the user terminal device 100 'may detect various manipulations such as touch, rotation, tilt, pressure, approach, and grip.

The touch sensor may be implemented in a capacitive or pressure-sensitive manner. The capacitive touch sensor refers to a sensor that uses a dielectric coated on a display surface to detect micro electricity excited by a user's body when a part of the user's body touches the display surface and calculates touch coordinates. The pressure-sensitive touch sensor includes two electrode plates embedded in the user terminal device 100, and when a user touches, touches a method of calculating touch coordinates by sensing that the upper and lower plates of the touched point are in contact and current flows. Means a sensor. In addition, an infrared detection method, a surface ultrasonic conduction method, an integral tension measurement method, a piezo effect method, and the like can be used to detect touch interaction.

In addition, the user terminal device 100 ′ may determine whether a touch object such as a finger or a stylus pen is in contact with or close to the touch sensor using a magnetic and magnetic field sensor, a light sensor, or a proximity sensor instead of the touch sensor.

The geomagnetic sensor is a sensor for detecting a rotation state and a moving direction of the user terminal device 100 '. The gyro sensor is a sensor for detecting the rotation angle of the user terminal device 100 '. Both the geomagnetic sensor and the gyro sensor may be provided, but even if only one of them is provided, the user terminal device 100 ′ may detect a rotation state.

The acceleration sensor is a sensor for detecting the degree of acceleration of movement in the X, Y, and Z axes of the user terminal device 100 '.

The proximity sensor is a sensor for detecting motion approaching without directly contacting the display surface. The proximity sensor forms a high-frequency magnetic field, a high-frequency oscillation type that senses a current induced by a magnetic field characteristic that changes when an object is approached, a magnetic type that uses a magnet, and a capacitive type that detects a change in capacitance due to the approach of an object It can be implemented with various types of sensors.

The grip sensor is a sensor that detects a user's grip by being disposed at the rear, rim, and handle parts separately from the touch sensor provided on the touch screen of the user terminal device 100 '. The grip sensor may be implemented as a pressure sensor in addition to the touch sensor.

In addition, the user terminal device 100 ′ includes an audio processing unit 160 that performs processing on audio data, a video processing unit 170 that performs processing on video data, and various audio data processed by the audio processing unit 160. In addition, it may further include a speaker (not shown) for outputting various notification sounds or voice messages, a microphone (not shown) for receiving user voice or other sound and converting it into audio data.

9A and 9B are diagrams for explaining a method of calculating illuminance according to an embodiment of the present invention.

According to an embodiment of the present invention, in measuring the illuminance, the user terminal devices 100 and 100 ′ may utilize tilt information sensed by a gyro sensor, a geomagnetic sensor, or an acceleration sensor.

Specifically, as illustrated in FIG. 9A, the measured illuminance may be corrected based on the sensing illuminance 911 and the tilt information 912 sensed by the gyro sensor, geomagnetic sensor, and acceleration sensor. Here, the illuminance information may be a single illuminance measured through the first sensor or the second sensors 120 and 130.

Specifically, an illuminance correction value corresponding to the slope information 912 may be obtained (920), and the sensing illuminance 911 may be corrected based on the obtained illuminance correction value (930).

For example, as illustrated in FIG. 9B, the illumination correction value for each gradient is stored in a lookup table form 925, and the measured measured illuminance value in real time is corrected based on the lookup table 925. You can. Here, the look-up table 925 may be individually provided for each sensor provided in the user terminal devices 100 and 100 '. For example, a corresponding look-up table may be provided based on sensing characteristics according to the sensor type, and a position where the sensor is provided. For example, a lookup table for illuminance correction measured by the first sensor 120 and a lookup table for illuminance correction measured by the second sensor 130 may be separately provided. The look-up table may be stored when the user terminal devices 100 and 100 'are manufactured, but may be provided or updated later by a server (not shown).

Meanwhile, the corrected illuminance may be calculated as “input illuminance * illuminance correction value for each slope”, but is not limited thereto, and may be calculated in various forms according to the shape of the illuminance correction value for each slope. For example, when the illuminance correction value for each slope is stored as the amount of illuminance to be added or subtracted, the corrected illuminance may be calculated in the form of "input illuminance ± illuminance correction value for each slope".

As described above, by using the gradient information when measuring the illuminance, it is possible to improve the accuracy of the illuminance measurement value.

10A and 10B are diagrams for describing an illuminance calculation method according to another embodiment of the present invention.

As shown in FIG. 10A, the illuminance may be calculated based on the illuminance 1011 measured by the first sensor 120, the illuminance 1012 measured by the second sensor 130, and the tilt information 1020. .

Specifically, a weight corresponding to each sensor corresponding to the tilt information 1020 may be obtained (1030), and illuminance may be estimated based on the obtained weight for each sensor (1040).

This is because the illuminance utilization value of the first sensor 120 and the second sensor 130 may vary according to the device tilt. For example, when the device is facing upward, the utilization value of the front illumination sensor is large, and when the device is facing downward, the utilization value of the rear illumination sensor is large. As such, the weights of summing two or more illuminance sensors can be differentiated according to the inclination of the device.

For example, as illustrated in FIG. 9B, the illuminance measured by the first sensor 120 and the second sensor 130 may be applied to each of the inclinations (eg, the X-axis angle) of the user terminal device 100. Different weights may be stored in a lookup table form 1035, and the measured measured illuminance values in real time may be corrected based on the lookup table 930. Here, the look-up table 1035 is an example, and may be implemented in various forms according to an embodiment. For example, a slope range to which the same weight is applied, a weight applied to each slope range, and the like may be set differently from the illustrated lookup table 1035. For example, there may be a method of switching to “100% front illumination / 0% rear illumination” or 0% front illumination / 100% rear illumination based on a specific slope.

Alternatively, the lookup table may be set in the form of a correction value to be adjusted according to the slope, not a weight form. The look-up table may be stored when the user terminal devices 100 and 100 'are manufactured, but may be provided or updated later by a server (not shown).

Meanwhile, the estimated illuminance may be calculated as “(α * first sensor illuminance) + (β * second sensor illuminance)” (where α and β are weights), but is not limited thereto. For example, when the luminance correction value for each slope is stored as the amount of illumination to be added or subtracted, the corrected illumination is "{(first sensor illumination-γ) + (second sensor illumination-δ)} / k" (here, Of course, γ and δ may be calculated in the form of correction values).

11 is a view for explaining an illuminance calculation method according to another embodiment of the present invention.

As illustrated in FIG. 11, illuminance may be calculated based on the sensing results of the proximity sensors provided on the front and rear surfaces provided with the first sensor 120 and the second sensor 130. For example, the proximity sensor provided on the rear surface may be an IR sensor or the like, but is not limited thereto. This is based on the principle of trusting the sensing data of the corresponding illuminance sensor only when there is no adjacent person or object, based on the fact that the reliability of the sensing data of the illuminance sensor is lowered when a person or object is in proximity.

As illustrated, when the proximity of the object is detected by the proximity sensor of the surface located at the first sensor 120 (1120: Y), the reliability of the illuminance 1011 sensed by the first sensor 120 is lowered. The illuminance 1011 sensed by the first sensor 120 can be utilized only when the proximity 1010 sensed by the sensor 120 is ignored (1130) and when no proximity is detected by the proximity sensor (1120: N). (1140).

Also, in the case of the second sensor 130, when the proximity of the object is detected (1250: Y) in the proximity sensor of the surface located in the second sensor 130, the illuminance 1012 sensed by the second sensor 130 Since the reliability of) is lowered, the illuminance 1011 sensed by the second sensor 130 is ignored (1255), and when the proximity is not detected by the proximity sensor (1240: N), sensing by the second sensor 130 Can utilize the roughness (1160).

Specifically, only when the proximity of the object is not detected on the surface where each sensor is provided, the illuminance 1011 sensed by the first sensor 120 and the illuminance 1112 sensed by the second sensor 130 may be utilized. As described with reference to 9a and 9b, the illuminance may be calculated in consideration of the gradient in various ways (1170).

12A and 12B are diagrams for explaining an implementation example of an illuminance sensor according to an embodiment of the present invention.

FIG. 12A is a view for explaining a case in which the HRM sensor provided on the back of a smart phone or the like is used as the second sensor 130 provided on the back, according to an embodiment of the present invention.

In general, HRM sensors sense a portion of visible light and a portion of infrared light for the purpose of measuring heart rate. However, as shown in FIG. 12A, the HRM sensor partially senses the visible light region. Accordingly, the HRM sensor may be used as a substitute for the second illuminance sensor 130.

Specifically, most indoor spaces consist of fluorescent lights and LED lights. In this case, as shown in FIG. 12B, since the fluorescent lamp and the LED light have almost no IR component, when sensing with HRM, only the visible light portion is sensed. That is, under fluorescent lighting and LED lighting, the HRM sensor has high reliability as an illuminance sensor. However, since sunlight and tungsten-based bulbs contain a lot of IR components, when sensing with an HRM sensor, the sensing value is large. In this case, the sensing value can be used by down-scaling. That is, when the HRM sensor is used as a rear illumination sensor, it is necessary to perform characteristic analysis on the light source in order to estimate the illumination. For example, it is possible to determine whether the lighting in the currently located space is a fluorescent lamp or an incandescent lamp and apply a scaling factor corresponding thereto.

13 is a view for explaining a method of estimating the illuminance in consideration of the type of a light source according to an embodiment of the present invention.

According to an embodiment of the present invention, when the front illuminance sensor is implemented as an RGB sensor and the rear illuminance sensor is implemented as an HRM sensor, the sensing value of the RGB sensor may be used to determine the type of light source in the user's space.

Specifically, as illustrated in FIG. 13, the R / G / B ratio is analyzed 1320 in the sensing value 1311 sensed by the RGB sensor to obtain a weight corresponding to the analyzed ratio, that is, the light source type (1330). ). In this case, a weight corresponding to the R / G / B ratio may be obtained based on predefined mapping information (for example, a graph mapping the R / G / B ratio and weight) as illustrated.

Subsequently, the obtained weight may be applied to the value 1312 sensed by the second sensor 130, that is, the HRM sensor to calculate the illuminance estimation value of the second sensor (1330). For example, the roughness estimation value may be calculated by multiplying the weight 1312 sensed by the HRM sensor by a weight.

For example, since the incandescent lamp (light bulb color) includes more red wavelength bands than the blue wavelength band, the R / B value is large in the value sensed by the first sensor 120, that is, the front RGB sensor. In this case, since the HRM sensing value is larger than the illuminance, the HRM sensor value can be corrected by reducing the applied weight. However, since the R / B value of the LED is sensed less than that of an incandescent lamp, in this case, the applied weight can be relatively large to estimate the illuminance from the HRM sensing value.

However, the above-described embodiment is only one embodiment, and in some cases, the value 1312 sensed by the HRM sensor may be used as an illuminance value without correction, or may be used as an illuminance value by simply scaling. For example, it is possible to calculate in the form of back illumination = back HRM sensing value * K (fixed simple scaling factor).

14 is a flowchart illustrating a method for adjusting luminance of a user terminal device according to an embodiment of the present invention.

The first sensor for sensing the light irradiated on the front of the user terminal device according to an embodiment of the present invention shown in Figure 14 and the second sensor provided on the back of the user terminal device for sensing the irradiated light is provided According to the luminance adjustment method of a user terminal device, first, the first sensor and the second sensor sense the light to be irradiated (S1410).

Subsequently, the brightness of the display provided on the front side is adjusted based on the front illumination detected through the first sensor and the rear illumination detected through the second sensor (S1420).

In addition, in step S1420 of adjusting the brightness of the display, it is determined whether the illuminance space is changed based on the instantaneous change amount of the front illuminance and the instantaneous change amount of the back illuminance. Brightness can be adjusted.

In addition, in the step S1420 of adjusting the brightness of the display, if the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a predetermined threshold value, and the direction of increase and decrease coincides, the illuminance space is determined to change and the illuminance space changes The brightness of the display can be adjusted when it is judged that it has been done.

In addition, in the step S1420 of adjusting the brightness of the display, when the instantaneous change amount of the front illuminance and the back illuminance is positive, it is determined that the illuminance space has changed from a relatively dark space to a bright space, and the instantaneous change amount of the front illuminance and the back illuminance In the case of a negative number, it can be determined that the illuminance space has changed from a relatively bright space to a dark space.

In addition, in step S1420 of adjusting the brightness of the display, the backlighting situation may be determined based on the comparison result of the front illumination and the rear illumination, and when it is determined that the backlighting situation is determined, the brightness of the display may be adjusted to correspond to the backlighting situation.

In addition, in the step S1420 of adjusting the brightness of the display, if it is determined that the backlight conditions, the brightness of the display may be adjusted higher than the current brightness.

In addition, in the step S1420 of adjusting the brightness of the display, when it is determined that the backlight is in the backlight state, the intensity of the backlight may be calculated, and an upward adjustment of the brightness may be calculated based on the intensity of the backlight.

In addition, in the step S1420 of adjusting the brightness of the display, based on at least one of a combination of mathematical operations of the ratio of the front illumination and the rear illumination, the difference between the front illumination and the rear illumination, and the front illumination and the rear illumination. The intensity of the backlight can be calculated.

In addition, in the step S1420 of adjusting the brightness of the display, if it is determined to be a backlight situation, the brightness of the display is adjusted with the brightness value calculated by adjusting the brightness of the display based on the back light intensity or applying a weight higher than the front light intensity to the back light intensity. I can adjust it.

As described above, according to various embodiments of the present invention, when measuring illuminance using an optical sensor, it is possible to minimize measurement errors and improve accuracy. That is, it is possible to optimally sense the illuminance by combining device tilt information and object proximity information using a plurality of illuminance data. Accordingly, high reliability illuminance sensing is possible even in various bad conditions such as a user's movement, tilt, and shadow.

In addition, it is possible to accurately catch the moment of change in illuminance space. In particular, the existing 'minimum required sensing delay time' in the development of the illuminance sensor can be significantly reduced. Accordingly, it is possible to develop a high-performance fast illuminance sensing device. Here, the 'minimum required sensing delay time' means that in order to avoid an instantaneous error occurring in the measurement according to the user's shadow or dynamic external environment, the sensing value is accumulated, or when the sensing value changes, the change is more than a certain time. It must be sustained to judge as a true value, which means the delay required to achieve this purpose.

In addition, physical optical sensing coverage can be expanded. In the form of using a diffuser mounted on a conventional single optical sensing, two or more sensors are used simultaneously, which has a great mechanical advantage in measurement direction and range.

In addition, it is possible to accurately detect the backlight situation and grasp the backlight intensity. Due to the nature of mobile electronic devices, there are many cases where they are placed in backlight situations. Particularly, mobile device users often face backlight situations in the daytime window. At this time, it is possible to secure optimal visibility when controlling the display luminance by accurately detecting the backlighting situation and backlighting intensity.

In addition, it is possible to control the optimal display luminance considering the human visual system. As described above, by maintaining luminance homeostasis in the same space and adjusting the luminance when transitioning to a space with different illuminance, optimal luminance control without a perceived visual disturbance is possible.

Meanwhile, a method for adjusting luminance of a user terminal device according to various embodiments described above may be implemented as a program and provided to the user terminal device.

For example, detecting light irradiated through a first sensor provided on a front surface of a user terminal device and a second sensor provided on a back surface, and detected through the front light intensity and the second sensor detected through the first sensor A non-transitory computer readable medium in which a program for performing a step of adjusting the brightness of the display based on the back illumination is stored may be provided.

The non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

110: display 120: first sensor
130: second sensor 140: controller

Claims (20)

In the user terminal device,
display;
A first sensor which is provided on the front surface of the user terminal device and senses the irradiated light;
A second sensor provided on the rear surface of the user terminal device to sense the irradiated light; And
It includes; a controller for adjusting the brightness of the display based on the front illumination detected through the first sensor and the rear illumination detected through the second sensor;
The controller,
A backlighting situation is identified based on the ratio of the detected front illuminance and the rear illuminance, and when the current situation is identified as the backlighting situation, the brightness of the display is calculated by applying a weight higher than the front illuminance to the rear illuminance. User terminal device for adjusting luminance. According to claim 1,
The controller,
A user terminal device for determining whether the illuminance space is changed based on the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance, and adjusting the brightness of the display to correspond to the changed illuminance space when it is determined that the illuminance space has changed. . According to claim 2,
The controller,
When the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a preset threshold value, and the direction of increase and decrease coincides, it is determined that the illuminance space has changed and the display is displayed when the illuminance space is determined to have changed. Adjusting the brightness of the user terminal device. According to claim 3,
The controller,
When the instantaneous change amount of the front illuminance and the rear illuminance is positive, it is determined that the illuminance space has changed from a relatively dark space to a bright space, and when the instantaneous change amount of the front illuminance and the rear illuminance is negative, the illuminance space is relatively bright. The user terminal device, which is judged to have changed into a dark space. delete According to claim 1,
The controller,
When it is determined that the backlighting situation, the user terminal device for adjusting the brightness of the display upward than the current brightness. The method of claim 6,
The controller,
When it is determined that the backlighting situation, the user terminal device for calculating the intensity of the backlight, and calculating the upward adjustment of the luminance based on the intensity of the backlight. The method of claim 7,
The controller,
The intensity of the backlight based on at least one of a ratio of the front illuminance and the rear illuminance, a difference between the front illuminance and the rear illuminance, and a preset mathematical operation combination of the front illuminance and the rear illuminance. The user terminal device for judging. delete According to claim 1,
The first sensor and the second sensor are implemented as at least one of an RGB sensor, a White sensor, an IR sensor, an IR + RED sensor, an HRM sensor, and a camera, respectively. According to claim 1,
The first sensor is implemented as an RGB sensor, the second sensor is implemented as an HRM sensor,
The controller is used to illuminate the rear side by scaling a sensing value sensed by the HRM sensor based on the lighting characteristics of the space where the user terminal device is located. In the brightness adjustment method of a user terminal device having a first sensor for detecting the light irradiated on the front of the user terminal device and a second sensor for detecting the light irradiated on the back of the user terminal device,
Sensing light emitted through the first sensor and the second sensor; And,
It includes; adjusting the brightness of the display provided on the front surface based on the front illumination detected through the first sensor and the rear illumination detected through the second sensor;
Adjusting the brightness of the display,
A backlight condition is identified based on the ratio of the sensed front illuminance and rear illuminance. When the current situation is identified as the backlight condition, the luminance of the display is calculated by applying a weight higher than the front illuminance to the rear illuminance. How to adjust the luminance. The method of claim 12,
Adjusting the brightness of the display,
Luminance adjustment method of determining whether the illuminance space is changed based on the instantaneous change amount of the front illuminance and the instantaneous change amount of the back illuminance, and adjusting the brightness of the display to correspond to the changed illuminance space when it is determined that the illuminance space has changed . The method of claim 13,
Adjusting the brightness of the display,
When the instantaneous change amount of the front illuminance and the instantaneous change amount of the rear illuminance are equal to or greater than a preset threshold value, and the direction of increase and decrease coincides, it is determined that the illuminance space has changed and the display is displayed when the illuminance space is determined to have changed. The brightness adjustment method of adjusting the brightness. The method of claim 14,
Adjusting the brightness of the display,
When the instantaneous change amount of the front illuminance and the rear illuminance is positive, it is determined that the illuminance space has changed from a relatively dark space to a bright space, and when the instantaneous change amount of the front illuminance and the rear illuminance is negative, the illuminance space is relatively bright. The brightness adjustment method is judged as being changed to a dark space. delete The method of claim 12,
Adjusting the brightness of the display,
If it is judged that the backlighting situation, the brightness adjustment method of adjusting the brightness of the display upward than the current brightness. The method of claim 17,
Adjusting the brightness of the display,
If it is judged that the backlighting situation, the intensity of the backlight is calculated, and the luminance adjustment method is calculated based on the intensity of the backlight. The method of claim 18,
Adjusting the brightness of the display,
The backlight is based on at least one of a ratio of the front illuminance and the rear illuminance, a difference between the front illuminance and the rear illuminance, and a preset mathematical operation combination of the front illuminance and the rear illuminance. A method for adjusting luminance, for calculating intensity. Performing a method of controlling luminance of a user terminal device having a first sensor that is provided on the front of the user terminal device to sense the irradiated light and a second sensor that is provided on the rear side of the user terminal device and detects the irradiated light In the recording medium is stored a program for doing,
The above method,
Sensing light emitted through the first sensor and the second sensor; And,
It includes; adjusting the brightness of the display provided on the front surface based on the front illumination detected through the first sensor and the rear illumination detected through the second sensor;
Adjusting the brightness of the display,
A backlight condition is identified based on the ratio of the sensed front illuminance and rear illuminance. When the current situation is identified as the backlight condition, the luminance of the display is calculated by applying a weight higher than the front illuminance to the rear illuminance. Recording media to adjust them.

Images