CN114615395A - Off-screen camera device, display equipment and method for generating image by off-screen camera device - Google Patents

Abstract

The embodiment of the present disclosure provides a camera device under screen, which includes: the system comprises a plurality of under-screen cameras and an arithmetic unit, wherein the under-screen cameras are adjacently arranged; the plurality of adjacently arranged under-screen cameras comprise a black-and-white camera and a plurality of monochromatic cameras; each monochromatic camera is used for generating a monochromatic image, and the corresponding colors of all the monochromatic cameras form a primary color system; the black and white camera is used for generating a brightness image; and the operation unit is used for generating an output image according to the monochrome images generated by all the monochrome cameras and the brightness images generated by the black-and-white cameras. The embodiment of the disclosure also provides a display device and a method for generating an image by the under-screen camera device.

Description

Off-screen camera device, display equipment and method for generating image by off-screen camera device

Technical Field

The embodiment of the disclosure relates to the technical field of display, and in particular relates to an off-screen camera device, display equipment and an image generating method of the off-screen camera device.

Background

The high screen ratio is an important development direction of display equipment (such as a terminal), and the under-screen camera is taken as a technical scheme which can maximize the screen ratio, so that the method has important research significance.

Although the ratio of the screen to the screen can be increased, the photographing effect of the under-screen camera is inferior to that of a common camera.

Disclosure of Invention

The embodiment of the disclosure provides an off-screen camera device, a display device and a method for generating an image by the off-screen camera device.

In a first aspect, an embodiment of the present disclosure provides an off-screen image capturing apparatus, which includes: the system comprises a plurality of under-screen cameras and an arithmetic unit, wherein the under-screen cameras are adjacently arranged;

the plurality of adjacently arranged under-screen cameras comprise a black-and-white camera and a plurality of monochromatic cameras;

each monochromatic camera is used for generating a monochromatic image, and the corresponding colors of all the monochromatic cameras form a primary color system;

the black and white camera is used for generating a brightness image;

and the operation unit is used for generating an output image according to the monochrome images generated by all the monochrome cameras and the brightness images generated by the black-and-white cameras.

In some embodiments, each of the off-screen cameras includes a lens, a sensor array; the pixels corresponding to the sensor arrays of all the cameras under the screen are arranged consistently, and the lenses are used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array is used for receiving the imaging light rays and generating images based on the imaging light rays.

In some embodiments, each monochrome camera includes a lens, a color filter, a sensor array, the sensor array being a black and white sensor array; the lens is used for receiving light rays and generating imaging light rays based on the received light rays; the color filter is used for filtering the imaging light and generating monochromatic imaging light, and the color of the color filter of each monochromatic camera is the color corresponding to the monochromatic camera; the sensor array is used for receiving the monochromatic imaging light and generating a monochromatic image based on the monochromatic imaging light.

In some embodiments, the plurality of adjacently arranged under-screen cameras includes a red camera, a green camera, a blue camera, and a black and white camera.

In some embodiments, said generating an output image from all of said monochrome images and said luminance image comprises: generating a color image from all of the monochrome images; and adjusting the brightness of the color image according to the brightness image to generate an output image.

In some embodiments of the present invention, the,

each under-screen camera comprises a lens and a sensor array; the lens is used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array is used for receiving the imaging light rays and generating an image based on the imaging light rays; the under-screen camera device further comprises a motor coil; and the motor coil is used for controlling the lenses of all the under-screen cameras to be away from or close to the corresponding sensor array.

In some embodiments, the off-screen camera further comprises a protective case; all under-screen cameras are located in the protective shell.

In a second aspect, embodiments of the present disclosure provide a display apparatus, including:

a screen;

and any one of the above-mentioned under-screen camera devices.

In some embodiments, the display device is a terminal.

In a third aspect, an embodiment of the present disclosure provides a method for generating an image by an off-screen imaging device, where the off-screen imaging device is any one of the above-mentioned off-screen imaging devices, and the method includes:

acquiring the black-and-white image and all the monochrome images;

an output image is generated from all of the monochrome images and the luminance image.

In the method for generating the image by using the under-screen camera, the display device and the under-screen camera according to the embodiment of the disclosure, the output image is obtained by using the monochrome images generated by the plurality of monochrome cameras and the luminance image generated by the single black-and-white camera, and the luminance performance of the generated color image is improved by using the luminance image, so that the color image with good luminance performance can still be obtained under the condition that the quantity of light entering the under-screen camera is greatly compressed.

Drawings

In the drawings of embodiments of the disclosure:

fig. 1 is a block diagram of an off-screen camera device according to an embodiment of the present disclosure;

fig. 2 is a schematic position diagram of a plurality of off-screen cameras of an off-screen camera device according to an embodiment of the present disclosure;

fig. 3 is a schematic composition diagram of an off-screen camera device according to an embodiment of the present disclosure;

fig. 4 is a schematic composition diagram of a display device according to an embodiment of the disclosure;

fig. 5 is a flowchart of a method for generating an image by an off-screen camera device according to an embodiment of the present disclosure;

fig. 6 is a flowchart of another method for generating an image by an off-screen image capturing apparatus according to an embodiment of the present disclosure.

Detailed Description

In order to make those skilled in the art better understand the technical solutions of the embodiments of the present disclosure, the following describes in detail the off-screen image capturing apparatus, the display device, and the method for generating an image by the off-screen image capturing apparatus provided in the embodiments of the present disclosure with reference to the accompanying drawings.

The disclosed embodiments will be described more fully hereinafter with reference to the accompanying drawings, but the illustrated embodiments may be embodied in different forms and should not be construed as limited to the embodiments set forth in the disclosure. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The accompanying drawings, which are included to provide a further understanding of the disclosed embodiments and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. The above and other features and advantages will become more readily apparent to those skilled in the art from the detailed description of exemplary embodiments that proceeds with reference to the accompanying drawings,

embodiments of the present disclosure may be described with reference to plan and/or cross-sectional views in light of idealized schematic illustrations of the present disclosure. Accordingly, the example illustrations can be modified in accordance with manufacturing techniques and/or tolerances.

Embodiments of the present disclosure and features of embodiments may be combined with each other without conflict.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure, the term "and/or" includes any and all combinations of one or more of the associated listed items. As used in this disclosure, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises," "comprising," "made from … …," as used in this disclosure, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

Unless otherwise defined, all terms (including technical and scientific terms) used in this disclosure have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

The disclosed embodiments are not limited to the embodiments shown in the drawings, but include modifications of configurations formed based on a manufacturing process. Thus, the regions illustrated in the figures have schematic properties, and the shapes of the regions shown in the figures illustrate specific shapes of regions of elements, but are not intended to be limiting.

The under-screen camera utilizes a screen, such as an Active-matrix Organic Light-emitting Diode (AMOLED) screen, having a certain Light transmittance, and a camera (including a front camera and a rear camera) disposed below the screen, wherein when a user uses the front camera to take a picture, a screen area corresponding to the front camera does not display an image and serves as a Light inlet of the front camera.

The light transmittance of the AMOLED screen is low and is only about 10%, so that the quantity of light entering the camera under the screen is greatly compressed, and the photographing effect of the camera under the screen is influenced.

In some related arts, the number of lights entering the camera under the screen is increased by improving the light transmittance of the screen, and the photographing effect of the camera under the screen is improved.

For example, the polarizing function of the polarizer corresponding to the screen area of the under-screen camera is disabled through means such as heat treatment, or the polarizer is directly cut off, so that the absorption of the polarizer to light rays is reduced, and more light rays enter the under-screen camera.

However, when the absorption of the polarizing film to light is reduced, the reflection of the screen to ambient light is also enhanced, so that the contrast of the screen area corresponding to the camera under the screen is poor, and under the condition of high ambient light brightness, the display effect of the screen area corresponding to the camera under the screen is obviously reduced, and the display effect of the screen is seriously affected.

In other correlation techniques, the shooting effect of the camera under the screen is improved by improving the capability of the sensor array of the camera under the screen to collect light.

If a color wheel is arranged between a lens of the camera under the screen and the sensor array, red, blue and green areas on the color wheel respectively pass through the sensor array along with the rotation of the color wheel, so that the sensor array collects three images with different colors of red, blue and green, and the three images can be synthesized into a color image, namely a final output image.

Because the image of only one color needs to be acquired in the process of acquiring the image once, each pixel of the sensor array does not need to be divided into red, blue and green sub-pixels, and compared with a common camera without a color wheel (each pixel of the sensor array needs to be divided into three sub-pixels of red, blue and green), under the condition of the same size of the sensor array, the area of each pixel of the sensor array of the camera under the screen provided with the color wheel is obviously larger, and the capacity of acquiring light rays is obviously stronger.

However, the color wheel is mounted on the under-screen camera, so that the structure of the under-screen camera becomes complex, and the manufacturing process of the under-screen camera becomes complex; meanwhile, three images with different colors are acquired in a short time, so that the acquisition frequency of the sensor array is higher than that of the sensor array of a common camera, correspondingly, for each image, the corresponding acquisition time is shortened, the number of acquired light rays is reduced, and the photographing effect of the camera under the screen is influenced.

In view of this, the embodiments of the present disclosure provide an off-screen image capturing apparatus, a display apparatus, and a method for generating an image by an off-screen image capturing apparatus.

In a first aspect, referring to fig. 1, an embodiment of the present disclosure provides an off-screen image capturing apparatus 1, including: a plurality of under-screen cameras 11 arranged adjacently, and an arithmetic unit 12;

the plurality of adjacently arranged under-screen cameras 11 comprise a black-and-white camera 112 and a plurality of monochromatic cameras 111;

each monochromatic camera 111 is used for generating a monochromatic image, and the monochromatic colors corresponding to all the monochromatic cameras 111 form a primary color system;

the black-and-white camera 112 is used for generating a brightness image;

and an arithmetic unit 12 for generating an output image from the monochrome images generated by all the monochrome cameras 111 and the luminance image generated by the monochrome camera 112.

The off-screen camera device 1 of the embodiment of the present disclosure includes a plurality of off-screen cameras 11, and one black-and-white camera 112 and a plurality of monochrome cameras 111 exist in the plurality of off-screen cameras 11.

The monochrome camera 112 refers to a camera that generates a grayscale image (or a luminance image).

The monochrome camera 111 refers to a camera that generates an image that is a monochrome image (i.e., only one color in the image), where each monochrome camera 111 corresponds to one color, and the colors corresponding to all the monochrome cameras 111 included in the under-screen imaging device 1 according to the embodiment of the present disclosure form a primary color system, that is, the color corresponding to each monochrome camera 111 is a primary color, and other colors can be obtained by mixing the colors corresponding to the monochrome cameras 111, for example, the monochrome camera 111 is a red camera, a blue camera, and a green camera.

Through setting up camera 11 under a plurality of screens, increase and get into camera 11's total income light quantity under the screen, just also promoted the image effect of the image that acquires, and compare with camera expansion multifold under a screen, set up camera easier realization under a plurality of screens, the cost is also lower.

The plurality of under-screen cameras 11 of the under-screen camera device 1 according to the embodiment of the present disclosure are arranged adjacently, and specifically, the plurality of under-screen cameras 11 may be arranged in a rectangle with an aspect ratio closest to 1.

As shown in fig. 2, when the number of the off-screen cameras is 4, the 4 off-screen cameras are adjacently arranged in a square (2 rows are adjacently arranged, and 2 off-screen cameras are adjacently arranged in each row); when the number of the under-screen cameras is 6, the 6 under-screen cameras are adjacently arranged in 2 lines, and each line is adjacently arranged with 3 under-screen cameras; when the number of the under-screen cameras is an odd number (if n, n is an odd number larger than 1), n-1 under-screen cameras are firstly arranged, and after the arrangement is finished, the last camera is placed at the adjacent position of the under-screen camera corresponding to the rectangular right angle formed by the n-1 under-screen cameras.

The adjacent arrangement means that the distance between the cameras 11 under the screen is as small as possible within a safe distance which does not affect the normal work of the cameras under the screen.

Obviously, if there is a certain distance between the off-screen cameras, only a few pixels (even no pixels) in the images generated by the different off-screen cameras correspond to each other, so that for most of the pixels of the output image, all the primary colors corresponding to the pixels cannot be obtained, and the corresponding real color cannot be obtained.

The closer the distance between the cameras under the screen is, the more consistent the light rays received by the cameras are, the more consistent the generated images are, the more pixels of the images shot by different cameras can correspond to each other, so that all primary colors corresponding to the more pixels can be obtained, the corresponding real color of the primary colors can be obtained, and the output image can be generated.

The off-screen image pickup apparatus 1 of the embodiment of the present disclosure further includes an arithmetic unit 12, and the arithmetic unit 12 is configured to generate a final output image of the off-screen image pickup apparatus 1 from the monochrome image generated by the monochrome camera 111 and the luminance image generated by the black camera 112.

Since the colors corresponding to all the monochrome cameras 111 form a primary color system, a color image can be generated by the monochrome images corresponding to all the monochrome cameras 111, and the gray level image or the luminance image generated by the black camera 112 has better luminance performance than the color image, and can be used for improving the image effect of the generated color image to improve the image effect, especially the output image with better image effect in dark.

In the under-screen camera device according to the embodiment of the present disclosure, the monochrome images generated by the plurality of monochrome cameras and the luminance image generated by the single monochrome camera acquire the output image, and the luminance image has a better luminance expression compared to the color image, and the luminance expression of the generated color image is improved by the luminance image, so that the color image with good luminance expression can still be acquired under the condition that the amount of light entering the under-screen camera is greatly compressed.

In some embodiments, referring to fig. 3, each underscreen camera 11 includes a lens 01, a sensor array 03; the pixels corresponding to the sensor arrays 03 of all the under-screen cameras 11 are arranged in a consistent manner; the lens 01 is used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array 03 is configured to receive the imaging light and generate an image based on the imaging light.

Each of the off-screen cameras 11 of the off-screen image pickup apparatus 1 of the embodiment of the present disclosure includes a lens 01 and a sensor array 03.

The lens 01 is used for receiving light transmitted through the screen and generating imaging light based on the received light.

The sensor array 03 is configured to receive the imaging light and generate an image using the imaging light. The sensor array 03 is an array of photodiodes arranged in a pattern corresponding to the pixel pattern of the image produced by the sensor array.

The pixel arrangement corresponding to the sensor arrays 03 of all the off-screen cameras 11 of the off-screen image capturing apparatus 1 according to the embodiment of the present disclosure is uniform, that is, the number of pixels of the image generated by the sensor arrays 03 of all the off-screen cameras 11 is completely uniform in the horizontal direction and the vertical direction.

In the case where the pixel arrangements of the images generated by the sensor arrays 03 of all the underscreen cameras 11 are completely the same, when the arithmetic unit 12 generates the final output image from the monochrome image and the luminance image, the pixel value of the first pixel at the upper left corner of the final output image can be calculated from the pixel value at the position of each image by directly using the pixels at the same position (for example, the first pixel at the upper left corner) of the images generated by all the sensor arrays 03 as a group.

In some embodiments, referring to fig. 3, each monochrome camera 111 includes a lens 01, a color filter 02, a sensor array 03, the sensor array 03 being a black and white sensor array;

the lens 01 is used for receiving light rays and generating imaging light rays based on the received light rays;

the color filter 02 is used for filtering imaging light and generating monochromatic imaging light, and the color filter 01 of each monochromatic camera 111 is the color corresponding to the monochromatic camera 111;

the sensor array 03 is configured to receive monochromatic imaging light and generate a monochromatic image based on the monochromatic imaging light.

Each monochrome camera 111 of the under-screen image pickup apparatus 1 of the embodiment of the present disclosure includes a lens 01, a color filter 02, and a sensor array 03.

The lens 01 is used for receiving light transmitted through the screen and generating imaging light based on the received light.

The color filter 02 can be installed on the sensor array 03, and the color thereof is the color corresponding to the monochrome camera, and is used for filtering out the light rays of other colors except the light rays of the color corresponding to the monochrome camera in the imaging light rays and generating the monochrome imaging light rays of the color corresponding to the monochrome camera.

The sensor array 03 is a black-and-white sensor array and is configured to generate a monochromatic image according to monochromatic imaging light.

Since the sensor array 03 is a black-and-white sensor array, a luminance image can be obtained without adding a color filter between the lens 01 of the black-and-white camera 112 and the sensor array 03. Of course, a transparent color filter can also be added between the lens of the black-and-white camera and the sensor array.

The single-color camera formed by the lens 01, the color filter 02 and the black-and-white sensor array 03 belongs to a mature process, and is simple to realize and low in cost.

In some embodiments, the plurality of adjacently arranged under-screen cameras includes a red camera, a green camera, a blue camera, and a black and white camera.

The plurality of off-screen cameras of the off-screen camera device 1 according to the embodiment of the present disclosure are a red camera, a green camera, a blue camera, and a black-and-white camera, respectively.

Specifically, the sensor array of the 4 cameras is composed of 4 black-and-white sensors with corresponding pixels arranged completely in the same manner, wherein red, blue and green color filters are respectively mounted on the sensor arrays of the red camera, the green camera and the blue camera.

The red camera, the green camera and the blue camera are monochrome cameras, the corresponding red, blue and green are the primary colors which are most widely and mature in application, and the colors which can be synthesized are also the most widely, so that the image effect of the color image obtained by using the red camera, the green camera and the blue camera is better than the color image obtained by using other primary color cameras.

In some embodiments, generating an output image from all monochrome images and luminance images comprises:

generating a color image from all the monochrome images;

and adjusting the brightness of the color image according to the brightness image to generate an output image.

Because the colors corresponding to all the monochrome cameras 111 form a primary color system, a color image can be generated by the monochrome images corresponding to all the monochrome cameras 111, and the gray level image or the luminance image generated by the black camera 112 has better luminance expression compared with the color image, and can be used for improving the detail expression of the generated color image under dark light and improving the image effect of the color image.

Specifically, the sharpness of the edge of the object in the image is determined by the luminance image generated by the black-and-white camera 112, and the obtained sharpness result of the edge of the object is synthesized with the color image generated by the monochrome images corresponding to all the monochrome cameras 111, so that the image effect of the color image, especially the image effect of the color image in the dark light, is improved.

In some embodiments, referring to fig. 3, each underscreen camera 11 includes a lens 01, a sensor array 03; the lens 01 is used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array 03 is used for receiving the imaging light and generating an image based on the imaging light;

the under-screen camera 1 further includes a motor coil 13; the motor coils 13 are used for controlling the lenses 01 of all the under-screen cameras 11 to simultaneously move away from or close to the corresponding sensor arrays 03.

In some embodiments, the underscreen camera 1 further includes a protective case 14; all the underscreen cameras 11 are located within a protective case 14.

Referring to fig. 3, the under-screen image capturing apparatus 1 according to the embodiment of the present disclosure includes a plurality of under-screen cameras 11 (e.g., a red camera, a blue camera, a green camera, and a black-and-white camera), an arithmetic unit 12, a motor coil 13, and a protective case 14.

The protective housing 14 is used for protecting the cameras under the screen, all the cameras 11 under the screen are located in the protective housing 14, each camera 11 under the screen comprises a lens 01 and a sensor array 03, and a corresponding color filter 02 is further arranged on the sensor array of the monochrome camera (such as a red camera, a blue camera and a green camera). The motor coils 13 are used for controlling the lenses 01 of all the under-screen cameras 11 to be away from or close to the corresponding sensor arrays 03 at the same time, so as to achieve the effect of adjusting the focal length.

It should be noted that, when the underscreen camera device 1 is viewed from the side, only the side surfaces of the plurality of underscreen cameras 11 (i.e. the side views of the underscreen cameras 11) can be seen, and the lenses 01 of all the underscreen cameras 11 cannot be seen at the same time as shown in fig. 3 (similarly, the color filters 02 and the sensor arrays 03 of all the underscreen cameras 11 cannot be seen at the same time), but for convenience of description, the lenses 01 of all the underscreen cameras 11 are drawn in fig. 3 (i.e. the top view of the underscreen cameras 11 is used to replace the side views of the underscreen cameras).

Specifically, the working process of the off-screen camera device 1 according to the embodiment of the present disclosure is as follows:

light enters the lens 01 of the under-screen camera 11 through the screen, the under-screen camera 11 generates imaging light according to the entering light, the imaging light generates monochromatic imaging light through the color filter 02 (for a black-and-white camera, the imaging light directly irradiates on the sensor array 03) and irradiates on the corresponding sensor array 03, and the sensor array 03 generates a red image, a blue image, a green image and a black-and-white image according to the received light and sends the red image, the blue image, the green image and the black-and-white image to the arithmetic unit 12.

The sensor arrays 03 of the various under-screen cameras 11 are arranged in a consistent manner, so that the pixels of the generated images are also arranged in a consistent manner, the operation unit 12 corresponds the pixels at the transverse and longitudinal positions of the various images one by one, a color image is synthesized according to the red image, the blue image and the green image, under the condition that the light of the color image is dark, the operation unit 12 judges the sharpness of the edge of an object in the image according to the brightness image generated by the black-and-white sensor, and the obtained sharpness result is synthesized with the color image so as to improve the image taking effect of the color image under the dark light.

In a second aspect, referring to fig. 4, an embodiment of the present disclosure provides a display apparatus, including:

a screen;

and any one of the above-described under-screen image pickup apparatuses 1.

In some embodiments, the display device of the embodiments of the present disclosure is specifically a terminal.

Specifically, the screen of the display device in the embodiment of the present disclosure is an AMOLED screen, and referring to fig. 4, the components of the AMOLED screen include: transparent substrate, anode, organic light-emitting material layer, and cathode

The anode provides a "hole" for the organic light emitting material layer, the anode uses a transparent conductive material ITO (Indium Tin Oxides), the cathode provides electrons for the organic light emitting material layer, and the cathode also uses a transparent conductive material. The organic light-emitting material layer is composed of organic light-emitting material molecules, and can combine electrons injected from the cathode and holes injected from the anode to form excitons under the driving of external voltage, and the excitons are radiated and excited to emit photons to generate visible light.

The specific material of transparent substrate can be plastics or glass, and the attached shading bubble of transparent substrate's back is cotton, and the cotton part hole of digging of shading bubble forms the permeable light region, and light just so can get into camera under the screen through the cotton hole region of digging of negative pole, organic luminescent layer, positive pole, transparent substrate and shading bubble of screen in proper order.

In the display device of the embodiment of the disclosure, the monochrome images generated by the plurality of monochrome cameras and the luminance image generated by the one monochrome camera are used to obtain the output image, and the luminance image has better luminance expression compared with the color image, and the luminance expression of the generated color image is improved by the luminance image, so that the color image with good luminance expression can still be obtained under the condition that the quantity of light entering the camera under the screen is greatly compressed.

In a third aspect, with reference to fig. 5, an embodiment of the present disclosure provides a method for an off-screen imaging apparatus to generate an image, where the off-screen imaging apparatus is any one of the off-screen imaging apparatuses 1, and the method includes:

s101, acquiring a black-and-white image and all monochrome images.

And S102, generating an output image according to all the monochrome images and the brightness images.

In some embodiments, referring to fig. 6, generating an output image from all monochrome images and luminance images (S102) includes:

and S1021, generating a color image according to all the monochrome images.

S1022, the luminance of the color image is adjusted according to the luminance image, and an output image is generated.

The operation unit generates a color image through all the monochrome images, improves the detail expression of the generated color image under dark light according to the gray image, improves the image effect of the color image, generates an output image, and stores and outputs the output image.

Specifically, the sharpness of the edge of the object in the image is judged through the brightness image, and the obtained sharpness result of the edge of the object is synthesized with the color image generated through all the monochrome images, so that the image effect of the color image, especially the image effect of the color image under the dark light, is improved.

According to the method for generating the image by the under-screen camera device, the output image is obtained through the monochrome images generated by the plurality of monochrome cameras and the brightness image generated by the black and white camera, and the brightness performance of the generated color image is improved through the brightness image by utilizing the characteristic that the brightness image has better brightness performance compared with the color image, so that the color image with good brightness performance can still be obtained under the condition that the quantity of light entering the under-screen camera is greatly compressed.

One of ordinary skill in the art will appreciate that all or some of the steps, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof.

In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation.

Some or all of the physical components may be implemented as software executed by a processor, such as a Central Processing Unit (CPU), digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), FLASH memory (FLASH), or other disk storage; compact disk read only memory (CD-ROM), Digital Versatile Disk (DVD), or other optical disk storage; magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage; any other medium which can be used to store the desired information and which can be accessed by the computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.

The present disclosure has disclosed example embodiments and, although specific terms are employed, they are used and should be interpreted in a generic and descriptive sense only and not for purposes of limitation. In some instances, features, characteristics and/or elements described in connection with a particular embodiment may be used alone or in combination with features, characteristics and/or elements described in connection with other embodiments, unless expressly stated otherwise, as would be apparent to one skilled in the art. It will, therefore, be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the disclosure as set forth in the appended claims.

Claims (10)

1. An under-screen camera device, comprising: the system comprises a plurality of under-screen cameras and an arithmetic unit, wherein the under-screen cameras are adjacently arranged;

the plurality of adjacently arranged under-screen cameras comprise a black-and-white camera and a plurality of monochromatic cameras;

each monochromatic camera is used for generating a monochromatic image, and the corresponding colors of all the monochromatic cameras form a primary color system;

the black and white camera is used for generating a brightness image;

and the operation unit is used for generating an output image according to the monochrome images generated by all the monochrome cameras and the brightness images generated by the black and white cameras.

2. The off-screen camera device of claim 1, wherein each off-screen camera comprises a lens, a sensor array; the pixels corresponding to the sensor arrays of all the under-screen cameras are arranged consistently, and the lenses are used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array is used for receiving the imaging light and generating an image based on the imaging light.

3. The device of claim 1, wherein each monochrome camera comprises a lens, a color filter, a sensor array, the sensor array being a black and white sensor array;

the lens is used for receiving light rays and generating imaging light rays based on the received light rays;

the color filter is used for filtering the imaging light and generating monochromatic imaging light, and the color of the color filter of each monochromatic camera is the color corresponding to the monochromatic camera;

the sensor array is used for receiving the monochromatic imaging light and generating a monochromatic image based on the monochromatic imaging light.

4. The device of claim 1, wherein the plurality of adjacently arranged under-screen cameras comprises a red camera, a green camera, a blue camera, and a black and white camera.

5. The underscreen camera device of claim 1, wherein said generating an output image from all of said monochrome images and said luminance image comprises:

generating a color image from all of the monochrome images;

and adjusting the brightness of the color image according to the brightness image to generate an output image.

6. The off-screen camera device of claim 1, wherein each off-screen camera comprises a lens, a sensor array; the lens is used for receiving light rays and generating imaging light rays based on the received light rays; the sensor array is used for receiving the imaging light rays and generating an image based on the imaging light rays;

the under-screen camera device further comprises a motor coil;

and the motor coil is used for controlling the lenses of all the under-screen cameras to be away from or close to the corresponding sensor arrays.

7. The device of claim 1, further comprising a protective case; all under-screen cameras are located in the protective shell.

8. A display apparatus, comprising:

a screen;

and an under-screen camera apparatus as claimed in any one of claims 1 to 7.

9. The display device of claim 8, wherein the display device is a terminal.

10. A method of generating an image by an off-screen camera device, the off-screen camera device of any one of claims 1 to 7, the method comprising:

acquiring the black-and-white image and all the monochrome images;

an output image is generated from all of the monochrome images and the luminance image.

Images