CN106210677A - Image color processing method, device and terminal unit - Google Patents
Image color processing method, device and terminal unit Download PDFInfo
- Publication number
- CN106210677A CN106210677A CN201610615539.7A CN201610615539A CN106210677A CN 106210677 A CN106210677 A CN 106210677A CN 201610615539 A CN201610615539 A CN 201610615539A CN 106210677 A CN106210677 A CN 106210677A
- Authority
- CN
- China
- Prior art keywords
- color
- frame image
- image
- pixel
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 21
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 20
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 20
- 230000003287 optical effect Effects 0.000 claims description 67
- 239000011159 matrix material Substances 0.000 claims description 26
- 230000006870 function Effects 0.000 claims description 21
- 238000003384 imaging method Methods 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 16
- 230000000694 effects Effects 0.000 description 8
- 238000006073 displacement reaction Methods 0.000 description 7
- 230000002194 synthesizing effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000009826 distribution Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005459 micromachining Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- -1 LIGA Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 238000001459 lithography Methods 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000004377 microelectronic Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The application proposes a kind of image color processing method, device and terminal unit, and the method is used in the terminal unit with shoot function, and MEMS controls imageing sensor and moves, and shoots the first two field picture at initial position；Trigger MEMS and imageing sensor is moved two pixel distances to primary importance from initial position to default first direction, shoot the second two field picture in primary importance；Trigger MEMS and imageing sensor is moved two pixel distances to the second position from primary importance to default second direction, shoot the 3rd two field picture in the second position；According to color component synthesis the 4th two field picture that each location of pixels in the first two field picture, the second two field picture and the 3rd two field picture is corresponding.Thus, improve the accuracy of image color reduction.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image color processing method and apparatus, and a terminal device.
Background
Various terminal devices with shooting functions are widely applied to daily life, and the terminal devices need to perform image color reduction processing on pictures to be acquired during shooting so as to acquire shot images with good quality as far as possible.
Since true color of an image means that in each pixel value making up a color image there are R, G, B primary color components, each primary color component directly determining the primary color intensity of the display device to produce color. However, the data format from the image sensor in the prior art is a bayer data format, and each pixel in this format has only one of three color channels, so that each pixel has only one real color component, and other missing color components need to be estimated and obtained by other processing methods, and the estimated color component and the real color component are subjected to synthesis processing.
Therefore, when the current terminal device shoots a picture, the obtained image color and the real picture color have larger difference, and the color reduction degree of the image is not good.
Disclosure of Invention
The present application is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first objective of the present application is to provide an image color processing method, which enables more color components in an image pixel to be obtained, and improves the restoration effect of the true color of the image and the image quality.
A second object of the present application is to provide an image color processing apparatus.
A third object of the present application is to provide a terminal device.
In order to achieve the above object, an embodiment of a first aspect of the present application provides an image color processing method, where the method is applied in a terminal device having a shooting function, and an imaging module of the terminal device includes: MEMS and image sensor, wherein, MEMS control image sensor removes, image sensor includes photosensitive pixel array, and sets up optical filter on the photosensitive pixel array, the optical filter includes a plurality of filter unit, and every filter unit is the matrix unit of four rows and four columns, the matrix unit includes: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the method comprises the following steps:
shooting a first frame image on a preview picture at an initial position;
triggering the micro-electro-mechanical system to move the image sensor to a first position from an initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame of image at the second position;
and performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
The image color processing method of the embodiment of the application, by using the micro electro mechanical system to accurately control the image sensor to move, and the image sensor is provided with the optical filter and the photosensitive pixel array, the optical filter comprises a plurality of optical filter units, the optical filter units comprise a first color filter subunit, a second color filter subunit and two third color filter subunits which are arranged according to a 4x4 matrix, the first color filter subunit comprises a plurality of first color filters, the second color filter subunit comprises four second color filters, and the third color filter subunit comprises four third color filters, the micro electro mechanical system with the accurate displacement control function controls the image sensor to move for two pixel distances along a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving, obtains a second frame image after moving the first direction, and acquiring a third frame image after moving in the second direction, and synthesizing the first frame image, the second frame image and the third frame image according to the color component of each pixel position of each frame image to form a fourth frame image, namely a final image, so that more color components in the image pixels can be acquired, and the real color restoration effect and the image quality of the image are improved.
In order to achieve the above object, a second aspect of the present application provides an image color processing apparatus, which is applied in a terminal device having a shooting function,
imaging module among the terminal equipment includes: a micro-electro-mechanical system and an image sensor, wherein,
the MEMS controls the image sensor to move, the image sensor comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter comprises a plurality of optical filter units, each optical filter unit is a matrix unit with four rows and four columns, and the matrix unit comprises: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the device comprises:
the first processing module is used for shooting a first frame image on the preview picture at an initial position;
the second processing module is used for triggering the micro electro mechanical system to move the image sensor to a first position from the initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
the third processing module is used for triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame image at the second position;
and the synthesis module is used for carrying out synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image so as to generate a fourth frame image of the preview picture.
The image color processing apparatus of the embodiment of the application, which is applied in a terminal device, precisely controls the movement of an image sensor by using a micro electro mechanical system, and the image sensor is provided with a filter and a photosensitive pixel array, the filter comprises a plurality of filter units, and the filter units comprise a first color filter subunit, a second color filter subunit and two third color filter subunits arranged according to a 4x4 matrix, the first color filter subunit comprises four first color filters, the second color filter subunit comprises four second color filters, and the third color filter subunit comprises four third color filters, the micro electro mechanical system with precise displacement control function controls the image sensor to move for two pixel distances along a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving, the second frame image is obtained after the first direction is moved, the third frame image is obtained after the second direction is moved, and the first frame image, the second frame image and the third frame image are synthesized to form the fourth frame image, namely the final image, according to the color component of each pixel position of each frame image, so that more color components in the image pixels can be obtained, and the real color restoration effect and the image quality of the image are improved.
To achieve the above object, a third aspect of the present application provides a terminal device, including: the casing with set up imaging module in the casing, wherein, imaging module includes: a micro-electro-mechanical system, an image sensor, a lens, a memory, and a processor,
the micro-electro-mechanical system controls the movement of the image sensor,
the image sensor includes photosensitive pixel array, and sets up the light filter on the photosensitive pixel array, the light filter includes a plurality of filter units, and every filter unit is the matrix unit of four rows four columns, the matrix unit includes: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the memory is used for storing executable program codes;
the processor performs by reading executable program code stored in the memory:
shooting a first frame image on a preview picture at an initial position;
triggering the micro-electro-mechanical system to move the image sensor to a first position from the initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame of image at the second position;
and performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
In the terminal device of the embodiment of the application, the mems in the terminal device precisely controls the movement of the image sensor, the image sensor is provided with a filter and a photosensitive pixel array, the filter includes a plurality of filter units, the filter units include a first color filter subunit, a second color filter subunit and two third color filter subunits arranged in a 4x4 matrix, the first color filter subunit includes a plurality of first color filters, the second color filter subunit includes four second color filters, and the third color filter subunit includes four third color filters, the mems having precise displacement control function controls the image sensor to move two pixel distances in a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving, obtains a second frame image after moving the first direction, and acquiring a third frame image after moving in the second direction, and synthesizing the first frame image, the second frame image and the third frame image according to the color component of each pixel position of each frame image to form a fourth frame image, namely a final image, so that more color components in the image pixels can be acquired, and the real color restoration effect and the image quality of the image are improved.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic structural diagram of an optical filter in a terminal device applied in an image color processing method according to an embodiment of the present application;
FIG. 2 is a schematic structural diagram of a MEMS and an image sensor according to an embodiment of the present disclosure;
FIG. 3 is a flow chart of an image color processing method according to an embodiment of the present application;
FIG. 4 is a schematic diagram of color components obtained by the optical filter in the first frame image;
FIG. 5 is a schematic diagram of color components obtained by the optical filter in the second frame image;
FIG. 6 is a schematic diagram of color components obtained by the optical filter in the third frame of image;
FIG. 7 is a flow chart of an image color processing method according to another embodiment of the present application;
FIG. 8 is a schematic structural diagram of an image color processing apparatus according to an embodiment of the present application;
FIG. 9 is a schematic diagram of an image color processing apparatus according to another embodiment of the present application;
fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
An image color processing method, an image color processing device, and a terminal device according to embodiments of the present application are described below with reference to the drawings.
Specifically, the image color processing method provided by the present invention is applied to a terminal device with a shooting function, and it should be noted that the types of the terminal device are many, and include: cell-phones, panel computer, wearable equipment etc..
The terminal equipment with the shooting function comprises an imaging module. The image sensor in the imaging module comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array. The light sensing principle is that a light sensing unit of a light sensing pixel array generates an electric signal by receiving a light signal filtered from an optical filter, and obtains color output through exposure.
The structure of the optical filter determines the distribution of the color components filtered corresponding to the pixel position of each captured image, and different optical filter structures can be selected according to actual application requirements for image capturing. The filter structure applied in the image color processing method provided in this embodiment is shown in fig. 1, and specifically as follows:
fig. 1 is a schematic structural diagram of an optical filter in a terminal device applied in an image color processing method according to an embodiment of the present application; referring to fig. 1, the optical filter 10 includes a plurality of filter units 11, each filter unit 11 is a matrix unit with four rows and four columns, and the matrix unit includes: one first color filter subunit 111 and one second color filter subunit 112 disposed diagonally, and two third color filter subunits 113 and 114 disposed diagonally, wherein the first color filter subunit 111 includes four first color filters 1111; the second color filter subunit 112 includes four second color filters 1121; the third color filter subunit 113 includes four third color filters 1131.
It should be noted that the positions of the first color filter subunit, the second color filter subunit, and the third color filter subunit may be deployed according to application requirements. For example, the deployment of the color filter subunits in each filter unit in the filter shown in fig. 1 is: a BAYER array is arranged in an arrangement of 1 red, 2 green, and 1 blue, and the first color filter subunit 111 includes four red (R1, R2, R3, and R4) filters, the second color filter subunit 112 includes four blue (B1, B2, B3, and B4) filters, the third color filter subunit 113 includes four green (Gr1, Gr2, Gr3, and Gr4) filters, and the third color filter subunit 114 includes four green (Gb1, Gb2, Gb3, and Gb4) filters.
It should be noted that, in the present embodiment, the structural disposition of each filtering unit of the optical filter of the present embodiment may be the same or different, and in the present embodiment, it is preferable that the structural disposition of each filtering unit is the same.
Since each color filter can only obtain one color component, the other two color components need to be estimated through a series of algorithms, for example, the first color filter subunit 111 in fig. 1 is the image pixel position corresponding to the red filter (R1, R2, R3, and R4), and only the corresponding red component can be obtained, and the blue component and the green component corresponding to the pixel position need to be estimated; alternatively, for example, the second color filter subunit 112 in fig. 1 is an image pixel position corresponding to the blue color filter (B1, B2, B3, and B4), only the corresponding blue color component can be obtained, and the red color component and the green color component corresponding to the pixel position need to be estimated. Therefore, based on the image captured by the filter adopted in the embodiment, since each pixel position in the whole image needs to be estimated to restore two color components, the color restoration degree of the whole image is not high, and the display effect of the whole image is affected.
In order to solve the above problems, the image color processing method provided by the present invention introduces a micro-electromechanical system, determines a preset moving distance according to the distribution structure of the color filter in the filter unit, and triggers the micro-electromechanical system to control the image sensor to move to a corresponding position according to the preset moving distance to shoot a reference image, thereby obtaining more real color components at the same pixel position from the reference image for synthesis, and improving the color restoration degree of the image. Among them, Micro-Electro-Mechanical systems (MEMS), also called Micro-Electro-Mechanical systems, microsystems, micromachines, etc., are developed based on the Micro-electronic technology (semiconductor manufacturing technology), and incorporate the technologies of lithography, etching, thin film, LIGA, silicon micromachining, non-silicon micromachining, and precision machining to make high-tech electromechanical devices. The operation range is in the micrometer range, the precise displacement control can be realized, the precision is very high, and the pixel level can be achieved (namely, the distance of the MEMS driving the image sensor to move each time can be equivalent to the size of the image sensor pixel).
Fig. 2 is a schematic structural diagram of a micro-electromechanical system (MEMS) and an image sensor according to an embodiment of the present invention, and the following describes a principle that the micro-electromechanical system (MEMS) drives the image sensor to move with reference to fig. 2, specifically, the micro-electromechanical system (MEMS) includes a fixed electrode 21, a movable electrode 22, and a deformable connecting member 23. The movable electrode 22 is engaged with the fixed electrode 21. The connector 23 fixedly connects the fixed electrode 21 and the movable electrode 22. The fixed electrode 21 and the movable electrode 22 are used to generate an electrostatic force by a driving voltage. The link 23 is configured to deform in a direction in which the movable electrode 22 moves under an electrostatic force to allow the movable electrode 22 to move and thus move the image sensor 30.
It should be noted that, according to different application requirements, the corresponding mems is configured to control the image sensor to move in different directions, for example: the micro electro mechanical systems can be respectively arranged in the horizontal direction and the vertical direction of the image sensor, so that the micro electro mechanical systems can drive the image sensor to horizontally move leftwards or rightwards, horizontally move upwards or downwards and the like. The micro-electromechanical system controls the step length of the image sensor in each movement, and the like, and can be calibrated by the system according to a large amount of experimental data, and can be set by a user according to requirements.
FIG. 3 is a flow chart of an image color processing method according to an embodiment of the present application; as shown in fig. 3, the method may specifically include the following steps:
s101, a first frame image is captured on the preview screen at an initial position.
S102, triggering the micro-electro-mechanical system to move the image sensor to a first position in a preset first direction by two pixel distances, and shooting a second frame image at the first position.
S103, triggering the micro electro mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame image at the second position.
Specifically, during shooting, a user focuses the terminal device on a shooting object, and shoots a first frame image corresponding to a preview picture after focusing is finished.
Fig. 4 is a schematic diagram of color components obtained by the optical filter in the first frame image, for example:
the red component is obtained at the pixel position a corresponding to the red filter (R1, R2, R3, and R4)111, the green component is obtained at the pixel position B corresponding to the green filter (Gb1, Gb2, Gb3, Gb4)114, and the blue component is obtained at the pixel position c corresponding to the blue filter (B1, B2, B3, B4) 112.
Because the color distribution structure in each filtering unit in the image sensor related by the invention is a matrix unit with four rows and four columns, the matrix unit comprises: one first color filter subunit 111 and one second color filter subunit 112 disposed diagonally, and two third color filter subunits 113 and 114 disposed diagonally. Therefore, for the same pixel position, if the three color components are to be respectively obtained through the filters with different colors, on the basis of the first color component obtained in the first frame image, the micro electro mechanical system can be triggered to control the image sensor to move two pixel distances from the initial position to the first preset direction to the first position, and to shoot the second frame image at the first position, and to obtain the second color component corresponding to the pixel position in the second frame image, and then the micro electro mechanical system is triggered again to control the image sensor to move two pixel distances from the first position to the second preset direction to the second position, and to shoot the third frame image at the second position, and to obtain the third color component corresponding to the pixel position in the third frame image.
It should be noted that the preset first direction and the preset second direction may be set according to actual application needs. For example: if the preset first direction is a transverse direction, the preset second direction is a longitudinal direction; or, if the preset first direction is a longitudinal direction, the preset second direction is a transverse direction. The longitudinal direction is a row direction of the filter units arranged in a matrix form, and the transverse direction is a column direction of the filter units arranged in a matrix form.
Specifically, when the direction to the preset first direction is to the right, the direction to the preset second direction is to the up or down; or when the movement to the preset first direction is towards the left, the movement to the preset second direction is towards the upper direction or towards the lower direction; when the direction to the preset first direction is upward, the direction to the preset second direction is leftward or rightward; when the direction is downward, the direction is leftward or rightward.
For a more clear description of the above implementation, the following description is given in conjunction with fig. 4 to 6.
FIG. 5 is a schematic diagram of color components obtained by the optical filter in the second frame image;
FIG. 6 is a schematic diagram of color components obtained by the optical filter in the third frame of image;
as shown in fig. 4-6, taking the selected reference pixel position d (a certain point corresponding to the image of the external scene) as an example, at the initial position, i.e. when the mems does not drive the image sensor to move, the color component obtained by the pixel position through the optical filter is blue (B1, B2, B3 and B4) color component; the MEMS drives the image sensor to move to a preset first direction (for example, to move to the right) by a distance of two pixels to be in a first position state as shown in FIG. 5, and color components acquired by the pixel position d through the optical filter are green (Gb1, Gb2, Gb3 and Gb4) color components; then, based on the first position state shown in fig. 5, the mems drives the image sensor to move two pixel distances in a predetermined second direction (for example, downward movement) to be in the second position state shown in fig. 6, and the color component obtained by the pixel position d through the optical filter is a red (R1, R2, R3, and R4) color component. In this way, the three primary color components can be obtained at the pixel position respectively.
Of course, it is understood that the image sensor moved in this manner may not necessarily obtain three primary color components at each pixel position, for example, taking the pixel position B in fig. 4 to 6 as an example, before the image sensor is moved, as shown in fig. 4, the color components obtained by the color filter at the pixel position are green (Gb1, Gb2, Gb3 and Gb4) color components, while after the mems drives the image sensor to move the pixel position two pixel distances in the first direction to the first position, as shown in fig. 5, the color components obtained by the color filter at the pixel position B are blue (B1, B2, B3 and B4) color components, and after the mems drives the image sensor to move the image sensor again two pixel distances in the second direction to the second position, as shown in fig. 6, the color obtained by the color filter at the pixel position is still green (Gr1, Gb 3526 and Gb4) color components, Gr2, Gr3, and Gr 4). Thus, only two color components (blue and green) can be obtained for this pixel location, while the red color component is still missing.
Or, for example, as shown in fig. 4 to 6, for example, the pixel position c is taken as an example, before the image sensor moves, as shown in fig. 4, the color component acquired by the optical filter at the pixel position c is a red (R1, R2, R3, and R4) color component, and after the mems drives the image sensor to move two pixel distances to the first position in the first direction, as shown in fig. 5, the color component acquired by the optical filter at the pixel position c is a green (Gr1, Gr2, Gr3, and Gr4) color component, as shown in fig. 6, the pixel position a cannot acquire the color component through the optical filter after the mems drives the image sensor to move two pixel distances to the second position again. Thus, only two color components (red and green) can be obtained for this pixel location, while the blue color component is still missing.
In addition, at some pixel positions at the corresponding edges of the filter, even after the image sensor is moved twice in the above manner, only one color component can be obtained, for example, taking the pixel position at a in fig. 4 to 6 as an example, before the image sensor is moved, as shown in fig. 4, the color component obtained by the pixel position through the filter is a blue (B1, B2, B3 and B4) color component, and after the mems drives the image sensor to move two pixel distances to the first position in the first direction, as shown in fig. 5, the pixel position cannot obtain the color component through the filter, and after the mems drives the image sensor to move two pixel distances to the second position again, as shown in fig. 6, the pixel position cannot obtain the color component through the filter. Thus, only one color component (red) can be obtained for this pixel location, while the green and blue color components are still missing.
And S104, performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
Specifically, by combining the corresponding color components at the pixel positions in the preview screen, three color components are obtained at some pixel positions, for example, the pixel position d shown in fig. 4 to 6 can obtain three color components; while only two color components are obtained at certain pixel positions, for example, only two color components can be obtained at the pixel positions b and c shown in fig. 4 to 6; even only one color component is obtained at some pixel positions, e.g. the pixel position at a shown in fig. 4 to 6.
No matter the number of the color components obtained at each pixel position is several, the color components obtained at each pixel position are respectively and correspondingly synthesized, and for the missing color components at each pixel position, one color component may be missing at some positions, two color components may be missing at some positions, and in order to obtain the missing color components, the missing color components can be obtained by the estimation method in the prior art.
Compared with the prior art, the fourth frame image synthesized by adopting the mode does not need to estimate the color components at certain pixel positions, and only needs to estimate the residual color components at partial pixel positions, so that the number of the pixel positions needing to be estimated is greatly reduced, the workload is reduced, the inaccuracy caused by estimation can be reduced as much as possible, and the accuracy and the reality of image color restoration are improved.
The image color recovery method provided by this embodiment is to control the image sensor to move by using a micro electro mechanical system, where the image sensor is provided with a photosensitive pixel array and an optical filter, the optical filter includes a plurality of optical filter units, and the optical filter units include a plurality of first color filters, second color filters, and third color filters arranged according to a certain rule, and the micro electro mechanical system with a precise displacement control function (with a control precision at a pixel level) controls the image sensor to move two pixel distances along a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving, obtains a second frame image after moving the first direction, obtains a third frame image after moving the second direction, and synthesizes the first frame image, the second frame image, and the third frame image according to a color component of each pixel position of each frame image to form a fourth frame image, namely, the final image can obtain more color components in the image pixels, and the restoration effect of the real color of the image and the image quality are improved.
For the step 104 in the above embodiment, different processing methods may be adopted to estimate the missing color components in the pixel positions according to practical application needs, for example: in order to more clearly explain the estimation process of missing color components, the color lookup table, the interpolation method, and the like are specifically explained as follows by combining the embodiment shown in fig. 7 and by using the interpolation estimation method:
FIG. 7 is a flow chart of an image color processing method according to another embodiment of the present application; as shown in fig. 7, based on the foregoing embodiment, step 104 specifically includes:
and S1041, acquiring a first pixel position having a first color component, a second color component and a third color component simultaneously, and a second pixel position having a first color component, a second color component and a third color component simultaneously according to the color component corresponding to each pixel position in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image.
Specifically, as can be seen from the descriptions of fig. 4 to 6 in the above embodiments, some pixel positions can obtain three color components, and some pixel positions can obtain only two color components or only one color component. According to whether the first color component, the second color component and the third color component are acquired at the same time, the pixel positions are distinguished into a first pixel position and a second pixel position, so that the two different pixel positions are processed in different modes.
S1042, acquiring color components lacking in all second pixel positions through a preset interpolation algorithm;
and S1043, performing synthesis processing according to the color components of all the second pixel positions and the color components of all the first pixel positions after the interpolation processing to generate a fourth frame image.
The missing color component corresponding to the second pixel position lacking the color component may be obtained by a preset interpolation algorithm, and specifically, the preset interpolation algorithm may be a Nearest pixel interpolation algorithm (Nearest neighbor interpolation), a bilinear interpolation algorithm, a bicubic interpolation algorithm, a fractal algorithm, and the like. Therefore, three color components can be obtained at each pixel position, the first color component, the second color component and the third color component of the first pixel position with the three color components are directly synthesized, and the color components at the pixel positions of the rest color components obtained through an interpolation algorithm are synthesized, so that a fourth frame image with high color reduction degree, namely a final image, can be obtained.
In addition, in the present embodiment, since the number of color components that can be obtained at each pixel position may be one or two or three, for a pixel position where three color components cannot be obtained, if the second pixel position has one color component, the other two color components that are missing from all the second pixel positions are obtained by a preset interpolation algorithm; or, if the second pixel position has two color components, acquiring another color component missing from all the second pixel positions by a preset interpolation algorithm.
The image color recovery method provided by this embodiment is to control the image sensor to move by using a micro electro mechanical system, where the image sensor is provided with a photosensitive pixel array and an optical filter, the optical filter includes a plurality of optical filter units, and the optical filter units include a plurality of first color filters, second color filters, and third color filters arranged according to a certain rule, and the micro electro mechanical system with a precise displacement control function (with a control precision at a pixel level) controls the image sensor to move two pixel distances along a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving, obtains a second frame image after moving the first direction, obtains a third frame image after moving the second direction, and synthesizes the first frame image, the second frame image, and the third frame image according to a color component of each pixel position of each frame image to form a fourth frame image, the final image can respectively obtain a plurality of color components of each pixel position as much as possible through the three frames of images, and for the partially lacked color components, the estimation efficiency of the interpolation method is high, and the estimation accuracy is closer to the real color components, so that the color restoration accuracy is improved.
In order to implement the above embodiments, the present application also provides an image color processing apparatus.
Fig. 8 is a schematic structural diagram of an image color processing apparatus according to an embodiment of the present application.
The image color processing device is applied to a terminal device with a shooting function, as shown in fig. 2, an imaging module in the terminal device comprises: a micro-electro-mechanical system and an image sensor, wherein,
the micro electro mechanical system controls the image sensor to move, and the image sensor comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array.
As shown in fig. 1, the optical filter 10 includes a plurality of filter units 11, each filter unit 11 is a matrix unit with two rows and two columns, and the matrix unit includes: one first color filter 111 and one second color filter 112 disposed diagonally, and two third color filters (113, 114) disposed diagonally;
as shown in fig. 8, the image color processing apparatus includes:
a first processing module 41, configured to capture a first frame image of the preview screen at an initial position;
a second processing module 42, configured to trigger the mems to move the image sensor to a first position from the initial position to a preset first direction by a distance of two pixels, and capture a second frame image at the first position;
the third processing module 43 is configured to trigger the mems to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and capture a third frame image at the second position;
and a synthesizing module 44, configured to perform synthesis processing according to the color component corresponding to each pixel position in the preview image acquired through the optical filter in the first frame image, the second frame image, and the third frame image, so as to generate a fourth frame image of the preview image.
In this embodiment, if the preset first direction is a transverse direction, the preset second direction is a longitudinal direction; or, if the preset first direction is a longitudinal direction, the preset second direction is a transverse direction.
It should be noted that the foregoing explanation of the embodiment of the image color processing method is also applicable to the image color processing apparatus of the embodiment, and is not repeated herein.
The image color processing device of the embodiment of the application is applied to a terminal device, an imaging module in the terminal device comprises a micro electro mechanical system and an image sensor, the micro electro mechanical system is connected with the image sensor, the micro electro mechanical system controls the image sensor to move, an optical filter and a photosensitive pixel array are arranged on the image sensor, the optical filter comprises a plurality of optical filter units, the optical filter units comprise a plurality of first color filters, second color filters and third color filters which are arranged according to a certain rule, the micro electro mechanical system with the accurate displacement control function controls the image sensor to move two pixel distances along a preset first direction and a preset second direction and two pixel distances along the preset first direction and the preset second direction, so that a first frame image is obtained before moving, a second frame image is obtained after moving the first direction, and acquiring a third frame image after moving in the second direction, and synthesizing the first frame image, the second frame image and the third frame image according to the color component of each pixel position of each frame image to form a fourth frame image, namely a final image, so that more color components in the image pixels can be acquired, and the real color restoration effect and the image quality of the image are improved.
Fig. 9 is a schematic structural diagram of an image color processing apparatus according to another embodiment of the present application.
As shown in fig. 9, based on the embodiment shown in fig. 8, the synthesis module 44 specifically includes: an acquisition unit 441, a calculation unit 442, and a generation unit 443.
The obtaining unit 441 is configured to: and acquiring a first pixel position simultaneously having a first color component, a second color component and a third color component and a second pixel position not simultaneously having the first color component, the second color component and the third color component according to the color component corresponding to each pixel position in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image.
The calculation unit 442 is configured to: and acquiring the missing color components of all the second pixel positions by a preset interpolation algorithm.
The generating unit 443 is configured to: and performing synthesis processing according to the color components of all the second pixel positions and the color components of all the first pixel positions after the interpolation processing to generate a fourth frame image of the preview picture.
In this embodiment, further, the calculating unit 442 is configured to: if the second pixel position has one color component, acquiring other two color components lacking in all the second pixel positions through a preset interpolation algorithm; or, if the second pixel position has two color components, acquiring another color component missing from all the second pixel positions by a preset interpolation algorithm.
It should be noted that the foregoing explanation of the embodiment of the image color processing method is also applicable to the image color processing apparatus of the embodiment, and is not repeated herein.
In order to implement the above embodiments, the present application further provides a terminal device.
Fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application. The terminal apparatus 1000 in the present embodiment may be a mobile phone or the like having a photographing function.
As shown in fig. 10, the terminal device includes: casing and the imaging module assembly 1000 of setting in the casing, wherein, imaging module assembly 1000 includes: a micro-electro-mechanical system 20, an image sensor 30, a lens 1001, a memory 1002, and a processor 1003,
the mems 20 controls the image sensor movement,
the image sensor includes photosensitive pixel array, and sets up the light filter on the photosensitive pixel array, the light filter includes a plurality of filter units, and every filter unit is the matrix unit of four rows four columns, the matrix unit includes: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the memory 1002 is used for storing executable program codes;
the processor 1003 executes by reading executable program code stored in the memory 1002:
shooting a first frame image on a preview picture at an initial position;
triggering the micro-electro-mechanical system 20 to move the image sensor 30 to a first position from the initial position to a preset first direction by a distance of two pixels, and capturing a second frame image at the first position;
triggering the micro-electro-mechanical system 20 to move the image sensor 30 to a second position from the first position to a preset second direction by two pixel distances, and capturing a third frame of image at the second position;
and performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
It should be noted that the foregoing explanation of the embodiment of the image color processing method is also applicable to the image color processing apparatus of the embodiment, and is not repeated herein.
The terminal device of the embodiment of the application, the MEMS in the terminal device controls the image sensor to move, the image sensor is provided with a filter and a photosensitive pixel array, the filter comprises a plurality of filter units, the filter units comprise a first color filter subunit, a second color filter subunit and two third color filter subunits which are arranged according to a 4x4 matrix, the first color filter subunit comprises four first color filters, the second color filter subunit comprises four second color filters, and the third color filter subunit comprises four third color filters, the MEMS with an accurate position control function is triggered by a processor to control the image sensor to move for two pixel distances along a preset first direction and a preset second direction, so that the terminal device obtains a first frame image before moving and obtains a second frame image after moving the first direction, and acquiring a third frame image after moving in the second direction, and synthesizing the first frame image, the second frame image and the third frame image according to the color component of each pixel position of each frame image to form a fourth frame image, namely a final image, so that more color components in the image pixels can be acquired, and the real color restoration effect and the image quality of the image are improved.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
Claims (9)
1. An image color processing method is applied to a terminal device with a shooting function, wherein an imaging module in the terminal device comprises: a micro-electro-mechanical system and an image sensor, wherein,
the MEMS controls the image sensor to move, the image sensor comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter comprises a plurality of optical filter units, each optical filter unit is a matrix unit with four rows and four columns, and the matrix unit comprises: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the method comprises the following steps:
shooting a first frame image on a preview picture at an initial position;
triggering the micro-electro-mechanical system to move the image sensor to a first position from the initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame of image at the second position;
and performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
2. The method of claim 1,
if the preset first direction is a transverse direction, the preset second direction is a longitudinal direction;
or,
if the preset first direction is a longitudinal direction, the preset second direction is a transverse direction.
3. The method according to claim 1, wherein the generating a fourth frame image by performing a synthesis process based on color components corresponding to respective pixel positions in a preview screen acquired through the optical filter in the first frame image, the second frame image, and the third frame image includes:
according to color components corresponding to pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image, acquiring first pixel positions simultaneously having a first color component, a second color component and a third color component and second pixel positions not simultaneously having the first color component, the second color component and the third color component;
acquiring color components lacking in all second pixel positions through a preset interpolation algorithm;
and performing synthesis processing according to the color components of all the second pixel positions and the color components of all the first pixel positions after the interpolation processing to generate a fourth frame image of the preview picture.
4. The method according to claim 3, wherein the obtaining the missing color components of all the second pixel positions by a preset interpolation algorithm comprises:
if the second pixel position has one color component, acquiring other two color components lacking in all the second pixel positions through a preset interpolation algorithm; or,
and if the second pixel position has two color components, acquiring another color component which is lacked in all the second pixel positions through a preset interpolation algorithm.
5. An image color processing device, characterized in that, the device is applied in a terminal device with a shooting function, an imaging module in the terminal device comprises: a micro-electro-mechanical system and an image sensor, wherein,
the MEMS controls the image sensor to move, the image sensor comprises a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter comprises a plurality of optical filter units, each optical filter unit is a matrix unit with four rows and four columns, and the matrix unit comprises: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the device comprises:
the first processing module is used for shooting a first frame image on the preview picture at an initial position;
the second processing module is used for triggering the micro electro mechanical system to move the image sensor to a first position from the initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
the third processing module is used for triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame image at the second position;
and the synthesis module is used for carrying out synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image so as to generate a fourth frame image of the preview picture.
6. The image color processing apparatus according to claim 5,
if the preset first direction is a transverse direction, the preset second direction is a longitudinal direction;
or,
if the preset first direction is a longitudinal direction, the preset second direction is a transverse direction.
7. The image color processing apparatus according to claim 5, wherein the composition module comprises:
an obtaining unit, configured to obtain, according to color components corresponding to pixel positions in the preview picture obtained through the optical filter in the first frame image, the second frame image, and the third frame image, a first pixel position having a first color component, a second color component, and a third color component at the same time, and a second pixel position having a first color component, a second color component, and a third color component at the same time;
the computing unit is used for acquiring color components lacking in all second pixel positions through a preset interpolation algorithm;
and the generating unit is used for performing synthesis processing on the color components of all the second pixel positions and the color components of all the first pixel positions after interpolation processing to generate a fourth frame image of the preview picture.
8. The image color processing apparatus according to claim 7, wherein said calculation unit is configured to:
if the second pixel position has one color component, acquiring other two color components lacking in all the second pixel positions through a preset interpolation algorithm; or,
and if the second pixel position has two color components, acquiring another color component which is lacked in all the second pixel positions through a preset interpolation algorithm.
9. A terminal device, comprising: the casing with set up imaging module in the casing, wherein, imaging module includes: a micro-electro-mechanical system, an image sensor, a lens, a memory, and a processor,
the micro-electro-mechanical system controls the movement of the image sensor,
the image sensor includes photosensitive pixel array, and sets up the light filter on the photosensitive pixel array, the light filter includes a plurality of filter units, and every filter unit is the matrix unit of four rows four columns, the matrix unit includes: a first color filter subunit and a second color filter subunit disposed diagonally, and two third color filter subunits disposed diagonally, wherein the first color filter subunit includes four first color filters; the second color filter subunit comprises four second color filters; the third color filter subunit comprises four third color filters;
the memory is used for storing executable program codes;
the processor performs by reading executable program code stored in the memory:
shooting a first frame image on a preview picture at an initial position;
triggering the micro-electro-mechanical system to move the image sensor to a first position from the initial position to a preset first direction by two pixel distances, and shooting a second frame image at the first position;
triggering the micro-electro-mechanical system to move the image sensor to a second position from the first position to a preset second direction by two pixel distances, and shooting a third frame of image at the second position;
and performing synthesis processing according to the color components corresponding to the pixel positions in the preview picture acquired through the optical filter in the first frame image, the second frame image and the third frame image to generate a fourth frame image of the preview picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610615539.7A CN106210677B (en) | 2016-07-29 | 2016-07-29 | Image color processing method, device and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610615539.7A CN106210677B (en) | 2016-07-29 | 2016-07-29 | Image color processing method, device and terminal device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210677A true CN106210677A (en) | 2016-12-07 |
| CN106210677B CN106210677B (en) | 2018-02-06 |
Family
ID=57498091
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610615539.7A Active CN106210677B (en) | 2016-07-29 | 2016-07-29 | Image color processing method, device and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210677B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200099898A1 (en) * | 2018-09-24 | 2020-03-26 | Google Llc | Color imaging system |
| CN112616007A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616009A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616008A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112637473A (en) * | 2020-12-31 | 2021-04-09 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112788218A (en) * | 2020-12-31 | 2021-05-11 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN113038091A (en) * | 2021-03-11 | 2021-06-25 | 苏州乐佰图信息技术有限公司 | Pixel rotation mechanism and pixel rotation method thereof |
| WO2022143850A1 (en) * | 2020-12-31 | 2022-07-07 | 维沃移动通信有限公司 | Electronic device and photographing module thereof |
| KR102724278B1 (en) * | 2020-12-31 | 2024-10-31 | 비보 모바일 커뮤니케이션 컴퍼니 리미티드 | Electronic devices and their photographing modules |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104079904A (en) * | 2014-07-17 | 2014-10-01 | 广东欧珀移动通信有限公司 | Color image generating method and device |
| US8989487B2 (en) * | 2008-05-19 | 2015-03-24 | Samsung Electronics Co., Ltd. | Apparatus and method for combining images |
| CN105100558A (en) * | 2014-05-16 | 2015-11-25 | 全视科技有限公司 | Wafer level camera having movable color filter grouping |
| CN105611123A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Imaging method, image sensor, imaging device and electronic device |
-
2016
- 2016-07-29 CN CN201610615539.7A patent/CN106210677B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8989487B2 (en) * | 2008-05-19 | 2015-03-24 | Samsung Electronics Co., Ltd. | Apparatus and method for combining images |
| CN105100558A (en) * | 2014-05-16 | 2015-11-25 | 全视科技有限公司 | Wafer level camera having movable color filter grouping |
| CN104079904A (en) * | 2014-07-17 | 2014-10-01 | 广东欧珀移动通信有限公司 | Color image generating method and device |
| CN105611123A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Imaging method, image sensor, imaging device and electronic device |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200099898A1 (en) * | 2018-09-24 | 2020-03-26 | Google Llc | Color imaging system |
| US10687033B2 (en) | 2018-09-24 | 2020-06-16 | Google Llc | Color imaging system |
| CN111602387A (en) * | 2018-09-24 | 2020-08-28 | 谷歌有限责任公司 | Color imaging system |
| EP3714594A1 (en) * | 2018-09-24 | 2020-09-30 | Google LLC | Color imaging system |
| CN111602387B (en) * | 2018-09-24 | 2021-07-06 | 谷歌有限责任公司 | Color imaging system |
| CN112788218A (en) * | 2020-12-31 | 2021-05-11 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616008A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112637473A (en) * | 2020-12-31 | 2021-04-09 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616009A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616007A (en) * | 2020-12-31 | 2021-04-06 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| CN112616007B (en) * | 2020-12-31 | 2022-06-17 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| WO2022143850A1 (en) * | 2020-12-31 | 2022-07-07 | 维沃移动通信有限公司 | Electronic device and photographing module thereof |
| WO2022143682A1 (en) * | 2020-12-31 | 2022-07-07 | 维沃移动通信有限公司 | Electronic device and camera module thereof |
| CN112637473B (en) * | 2020-12-31 | 2022-11-11 | 维沃移动通信有限公司 | Electronic equipment and camera module thereof |
| KR102724278B1 (en) * | 2020-12-31 | 2024-10-31 | 비보 모바일 커뮤니케이션 컴퍼니 리미티드 | Electronic devices and their photographing modules |
| CN113038091A (en) * | 2021-03-11 | 2021-06-25 | 苏州乐佰图信息技术有限公司 | Pixel rotation mechanism and pixel rotation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210677B (en) | 2018-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210677B (en) | Image color processing method, device and terminal device | |
| CN106210678A (en) | Image color processing method, device and terminal unit | |
| CN106162112B (en) | Image color processing method, device and terminal device | |
| JP6341736B2 (en) | Imaging apparatus, control method, program, storage medium | |
| JP5226600B2 (en) | Image deformation apparatus and operation control method thereof | |
| CN107404619B (en) | image zooming processing method and device and terminal equipment | |
| US20110292227A1 (en) | Imaging apparatus, image correction method, and computer-readable recording medium | |
| EP2882183B1 (en) | Electronic apparatus and method of controlling the same | |
| EP2682799B1 (en) | Imaging device, semiconductor integrated circuit, and imaging method | |
| US20170019599A1 (en) | Photographing apparatus, photographing method and program | |
| CN106162111B (en) | Image color processing method and terminal device | |
| CN103941522A (en) | Focus adjustment unit, camera system and method for controlling focus adjustment unit | |
| JP5484617B2 (en) | Imaging device | |
| EP3210066B1 (en) | Controlling focus lens assembly | |
| JP2008054062A (en) | Image pickup device | |
| JP2017005555A (en) | Imaging device, imaging control device, imaging control method and imaging control program | |
| JP2011019024A (en) | Image pickup device | |
| CN106162110A (en) | Image color processing method, device and terminal unit | |
| CN106303221A (en) | control method, device and mobile terminal | |
| JP2001221945A (en) | Automatic focusing device | |
| JP2013034173A (en) | Imaging apparatus | |
| CN108322654B (en) | Lens zooming method and device and mobile terminal | |
| JP6597080B2 (en) | Imaging device | |
| JP2014236244A (en) | Image processing system, image processing program, and digital camera | |
| JP2008064847A (en) | Image blur correction controller, control method, imaging apparatus and imaging method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |