CN109472763B - Image synthesis method and device - Google Patents
Image synthesis method and device Download PDFInfo
- Publication number
- CN109472763B CN109472763B CN201710801070.0A CN201710801070A CN109472763B CN 109472763 B CN109472763 B CN 109472763B CN 201710801070 A CN201710801070 A CN 201710801070A CN 109472763 B CN109472763 B CN 109472763B
- Authority
- CN
- China
- Prior art keywords
- effective
- mixed
- pixels
- pixel
- pixel set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001308 synthesis method Methods 0.000 title description 8
- 239000011159 matrix material Substances 0.000 claims abstract description 58
- 238000002156 mixing Methods 0.000 claims abstract description 44
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 17
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 17
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 15
- 238000000034 method Methods 0.000 claims abstract description 13
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 12
- 239000003086 colorant Substances 0.000 claims description 34
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000005923 long-lasting effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
A method of image synthesis, comprising: respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods; analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set; determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set; obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix; and synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm. An apparatus for image synthesis. The scheme can realize mixing of special images, and is high in flexibility and wide in application.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to an image synthesis method and device.
Background
The blend mode may combine images with colors between images to create a variety of effects. The mixed mode is widely applied in the technical field of image processing, for example, a drawing tool and an editing and adjusting tool can be applied to the mixed mode to perform aliasing on two or more images, so that the mixed mode is effectively and flexibly applied, and the images are dazzling and colorful.
With the deep development and application of image processing technology, an image synthesis-based method is a long-lasting research hotspot. Poisson blending as described in the related art may result in color change and blending edge non-smoothness due to excessive force on maintaining the gradient of the original image under certain conditions. The related technology is further expanded on the basis of Poisson mixing to solve the phenomena of color change and unsmooth mixed edge. However, the image blending just performs aliasing based on the rule followed by most images, and blending is performed for special images, which lacks flexibility and wide applicability.
Disclosure of Invention
The embodiment of the invention provides an image synthesis method and device, which are used for mixing special images.
A method of image synthesis, comprising:
respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods;
analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set;
determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set;
obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
and synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm.
Optionally, the neighborhood candidate pixel set includes all pixels except for the pixel to be mixed in the neighborhood of the pixel to be mixed, and the neighborhood pixel set includes all pixels in the neighborhood candidate pixel set and the pixel to be mixed.
Optionally, the analyzing the valid pixels in the neighborhood candidate pixel set includes:
analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set;
and determining effective pixels in the neighborhood candidate pixel set according to threshold values of all channels of the three primary colors.
Optionally, the determining effective pixels in the neighborhood candidate pixel set according to the threshold of each channel of the three primary colors includes:
determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors;
and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
Optionally, the obtaining an effective blending value of the pixel to be blended according to the effective pixel set and the effective coefficient matrix includes:
and carrying out weighted average according to all elements in the effective pixel set and the coefficients of the effective coefficient matrix corresponding to the elements to obtain an effective mixed value of the pixel to be mixed.
Optionally, the mixed mode algorithm is:
Pout=P″1×α+P″2x (255-a), wherein,
Poutis the result of the output after image blending, P ″)1Is an effective blending value, P ″, of the pixel to be blended of a first image to be synthesized2Alpha is a transparency coefficient, which is an effective blending value of the pixels to be blended of the second image to be synthesized.
An apparatus for image synthesis, comprising:
the first determining module is used for respectively determining neighborhoods of pixels to be mixed in the images to be synthesized and determining a neighborhood candidate pixel set from the neighborhoods;
the analysis module is used for analyzing effective pixels in the neighborhood candidate pixel set and determining the effective pixels and the pixels to be mixed as an effective pixel set;
a second determining module, configured to determine, according to the effective identifier corresponding to the element in the effective pixel set, an effective coefficient matrix corresponding to a neighborhood pixel set of the pixel to be mixed;
the obtaining module is used for obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
and the synthesis module is used for synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and the mixed mode algorithm.
Optionally, the neighborhood candidate pixel set includes all pixels except for the pixel to be mixed in the neighborhood of the pixel to be mixed, and the neighborhood pixel set includes all pixels in the neighborhood candidate pixel set and the pixel to be mixed.
Optionally, the analyzing module analyzes the valid pixels in the neighborhood candidate pixel set, and includes: analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set; and determining effective pixels in the neighborhood candidate pixel set according to threshold values of all channels of the three primary colors.
Optionally, the determining, by the analysis module, effective pixels in the neighborhood candidate pixel set according to threshold values of channels of three primary colors includes: determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors; and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
Optionally, the obtaining module obtains the effective blending value of the pixel to be blended according to the effective pixel set and the effective coefficient matrix, and includes: and carrying out weighted average according to all elements in the effective pixel set and the coefficients of the effective coefficient matrix corresponding to the elements to obtain an effective mixed value of the pixel to be mixed.
Optionally, the synthesis module is configured to, according to a mixed-mode algorithm: pout=P″1×α+P″2X (255- α), wherein PoutIs the result of the output after image blending, P ″)1Is an effective blending value, P ″, of the pixel to be blended of a first image to be synthesized2Alpha is a transparency coefficient, which is an effective blending value of the pixels to be blended of the second image to be synthesized.
An apparatus for image synthesis, comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of:
respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods;
analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set;
determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set;
obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
and synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm.
In summary, embodiments of the present invention provide an image synthesis method and apparatus, which can mix special images, and have high flexibility and wide application.
Drawings
Fig. 1 is a flowchart of an image synthesis method according to a first embodiment of the present invention;
FIG. 2 is a diagram illustrating an image synthesis method according to a second embodiment of the present invention;
FIG. 3 is a diagram illustrating a determination of a neighborhood range according to an embodiment of the present invention;
fig. 4 is a schematic diagram of an image synthesizing apparatus according to a second embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
Example one
Fig. 1 is a flowchart of an image synthesis method according to an embodiment of the present invention, and as shown in fig. 1, the method of this embodiment includes the following steps:
and step 15, synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and the mixed mode algorithm.
The method of the embodiment overcomes the limitation of the prior art, mixes any sample image by using the pixel area, and can overcome the phenomena of color change and unsmooth edge. The threshold value can be customized or selected according to the pixel value, the neighborhood of the mixed pixel and the neighborhood coefficient matrix can be mixed, and the flexibility of the mixing rule can be improved.
Example two
The technical solution of the embodiment of the present invention is described in detail with a specific embodiment.
As shown in fig. 2, the method of the present embodiment includes the following steps:
And (3) setting the current mixed pixel point as P, setting the coordinate of the pixel point as (x, y), and confirming the N multiplied by M neighborhood range of the mixed pixel point P through 4 neighborhood range parameters of h _ l, h _ r, v _ u and v _ d.
Wherein h _ l represents the distance between the coordinate x of the pixel P and the left boundary of the neighborhood, h _ r represents the distance between the coordinate x of the pixel P and the right boundary of the neighborhood, v _ u represents the distance between the coordinate y of the pixel P and the upper boundary of the neighborhood, and v _ d represents the distance between the coordinate y of the pixel P and the lower boundary of the neighborhood, so that the horizontal domain of the mixed pixel P is [ x-h _ l, x + h _ r ], the vertical domain is [ y-v _ u, x + v _ d ], and the neighborhood is shown in fig. 3.
the neighborhood candidate pixel set is the non-P in the NxM neighborhood of the current mixed pixel point P as the candidate pixel set.
The pixel set S in the neighborhood of the point P can be determined from the coordinates (x, y) of the current mixed pixel point P and the neighborhood range parameters h _ l, h _ r, v _ u, and v _ d described in step 101As shown in table 1.
TABLE 1
The P neighborhood candidate pixel set of the point is a set of all non-P pixels in the P neighborhood of the mixed pixel point, and is recorded as U based on the neighborhood candidate pixel set。
set S of pixels from neighborhood of pixel point PCoefficient matrix DpCalculating a candidate set of pixels UWhether each pixel in the previous result is valid is further confirmed based on each channel threshold value, and then a candidate pixel set U is used for judging whether each pixel in the previous result is validThe middle effective pixel and the pixel point P form an effective pixel set of the P point。
Let each channel threshold of three primary colors be Rmin、Rmax、Gmin、Gmax、Bmin、BmaxMixed pixel P neighborhood set SCoefficient matrix is Dp。Rmin、Rmax、Gmin、Gmax、Bmin、Bmax、 DpThe parameter is a candidate pixel set U as a neighborhood of the point PWhether each pixel in (a) is a valid metric.
The effective pixel analysis can be divided into the following steps:
step 103.1, from the set of pixels SCoefficient matrix is DpComputing a set of candidate pixels UWhether each pixel in (1) is valid;
set of pixels SCoefficient matrix is DpAre known and will not be described here.
Assuming that the width of the neighborhood of point P is n and the height is m, it can be obtained from step 101:
n=h_l+h_r+1,
m=v_u+v_d+1,
there is a mixed pixel P neighborhood set SCorresponding coefficient matrix DpComprises the following steps:
f for installationUMatrix representation pixel set UWhether each pixel in (1) is valid, FUComprises the following steps:
at FUIn the matrix, the coordinate P of the current mixed pixel point is an effective flag corresponding to (x, y)i,jAnd (wherein i ═ x-h _ l +1, j ═ y-v _ u +1) is always 1. And candidate pixel set UMiddle pixel Pi,jThe corresponding valid flag is flagi,jWherein i is more than or equal to 1 and less than or equal to n, i is not equal to x-h _ l +1, j is more than or equal to 1 and less than or equal to m, and j is not equal to y-v _ u + 1. Based on candidate pixel set UMiddle pixel Pi,jCorresponding coefficient matrix is DpIn di,jWherein i is not less than 1 and not more than n and i is not equal to x-h _ l +1, j is not less than 1 and not more than m and j is not equal to y-v _ u +1, if di,j0, then the corresponding flagi,j=0。
Step 103.2, calculating candidate pixel set U based on each channel threshold valueWhether each pixel in (1) is valid;
let each channel value corresponding to the current mixing point P be rp、gp、bpCandidate set of pixels UMiddle pixel Pi,jCorresponding each channel value is ri,j、gi,j、bi,jWherein i is more than or equal to 1 and less than or equal to n, i is not equal to x-h _ l +1, j is more than or equal to 1 and less than or equal to m, and j is not equal to y-v _ u + 1. By calculating rp、gp、bpAnd a threshold value Rmin,Rmax,Gmin,Gmax,Bmin,BmaxRespectively obtaining the effective intervals of the r channel valuesValid interval of values of g-channelValid interval of b channel value
Valid interval of r channel valuesValid interval of values of g-channelValid interval of b channel value
Step 103.3, based on the valid intervals respectively corresponding to r, g and bBy judging candidate pixel set UMiddle pixel Pi,jCorresponding each channel value is ri,j、gi,j、bi,jWhether or not it falls within the valid interval Further calculation of F in step 103.1UElement flag in matrixi,jWhether the value is 0. If Pi,jCorresponding flagi,jIs 1, then Pi,jAre valid candidates. And the current mixed pixel P is always the effective pixel, then P isi,jAnd the pixel point P forms an effective pixel set of the P point。
From the set of active pixels in step 103Effective identification corresponding to middle element determines pixel set SThe corresponding significant coefficient matrix D ″P. Confirmation of F from step 103.2UFlag in matrixi,jThe value (i is more than or equal to 1 and less than or equal to n, j is more than or equal to 1 and less than or equal to m) determines DpWhether each element is valid.
Let effective coefficient matrix DPComprises the following steps:
then there are:
wherein i is more than or equal to 1 and less than or equal to n, and j is more than or equal to 1 and less than or equal to m.
the effective blending value being a set of effective pixelsAnd carrying out weighted average on all the elements and the corresponding coefficients to obtain an effective mixed value of the mixed pixel point P.
Setting effective pixel setThe sum of the weights corresponding to the elements is count _ num, and the effective mixed value corresponding to the current mixed pixel P point is P', then:
Pout=P″src×α+P″dst×(255-α)
foreground image neighborhood parameter hsrcAnd vsrcIs a mixed pixel point PsrcNeighborhood zonesrcWidth and height ofPast current mixed pixel point PsrcCoordinate (x) ofsrc,ysrc) And neighborhood range parameter h _ lsrc、h_rsrc、v_usrcAnd v _ dsrcCalculating to obtain a mixed pixel point PsrcNeighborhood of (2)src. Then mix pixel point PsrcIn the horizontal direction of [ x ]src-h_lsrc,xsrc+h_rsrc]The vertical direction field is [ ysrc-v_usrc,ysrc+ v_dsrc]。
Background image neighborhood parameter hdstAnd vdstIs a mixed pixel point PdstNeighborhood zonedstBy the current mixed pixel point PdstCoordinate (x) ofdst,ydst) And neighborhood range parameter h _ ldst、h_rdst、v_udstAnd v _ ddstCalculating to obtain a mixed pixel point PdstNeighborhood of (2)dst. Then mix pixel point PdstIn the horizontal direction of [ x ]dst-h_ldst,xdst+h_rdst]The vertical direction field is [ ydst-v_udst,ydst+ v_ddst]。
Neighborhood of foreground imagessrcIs UsrcNeighborhood of background imagedstIs the set of candidate pixels in
Foreground image neighborhoodsrcSet of pixels SsrcIs recorded as a coefficient matrix ofThe threshold value of each channel of the three primary colors is respectivelyByAnd determining candidate pixel set by three primary color each channel threshold valueOf the effective pixel, candidate pixel set UsrcEffective pixel and point PsrcEffective pixel set constituting foreground imageThereby obtaining a pixel setCorresponding significant coefficient matrix
Background image neighborhood candidate pixel setIs recorded as a coefficient matrix ofThe threshold value of each channel of the three primary colors is respectivelyByAnd determining candidate pixel set by three primary color each channel threshold valueOf the effective pixel, a candidate pixel setEffective pixel and point PdstEffective pixel set constituting dstThereby obtaining a pixel setCorresponding significant coefficient matrix
From the above-mentioned set of pixels SsrcCorresponding significant coefficient matrixAnd a set of pixelsCorresponding significant coefficient matrixAn effective pixel set can be obtainedThe sum of the corresponding weights of the elements is sumsrcAnd an effective pixel setThe sum of the corresponding weights of the elements is sumdst。
There is a foreground image mixed pixel point PsrcThe corresponding effective mixing value is P ″)srcComprises the following steps:
background image mixed pixel point PdstThe corresponding effective mixing value is P ″)dstComprises the following steps:
p' through the foreground imagesrcAnd P' of background imagedstAnd coefficient alpha is used for carrying out image aliasing to obtain Pout:
Pout=P″src×α+P″dst×(255-α)
Compared with the prior art, the method provided by the embodiment of the invention has the advantages that the threshold value is customized or the threshold value, the neighborhood of the mixed pixel and the neighborhood coefficient matrix are selected according to the pixel value, so that the flexibility and the wide applicability of image mixing are improved while the image edge is smooth, the color change phenomenon is avoided, and the texture of the image is kept.
Fig. 4 is a schematic diagram of an image synthesizing apparatus according to an embodiment of the present invention, and as shown in fig. 4, the apparatus of the embodiment includes:
the first determining module is used for respectively determining neighborhoods of pixels to be mixed in the images to be synthesized and determining a neighborhood candidate pixel set from the neighborhoods;
the analysis module is used for analyzing effective pixels in the neighborhood candidate pixel set and determining the effective pixels and the pixels to be mixed as an effective pixel set;
a second determining module, configured to determine, according to the effective identifier corresponding to the element in the effective pixel set, an effective coefficient matrix corresponding to a neighborhood pixel set of the pixel to be mixed;
the obtaining module is used for obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
and the synthesis module is used for synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and the mixed mode algorithm.
The device of the embodiment overcomes the limitation of the prior art, utilizes the pixel area to mix any sample image, and can overcome the phenomena of color change and uneven edge. The threshold value can be customized or selected according to the pixel value, the neighborhood of the mixed pixel and the neighborhood coefficient matrix can be mixed, and the flexibility of the mixing rule can be improved.
In an embodiment, the neighborhood candidate set of pixels includes all pixels in the neighborhood of the pixel to be mixed except the pixel to be mixed, and the neighborhood set of pixels includes all pixels in the neighborhood candidate set of pixels and the pixel to be mixed.
In one embodiment, the analyzing module analyzes the valid pixels in the neighborhood candidate set, including: analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set; and determining effective pixels in the neighborhood candidate pixel set according to threshold values of all channels of the three primary colors.
In an embodiment, the determining, by the analysis module, effective pixels in the neighborhood candidate pixel set according to threshold values of channels of three primary colors includes: determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors; and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
In an embodiment, the obtaining module obtains the effective blending value of the pixel to be blended according to the effective pixel set and the effective coefficient matrix, and includes: and carrying out weighted average according to all elements in the effective pixel set and the coefficients of the effective coefficient matrix corresponding to the elements to obtain an effective mixed value of the pixel to be mixed.
In one embodiment, the synthesis module is based on a mixed-mode algorithm that:
Pout=P″1×α+P″2x (255-a), wherein,
Poutis the result of the output after image blending, P ″)1Is an effective blending value, P ″, of the pixel to be blended of a first image to be synthesized2Alpha is a transparency coefficient, which is an effective blending value of the pixels to be blended of the second image to be synthesized.
An embodiment of the present invention further provides an image synthesis apparatus, including: memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of:
respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods;
analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set;
determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set;
obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
and synthesizing the images to be synthesized according to the effective mixing values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm.
Embodiments of the present invention also provide a computer-readable storage medium storing computer-executable instructions, which when executed implement the method for image synthesis.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present invention is not limited to any specific form of combination of hardware and software.
The foregoing is only a preferred embodiment of the present invention, and naturally there are many other embodiments of the present invention, and those skilled in the art can make various corresponding changes and modifications according to the present invention without departing from the spirit and the essence of the present invention, and these corresponding changes and modifications should fall within the scope of the appended claims.
Claims (9)
1. A method of image synthesis, comprising:
respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods;
analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set;
determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set;
obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
synthesizing the images to be synthesized according to the effective mixed values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm;
wherein said analyzing the active pixels in the neighborhood candidate set comprises:
analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set;
determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors;
and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
2. The method of claim 1, wherein:
the neighborhood candidate pixel set comprises all pixels except the pixel to be mixed in the neighborhood of the pixel to be mixed, and the neighborhood pixel set comprises all pixels in the neighborhood candidate pixel set and the pixel to be mixed.
3. The method of claim 1, wherein: the obtaining the effective mixing value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix comprises:
and carrying out weighted average according to all elements in the effective pixel set and the coefficients of the effective coefficient matrix corresponding to the elements to obtain an effective mixed value of the pixel to be mixed.
4. The method of claim 1, wherein: the mixed mode algorithm is as follows:
Pout=P″1×α+P″2x (255-a), wherein,
Poutis the result of the output after image blending, P ″)1Is an effective blending value, P ″, of the pixel to be blended of a first image to be synthesized2Alpha is a transparency coefficient, which is an effective blending value of the pixels to be blended of the second image to be synthesized.
5. An apparatus for image synthesis, comprising:
the first determining module is used for respectively determining neighborhoods of pixels to be mixed in the images to be synthesized and determining a neighborhood candidate pixel set from the neighborhoods;
the analysis module is used for analyzing effective pixels in the neighborhood candidate pixel set and determining the effective pixels and the pixels to be mixed as an effective pixel set;
a second determining module, configured to determine, according to the effective identifier corresponding to the element in the effective pixel set, an effective coefficient matrix corresponding to a neighborhood pixel set of the pixel to be mixed;
the obtaining module is used for obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
the synthesis module is used for synthesizing the images to be synthesized according to the effective mixed values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm;
the analysis module analyzes the valid pixels in the neighborhood candidate set of pixels, including: analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set; determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors; and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
6. The apparatus of claim 5, wherein:
the neighborhood candidate pixel set comprises all pixels except the pixel to be mixed in the neighborhood of the pixel to be mixed, and the neighborhood pixel set comprises all pixels in the neighborhood candidate pixel set and the pixel to be mixed.
7. The apparatus of claim 5, wherein:
the obtaining module obtains the effective mixing value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix, and includes: and carrying out weighted average according to all elements in the effective pixel set and the coefficients of the effective coefficient matrix corresponding to the elements to obtain an effective mixed value of the pixel to be mixed.
8. The apparatus of any one of claims 5-7, wherein:
the synthesis module is based on a mixed mode algorithm as follows: pout=P″1×α+P″2X (255- α), wherein PoutIs the result of the output after image blending, P ″)1Is an effective blending value, P ″, of the pixel to be blended of a first image to be synthesized2Alpha is a transparency coefficient, which is an effective blending value of the pixels to be blended of the second image to be synthesized.
9. An apparatus for image synthesis, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of:
respectively determining neighborhoods of pixels to be mixed in an image to be synthesized, and determining a neighborhood candidate pixel set from the neighborhoods;
analyzing effective pixels in the neighborhood candidate pixel set, and determining the effective pixels and the pixels to be mixed as an effective pixel set;
determining an effective coefficient matrix corresponding to a neighborhood pixel set of the pixels to be mixed according to effective identifications corresponding to elements in the effective pixel set;
obtaining an effective mixed value of the pixel to be mixed according to the effective pixel set and the effective coefficient matrix;
synthesizing the images to be synthesized according to the effective mixed values of the pixels to be mixed of the images to be synthesized and a mixed mode algorithm;
wherein said analyzing the active pixels in the neighborhood candidate set comprises:
analyzing whether each pixel in the neighborhood candidate pixel set is valid according to the coefficient matrix of the neighborhood pixel set;
determining an effective interval of each channel value of the three primary colors according to each channel value of the three primary colors corresponding to the pixel to be mixed and each channel threshold value of the three primary colors;
and if the channel values of the three primary colors corresponding to the pixels in the neighborhood candidate pixel set are in the corresponding effective interval, determining the pixels as effective pixels.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710801070.0A CN109472763B (en) | 2017-09-07 | 2017-09-07 | Image synthesis method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710801070.0A CN109472763B (en) | 2017-09-07 | 2017-09-07 | Image synthesis method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109472763A CN109472763A (en) | 2019-03-15 |
CN109472763B true CN109472763B (en) | 2020-12-08 |
Family
ID=65657592
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710801070.0A Active CN109472763B (en) | 2017-09-07 | 2017-09-07 | Image synthesis method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109472763B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5630037A (en) * | 1994-05-18 | 1997-05-13 | Schindler Imaging, Inc. | Method and apparatus for extracting and treating digital images for seamless compositing |
CN1217126A (en) * | 1996-04-30 | 1999-05-19 | Cfb(新图象设计中心)有限公司 | Device and process for producing composite picture |
CN1510656A (en) * | 2002-11-27 | 2004-07-07 | 松下电器产业株式会社 | Displaying device, method and programm |
CN105578094A (en) * | 2015-12-18 | 2016-05-11 | 深圳市帅映科技有限公司 | Image edge fusion processing system |
-
2017
- 2017-09-07 CN CN201710801070.0A patent/CN109472763B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5630037A (en) * | 1994-05-18 | 1997-05-13 | Schindler Imaging, Inc. | Method and apparatus for extracting and treating digital images for seamless compositing |
CN1217126A (en) * | 1996-04-30 | 1999-05-19 | Cfb(新图象设计中心)有限公司 | Device and process for producing composite picture |
CN1510656A (en) * | 2002-11-27 | 2004-07-07 | 松下电器产业株式会社 | Displaying device, method and programm |
CN105578094A (en) * | 2015-12-18 | 2016-05-11 | 深圳市帅映科技有限公司 | Image edge fusion processing system |
Non-Patent Citations (2)
Title |
---|
Multiscaled Texture Synthesis Using Multisized Pixel Neighborhoods;Feng Dong等;《 IEEE Computer Graphics and Applications》;20070507;第27卷(第3期);41-47 * |
高效图像合成技术研究;吴昊;《中国博士学位论文全文数据库信息科技辑》;20140515(第5期);I138-38 * |
Also Published As
Publication number | Publication date |
---|---|
CN109472763A (en) | 2019-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020038124A1 (en) | Image contrast enhancement method and apparatus, and device and storage medium | |
TWI467516B (en) | Method for color feature extraction | |
KR101658719B1 (en) | Display method of area extraction results, and image processing device | |
JP5567063B2 (en) | Method for processing highlight and saturation regions in digital images | |
US20150022518A1 (en) | Image process device, image process method, and image process program | |
US20150077639A1 (en) | Color video processing system and method, and corresponding computer program | |
MX2008001154A (en) | Image blending. | |
CN102722872B (en) | Method for eliminating local highlight blooming of digital image | |
US9292732B2 (en) | Image processing apparatus, image processing method and computer program product | |
JP2010066803A (en) | Image processing apparatus and method, and program | |
KR101719431B1 (en) | Image processing apparatus and image processing method | |
CN103942756B (en) | A kind of method of depth map post processing and filtering | |
WO2012121412A1 (en) | Methods of image upscaling based upon directional interpolation | |
CN110111342B (en) | Optimized selection method and device for matting algorithm | |
US20130121565A1 (en) | Method and Apparatus for Local Region Selection | |
CN106875328B (en) | Image processing method and device | |
CN109472763B (en) | Image synthesis method and device | |
KR20100122381A (en) | Apparatus and method for painterly rendering | |
CN109242750B (en) | Picture signature method, picture matching method, device, equipment and storage medium | |
JP2009050035A (en) | Image processing method, image processing system, and image processing program | |
JP2007243987A (en) | Image processing method, image processing system, and image processing program | |
CN110035267B (en) | Image enhancement circuit and method | |
CN107886550B (en) | Image editing propagation method and system | |
JP6126054B2 (en) | Image signal processing method and image signal processing apparatus | |
JP2014045398A (en) | Image processing apparatus, and image processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |