Nothing Special   »   [go: up one dir, main page]

USRE44983E1 - Zoom algorithm - Google Patents

Zoom algorithm Download PDF

Info

Publication number
USRE44983E1
USRE44983E1 US13/101,064 US201113101064A USRE44983E US RE44983 E1 USRE44983 E1 US RE44983E1 US 201113101064 A US201113101064 A US 201113101064A US RE44983 E USRE44983 E US RE44983E
Authority
US
United States
Prior art keywords
image
pixels
destination
interest
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/101,064
Inventor
Detlef Schweng
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tp Link Usa Corp
Original Assignee
Youliza Gehts BV LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Youliza Gehts BV LLC filed Critical Youliza Gehts BV LLC
Priority to US13/101,064 priority Critical patent/USRE44983E1/en
Assigned to YOULIZA, GEHTS B.V. LIMITED LIABILITY COMPANY reassignment YOULIZA, GEHTS B.V. LIMITED LIABILITY COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DIGITAL IMAGING SYSTEMS GMBH
Application granted granted Critical
Publication of USRE44983E1 publication Critical patent/USRE44983E1/en
Assigned to GULA CONSULTING LIMITED LIABILITY COMPANY reassignment GULA CONSULTING LIMITED LIABILITY COMPANY MERGER (SEE DOCUMENT FOR DETAILS). Assignors: YOULIZA, GEHTS B.V. LIMITED LIABILITY COMPANY
Assigned to INTELLECTUAL VENTURES ASSETS 192 LLC reassignment INTELLECTUAL VENTURES ASSETS 192 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GULA CONSULTING LIMITED LIABILITY COMPANY
Assigned to TP-LINK USA CORPORATION reassignment TP-LINK USA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES ASSETS 192 LLC
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/403—Edge-driven scaling; Edge-based scaling

Definitions

  • This invention relates generally to image processing and relates more particularly to methods to zoom digital images.
  • Either still images or time-varying image sequences are the input to digital imaging systems.
  • a digital zoom capability uses algorithms and zooms in on the digital image in the camera. This can greatly improve the zoom capability of the camera and is less expensive than high-sophisticated zoom lenses, but also loses some image quality. The quality depends upon the algorithms used for zooming.
  • the challenge of the designers of digital zooming systems is to achieve fast performing methods for zooming providing good quality images and which are easy to be implemented.
  • U.S. Patent (U.S. Pat. No. 6,101,235 to Zavaljevski et al.) describes methods and apparatus for altering the spatial characteristics of a digital image collected in a CT system using a real-time magnification algorithm.
  • an enlarged image is generated by interpolating and filtering the original digital image data.
  • two pass linear interpolation and one-dimensional filtering is utilized to generate the enlarged image. The first pass performs interpolation in the x direction and the second pass performs interpolation in the y direction. The interpolations in the x and y directions are performed in two steps. Initially, linear interpolation is applied to the original digital image to generate interpolated data.
  • a one dimensional convolution filter is then applied to the interpolated data. Utilizing this process, a high quality enlarged image may be generated for any integer zoom factor.
  • a two-step procedure of interpolation and two-dimensional filtering is utilized. The first step performs bilinear interpolation of the digital image to generate interpolated data. The interpolated data is then filtered by a two-dimensional convolution filter.
  • U.S. Patent U.S. Pat. No. 5,602,870 to Hailey et al. discloses a spatial interpolation unit used to alter a digital image by performing a zoom operation thereon. Described is a spatial interpolation unit, which comprises a discrete set of filters for which at least some of the cut-off frequencies are logarithmically spaced.
  • U.S. Patent (U.S. Pat. No. 5,307,167 to Park et al.) describes a digital zoom system utilizing image buffers and employing an approximated bilinear interpolation method.
  • the zoom system includes an analog-to-digital (A/D) converter for converting an analog image signal to a digital image signal, an image buffer for storing the digital image signal generated for said A/D converter, a horizontal operation circuit for interpolating the digital image signal taken along with a horizontal direction, one or more horizontal image buffers for storing the digital image signal for 1-horizontal lines magnified in a horizontal direction, a vertical operation circuit for interpolating said horizontally magnified image signal in a vertical direction, a timing controller for controlling the image buffer, said horizontal and vertical operation circuits, and a digital-to-analog (D/A) converter for converting the digital image signal finally magnified in the horizontal and vertical direction back to analog image signal.
  • A/D analog-to-digital
  • D/A digital-to-analog
  • a principal object of the present invention is to achieve a fast and efficient way to zoom a digital image.
  • a method to zoom a region of interest from a digital image comprises the following steps: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of rows of pixels of destination image according to scale of conversion desired in y-direction, (4) calculate number of pixels contained in a row of pixels of destination image according to scale of conversion desired in x-direction, (5) calculate color values of each pixel along the rows of pixels of the destination image by interpolation from nearest row of pixels of source image, and (6) display zoomed region of interest in destination image.
  • Said method comprises the following steps: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of columns of pixels of destination image according to scale of conversion desired in x-direction, (4) calculate number of pixels contained in a column of pixels of destination image according to scale of conversion desired y-direction, (5) calculate color values of columns of pixels of destination image by interpolation from nearest column of pixels of source image, and (6) display zoomed region of interest in destination image.
  • Said method comprises the following steps, first: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of rows of pixels of destination image according to scale of conversion desired in y-direction, and (4) calculate number of pixels contained in a row of pixels of destination image according to scale of conversion desired in x-direction.
  • the method invented comprises the steps: (5) calculate x, y virtual starting point of destination pixel for each frame, (6) calculate virtual location of first destination pixel for new row in x-direction and interpolate new color values of color space of said first destination pixel from nearest source pixels located at nearest row of source pixels in y-direction, (7) calculate virtual position of next destination pixel in x-direction according to scale factor and interpolate new color values of color space used of said next pixel from nearest source pixels located at nearest row of source pixels in y-direction, (8) go to next step (8) if last destination pixel in x-direction has been reached otherwise go to step (6), (9) go to step (11) if last row of destination pixels has been reached otherwise go to next step (9), (10) calculate virtual location of next row in y-direction according to scale factor in y-direction and go to step (5), and (11) display zoomed region of interest in destination image.
  • Said method comprises the following steps, first: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of columns of pixels of destination image according to scale of conversion desired in x-direction, (4) calculate number of pixels contained in a column of pixels of destination image according to scale of conversion desired in y-direction, and (5) calculate x, y virtual starting point of destination pixel for each frame.
  • the method invented comprises the steps: (6) calculate virtual location of first destination pixel for new column in y-direction and interpolate new color values of color space of said first destination pixel from nearest source pixels located at nearest column of source pixels in x-direction, (7) calculate virtual position of next destination pixel in y-direction according to scale factor and interpolate new color values of color space used of said next pixel from nearest source pixels located at nearest column of source pixels in x-direction, (8) go to next step (8) if last destination pixel in y-direction has been reached otherwise go to step (6), (9) go to step (11) if last column of destination pixels has been reached otherwise go to next step (9), (10) calculate virtual location of next column in x-direction according to scale factor in x-direction and go to step (5), and (11) display zoomed region of interest in destination image.
  • FIG. 1 shows the major components of zooming of a digital image.
  • FIG. 2 shows a flowchart of a method how to zoom a digital image.
  • FIG. 3 shows a detailed flowchart of a method how to zoom a digital image.
  • the preferred embodiments disclose a novel method to zoom digital images. Said method is based on the methods to convert the resolution of digital images disclosed with U.S. patent application Ser. No. 10/830,329 docket number DS03-025, filed Apr. 27, 2004 and assigned to the same assignee as the present invention.
  • U.S. patent application Ser. No. 10/830,329 docket number DS03-025 filed Apr. 27, 2004 and assigned to the same assignee as the present invention.
  • the methods of the present invention apply to video images as well as to still images of a digital camera.
  • FIG. 1 shows the basic components of digital zooming.
  • a source image 1 There is a source image 1 , a region of interest (area to be zoomed) 2 , and a destination image 3 .
  • Said destination image 3 has a fixed size.
  • the region of interest 2 has a shape of a rectangle and is defined by e.g. the coordinates x uc , y uc of the upper left corner, the length x le in x-direction and the width y w in y-direction.
  • x uc , y uc , x le , and y w are variables and define the zooming factors in x- and y-direction compared to the fixed rectangular size of the destination image 3 having a fixed length x f and fixed width y f .
  • Other parameters to define the region of interest are possible as well, e.g. the coordinates of corners of the rectangle being located diagonally to each other.
  • the resolution of the region of interest is either decimated or enlarged to fit into the destination image.
  • the destination image 3 can be larger or smaller than the region of interest 2 , depending upon the zooming factors in x- and y-direction.
  • rectangles for the region of interest and for the destination image, e.g. circles, are possible as well.
  • Using rectangles is the simplest way to achieve zooming.
  • the methods invented apply to video images as well to still images of a digital camera.
  • the flowchart of FIG. 2 shows the principal steps of a method to zoom a digital image.
  • the first step 21 describes the definition of the size and location of the region of interest, in other words of the area to be zoomed.
  • said definition is performed according to the example shown in FIG. 1 , using the coordinates x uc , y uc of the upper left corner of the region of interest, its length x le in x-direction and its width y w in y-direction.
  • Another alternative to define the size and location of the region of interest could be to define the location of two corners, being located diagonally to each other as e.g.
  • Said methods describe a very fast and simple way to decrease or to increase the resolution of digital images and still maintain an acceptable quality of the images.
  • the method invented comprises a combination of using simultaneously two different procedures, first, a decimation filter, or interpolation, along one coordinate to calculate the color values of the destination pixels and, second, omitting some rows of source pixels along the other coordinate of an image according to the scale of conversion.
  • the method invented comprises a similar combination of procedures, first, an interpolation of source pixels to calculate the color values of the increased number of destination pixels, second, an extrapolation of the color values of the destination pixels being very close to the edges of the destination image, and, third, a replication of rows of the destination image to gain additional rows of destination pixels according to the scale of enlargement.
  • Step 22 of the flowchart of FIG. 2 describes the calculation of the scale of conversion in x- and y-direction from the region of interest to get the destination image.
  • the scale of conversion is calculated in x-direction using the following equation:
  • offsetx is the scale of decimation in x-direction
  • X LE is the length of the region of interest
  • X F is the fixed length of the destination image (as shown in FIG. 1 ).
  • the scale of conversion is calculated in y-direction using the following equation:
  • Step 23 describes the calculation of number of rows of pixels of the destination image according to scale of conversion desired in y-direction and calculated in the previous step. In case of decimation of the region of interest some rows of the region of interest will be omitted, in case of enlargement additional rows will be replicated.
  • step 24 the number of pixels contained in a row of pixels of the destination image is calculated according to the scale of conversion desired in x-direction and calculated in step 22 .
  • the following step 25 comprises the calculation of the color values of each pixel along the rows of pixels of the destination image by interpolation from nearest row of the source image (region of interest).
  • the last step 26 comprises the display of the zoomed region of interest in destination image.
  • FIG. 3 describes in more details a method of the present invention to zoom a digital image.
  • the first step 300 describes the definition of the size and location of the region of interest, in other words of the area to be zoomed.
  • said definition is performed according to the example shown in FIG. 1 , using the coordinates x uc , y uc of the upper left corner of the region of interest, its length x le in x-direction and its width y w in y-direction.
  • Another alternative to define the size and location of the region of interest could be to define the location of the upper left corner and the location of the bottom left corner and calculate the length and the width of the region of interest using the coordinates of these two corners. Many more definitions are possible.
  • Step 301 of said method comprises the calculation of the scale of conversion in x- and y-direction.
  • the scale of conversion offsetx is in x-direction is
  • the next step 302 comprises the calculation of number of rows of pixels of the destination image according to the scale of conversion desired in y-direction.
  • the following step 303 describes the calculation of the number of pixels contained in a row of pixels of the destination image according to the scale of conversion required in x-direction.
  • the following step 304 comprises the calculation of the x, y coordinates of the virtual starting point of destination pixels for a new frame. Said starting point, which is the middle of the first pixel, is calculated using the conversion scales calculated in the previous step.
  • the location of the starting point calculated is a “virtual” location; it is used for interpolation only. It does not describe the actual physical location of the destination pixel.
  • pixelwidthy is the width of a source pixel in y-direction.
  • the pixelwidth of a source image is identical in x- and y-direction.
  • said distance dist1y is used to locate and identify the nearest row of pixels of the source image and distance dist1x is used to locate the nearest pixels of said nearest row of the source image for the purpose of interpolation in x-direction.
  • step 305 the starting point of the first destination pixel in x-direction for a new row and the color values of said first pixel of a new row of the destination image are calculated.
  • the number of color values to be calculated depends upon the color space used.
  • the calculation of the starting point of step 305 is identical to the calculation used in step 304 .
  • the color values of the first pixel of a new row of the destination image are calculated by interpolation. In a preferred embodiment a linear interpolation of the color values of the two nearest pixels of the source image has been used. All color values of the color space used get interpolated to define the colors of the first pixel of a new row of the destination image.
  • the color space used could be e.g. RGB, YcbCr, YUV or any other color space comprising three or more colors.
  • nth order In case YUV color space is used luminance would be handled the same way as chrominance. Any polynomial of nth order could be used for interpolation, although order 0 (taking the color value of the nearest pixel) and order 1 (linear interpolation of the color values of the nearest two pixels) are the simplest polynomials to be used. In a preferred embodiment an interpolation of order 1 is used with the exception of pixels of the destination image having a virtual position between the first, or most left-sided, pixel of the nearest row of the source image and the left side edge of the image or correspondingly between the last, or most right-sided, pixel of the nearest row of the source image and the right-side edge of the image. For these “peripheral” pixels an interpolation of the order 0 is used, this means the first, or correspondingly, the last pixel of the nearest row of the source image is replicated.
  • neighboring pixels outside the region of interest can be used alternatively in order to enable an interpolation of order 1 for the peripheral pixels of the region of interest, thus achieving a better quality at the border of the destination image.
  • step 306 the “virtual” position of the next destination pixel in x-direction of the current y-line according to the scale factor is calculated as described above, and the correspondent color values of all colors of the color space used are calculated by an interpolation of the correspondent color values of the nearest source pixels.
  • the next step 307 checks if the last pixel location in the current y-line of the destination imaged has been reached. In case the last pixel location has not been reached the process flow goes back to step 306 and the next “virtual” location is calculated and the correspondent color values are interpolated. In case the last destination location in x-direction has been reached the process flow goes to step 308 . Step 308 checks if the last row in y-direction has been reached. In case the last row in y-direction has been reached the resolution of the source image has been successfully converted and the process flow goes to the last step 310 .
  • Step 310 describes the display of the zoomed region of interest in the destination image.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

Methods to zoom a region of interest from a digital image have been achieved. The methods invented support according to the scale of zooming the decrease or the increase of the resolution of digital images. The region of interest to be zoomed is variable; the destination image has a fixed size. In case of a decrease of the resolution of the region of interest the method invented combines interpolating source pixels to calculate the color values of the destination pixels and omitting some rows of source pixels. In case of enlargement the method invented combines interpolation of the source pixels to calculate the color values of the destination pixels, extrapolation of the destination pixels being close to the edge of the image, and replication of some of the interpolated rows of the destination image to gain additional rows according to the scale of the increase of resolution (enlargement) of a digital image.

Description

This application is related to U.S. patent application Ser. No. 10/830,329, filed Apr. 27, 2004 and assigned to the same assignee as the present invention.
BACKGROUND OF THE INVENTION
(1) Field of the Invention
This invention relates generally to image processing and relates more particularly to methods to zoom digital images.
(2) Description of the Prior Art
Either still images or time-varying image sequences are the input to digital imaging systems. A digital zoom capability uses algorithms and zooms in on the digital image in the camera. This can greatly improve the zoom capability of the camera and is less expensive than high-sophisticated zoom lenses, but also loses some image quality. The quality depends upon the algorithms used for zooming.
The challenge of the designers of digital zooming systems is to achieve fast performing methods for zooming providing good quality images and which are easy to be implemented.
There are various patents known dealing with said problems:
U.S. Patent (U.S. Pat. No. 6,101,235 to Zavaljevski et al.) describes methods and apparatus for altering the spatial characteristics of a digital image collected in a CT system using a real-time magnification algorithm. In accordance with one embodiment of the algorithm, once the digital image is collected, an enlarged image is generated by interpolating and filtering the original digital image data. In one aspect, two pass linear interpolation and one-dimensional filtering is utilized to generate the enlarged image. The first pass performs interpolation in the x direction and the second pass performs interpolation in the y direction. The interpolations in the x and y directions are performed in two steps. Initially, linear interpolation is applied to the original digital image to generate interpolated data. A one dimensional convolution filter is then applied to the interpolated data. Utilizing this process, a high quality enlarged image may be generated for any integer zoom factor. In another aspect of the present invention, a two-step procedure of interpolation and two-dimensional filtering is utilized. The first step performs bilinear interpolation of the digital image to generate interpolated data. The interpolated data is then filtered by a two-dimensional convolution filter.
U.S. Patent (U.S. Pat. No. 5,602,870 to Hailey et al.) discloses a spatial interpolation unit used to alter a digital image by performing a zoom operation thereon. Described is a spatial interpolation unit, which comprises a discrete set of filters for which at least some of the cut-off frequencies are logarithmically spaced.
U.S. Patent (U.S. Pat. No. 5,307,167 to Park et al.) describes a digital zoom system utilizing image buffers and employing an approximated bilinear interpolation method. The zoom system includes an analog-to-digital (A/D) converter for converting an analog image signal to a digital image signal, an image buffer for storing the digital image signal generated for said A/D converter, a horizontal operation circuit for interpolating the digital image signal taken along with a horizontal direction, one or more horizontal image buffers for storing the digital image signal for 1-horizontal lines magnified in a horizontal direction, a vertical operation circuit for interpolating said horizontally magnified image signal in a vertical direction, a timing controller for controlling the image buffer, said horizontal and vertical operation circuits, and a digital-to-analog (D/A) converter for converting the digital image signal finally magnified in the horizontal and vertical direction back to analog image signal.
SUMMARY OF THE INVENTION
A principal object of the present invention is to achieve a fast and efficient way to zoom a digital image.
In accordance with the object of this invention a method to zoom a region of interest from a digital image has been achieved. Said method comprises the following steps: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of rows of pixels of destination image according to scale of conversion desired in y-direction, (4) calculate number of pixels contained in a row of pixels of destination image according to scale of conversion desired in x-direction, (5) calculate color values of each pixel along the rows of pixels of the destination image by interpolation from nearest row of pixels of source image, and (6) display zoomed region of interest in destination image.
In accordance with the object of this invention another method to zoom a region of interest from a digital image has been achieved. Said method comprises the following steps: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of columns of pixels of destination image according to scale of conversion desired in x-direction, (4) calculate number of pixels contained in a column of pixels of destination image according to scale of conversion desired y-direction, (5) calculate color values of columns of pixels of destination image by interpolation from nearest column of pixels of source image, and (6) display zoomed region of interest in destination image.
In accordance with the object of this invention another method to zoom a region of interest from a digital image has been achieved. Said method comprises the following steps, first: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of rows of pixels of destination image according to scale of conversion desired in y-direction, and (4) calculate number of pixels contained in a row of pixels of destination image according to scale of conversion desired in x-direction. Furthermore the method invented comprises the steps: (5) calculate x, y virtual starting point of destination pixel for each frame, (6) calculate virtual location of first destination pixel for new row in x-direction and interpolate new color values of color space of said first destination pixel from nearest source pixels located at nearest row of source pixels in y-direction, (7) calculate virtual position of next destination pixel in x-direction according to scale factor and interpolate new color values of color space used of said next pixel from nearest source pixels located at nearest row of source pixels in y-direction, (8) go to next step (8) if last destination pixel in x-direction has been reached otherwise go to step (6), (9) go to step (11) if last row of destination pixels has been reached otherwise go to next step (9), (10) calculate virtual location of next row in y-direction according to scale factor in y-direction and go to step (5), and (11) display zoomed region of interest in destination image.
In accordance with the object of this invention another method to zoom a region of interest from a digital image has been achieved. Said method comprises the following steps, first: (1) define size and location of region of interest as part of source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number of columns of pixels of destination image according to scale of conversion desired in x-direction, (4) calculate number of pixels contained in a column of pixels of destination image according to scale of conversion desired in y-direction, and (5) calculate x, y virtual starting point of destination pixel for each frame. Furthermore the method invented comprises the steps: (6) calculate virtual location of first destination pixel for new column in y-direction and interpolate new color values of color space of said first destination pixel from nearest source pixels located at nearest column of source pixels in x-direction, (7) calculate virtual position of next destination pixel in y-direction according to scale factor and interpolate new color values of color space used of said next pixel from nearest source pixels located at nearest column of source pixels in x-direction, (8) go to next step (8) if last destination pixel in y-direction has been reached otherwise go to step (6), (9) go to step (11) if last column of destination pixels has been reached otherwise go to next step (9), (10) calculate virtual location of next column in x-direction according to scale factor in x-direction and go to step (5), and (11) display zoomed region of interest in destination image.
BRIEF DESCRIPTION OF THE DRAWINGS
In the accompanying drawings forming a material part of this description, there is shown:
FIG. 1 shows the major components of zooming of a digital image.
FIG. 2 shows a flowchart of a method how to zoom a digital image.
FIG. 3 shows a detailed flowchart of a method how to zoom a digital image.
 DESCRIPTION OF THE PREFERRED EMBODIMENTS
The preferred embodiments disclose a novel method to zoom digital images. Said method is based on the methods to convert the resolution of digital images disclosed with U.S. patent application Ser. No. 10/830,329 docket number DS03-025, filed Apr. 27, 2004 and assigned to the same assignee as the present invention. In order to be able to use said methods to convert the resolution for zooming the region of interest of the source image has to be defined prior to a change of resolution and the offsets have to be defined in a special way. The methods of the present invention apply to video images as well as to still images of a digital camera.
FIG. 1 shows the basic components of digital zooming. There is a source image 1, a region of interest (area to be zoomed) 2, and a destination image 3. Said destination image 3 has a fixed size. The region of interest 2 has a shape of a rectangle and is defined by e.g. the coordinates xuc, yuc of the upper left corner, the length xle in x-direction and the width yw in y-direction. These parameters xuc, yuc, xle, and yw are variables and define the zooming factors in x- and y-direction compared to the fixed rectangular size of the destination image 3 having a fixed length xf and fixed width yf. Other parameters to define the region of interest are possible as well, e.g. the coordinates of corners of the rectangle being located diagonally to each other. The resolution of the region of interest is either decimated or enlarged to fit into the destination image. The destination image 3 can be larger or smaller than the region of interest 2, depending upon the zooming factors in x- and y-direction.
Other shapes than rectangles for the region of interest and for the destination image, e.g. circles, are possible as well. Using rectangles is the simplest way to achieve zooming.
The methods invented apply to video images as well to still images of a digital camera.
The flowchart of FIG. 2 shows the principal steps of a method to zoom a digital image. The first step 21 describes the definition of the size and location of the region of interest, in other words of the area to be zoomed. In a preferred embodiment said definition is performed according to the example shown in FIG. 1, using the coordinates xuc, yuc of the upper left corner of the region of interest, its length xle in x-direction and its width yw in y-direction. Another alternative to define the size and location of the region of interest could be to define the location of two corners, being located diagonally to each other as e.g. the upper left corner and the location of the bottom right corner and calculate the length and the width of the region of interest using the coordinates of these two corners. Many more definitions are possible. The following steps 22-26 follow the methods of conversion of the resolution of digital images as disclosed in U.S. patent application Ser. No. 10/830,329 filed Apr. 22, 2004.
Said methods describe a very fast and simple way to decrease or to increase the resolution of digital images and still maintain an acceptable quality of the images. In case of a decimation of the resolution of a digital image the method invented comprises a combination of using simultaneously two different procedures, first, a decimation filter, or interpolation, along one coordinate to calculate the color values of the destination pixels and, second, omitting some rows of source pixels along the other coordinate of an image according to the scale of conversion. In case of an increase of the resolution of a digital image the method invented comprises a similar combination of procedures, first, an interpolation of source pixels to calculate the color values of the increased number of destination pixels, second, an extrapolation of the color values of the destination pixels being very close to the edges of the destination image, and, third, a replication of rows of the destination image to gain additional rows of destination pixels according to the scale of enlargement.
Step 22 of the flowchart of FIG. 2 describes the calculation of the scale of conversion in x- and y-direction from the region of interest to get the destination image. The scale of conversion is calculated in x-direction using the following equation:
offsetx = X LE X F ,
wherein offsetx is the scale of decimation in x-direction, XLE is the length of the region of interest, and XF is the fixed length of the destination image (as shown in FIG. 1). The scale of conversion is calculated in y-direction using the following equation:
offsety = Y W Y F ,
wherein offsety is the scale of decimation in y-direction, Yw is the width of the region of interest, and YF is the fixed width of the destination image (as shown in FIG. 1). Step 23 describes the calculation of number of rows of pixels of the destination image according to scale of conversion desired in y-direction and calculated in the previous step. In case of decimation of the region of interest some rows of the region of interest will be omitted, in case of enlargement additional rows will be replicated. In the next step 24 the number of pixels contained in a row of pixels of the destination image is calculated according to the scale of conversion desired in x-direction and calculated in step 22. The following step 25 comprises the calculation of the color values of each pixel along the rows of pixels of the destination image by interpolation from nearest row of the source image (region of interest). The last step 26 comprises the display of the zoomed region of interest in destination image.
FIG. 3 describes in more details a method of the present invention to zoom a digital image. The first step 300 describes the definition of the size and location of the region of interest, in other words of the area to be zoomed. In a preferred embodiment said definition is performed according to the example shown in FIG. 1, using the coordinates xuc, yuc of the upper left corner of the region of interest, its length xle in x-direction and its width yw in y-direction. Another alternative to define the size and location of the region of interest could be to define the location of the upper left corner and the location of the bottom left corner and calculate the length and the width of the region of interest using the coordinates of these two corners. Many more definitions are possible. The following steps 301-309 follow the methods of conversion of the resolution of digital images as disclosed in U.S. patent application U.S. Ser. No. 10/830,329 filed Apr. 22, 2004. Step 301 of said method comprises the calculation of the scale of conversion in x- and y-direction. Using the example shown in FIG. 1, the scale of conversion offsetx is in x-direction is
offsetx = X LE X F ,
wherein XLE is the length of the region of interest, and XF is the fixed length of the destination image (as shown in FIG. 1). The scale of conversion is calculated in y-direction using the following equation:
offsety = Y W Y F ,
wherein offsety is the scale of conversion in y-direction, Yw is the width of the region of interest, and YF is the fixed width of the destination image (as shown in FIG. 1). The next step 302 comprises the calculation of number of rows of pixels of the destination image according to the scale of conversion desired in y-direction. The following step 303 describes the calculation of the number of pixels contained in a row of pixels of the destination image according to the scale of conversion required in x-direction. The following step 304 comprises the calculation of the x, y coordinates of the virtual starting point of destination pixels for a new frame. Said starting point, which is the middle of the first pixel, is calculated using the conversion scales calculated in the previous step. The location of the starting point calculated is a “virtual” location; it is used for interpolation only. It does not describe the actual physical location of the destination pixel. The “virtual” distance dist1x of the middle of the first pixel from the edge of the image in x-directions is:
dist1x=offsetx×pixelwidthx/2,
wherein offsetx is the scale of conversion of the resolution in x-direction calculated in step 301, pixelwidthx is the width of a source pixel in x-direction. The distance dist1y of the middle of the first pixel from the edge of the image in y-directions is:
dist1y=offsety4/2×pixelwidthy/2,
wherein offsety is the scale of conversion of the resolution in y-direction calculated in step 301, pixelwidthy is the width of a source pixel in y-direction. Usually the pixelwidth of a source image is identical in x- and y-direction. As explained above said distance dist1y is used to locate and identify the nearest row of pixels of the source image and distance dist1x is used to locate the nearest pixels of said nearest row of the source image for the purpose of interpolation in x-direction. In step 305 the starting point of the first destination pixel in x-direction for a new row and the color values of said first pixel of a new row of the destination image are calculated. The number of color values to be calculated depends upon the color space used. The calculation of the starting point of step 305 is identical to the calculation used in step 304. Furthermore the color values of the first pixel of a new row of the destination image are calculated by interpolation. In a preferred embodiment a linear interpolation of the color values of the two nearest pixels of the source image has been used. All color values of the color space used get interpolated to define the colors of the first pixel of a new row of the destination image. The color space used could be e.g. RGB, YcbCr, YUV or any other color space comprising three or more colors.
In case YUV color space is used luminance would be handled the same way as chrominance. Any polynomial of nth order could be used for interpolation, although order 0 (taking the color value of the nearest pixel) and order 1 (linear interpolation of the color values of the nearest two pixels) are the simplest polynomials to be used. In a preferred embodiment an interpolation of order 1 is used with the exception of pixels of the destination image having a virtual position between the first, or most left-sided, pixel of the nearest row of the source image and the left side edge of the image or correspondingly between the last, or most right-sided, pixel of the nearest row of the source image and the right-side edge of the image. For these “peripheral” pixels an interpolation of the order 0 is used, this means the first, or correspondingly, the last pixel of the nearest row of the source image is replicated.
In case of enlargement, neighboring pixels outside the region of interest can be used alternatively in order to enable an interpolation of order 1 for the peripheral pixels of the region of interest, thus achieving a better quality at the border of the destination image.
In the following step 306 the “virtual” position of the next destination pixel in x-direction of the current y-line according to the scale factor is calculated as described above, and the correspondent color values of all colors of the color space used are calculated by an interpolation of the correspondent color values of the nearest source pixels.
The next step 307 checks if the last pixel location in the current y-line of the destination imaged has been reached. In case the last pixel location has not been reached the process flow goes back to step 306 and the next “virtual” location is calculated and the correspondent color values are interpolated. In case the last destination location in x-direction has been reached the process flow goes to step 308. Step 308 checks if the last row in y-direction has been reached. In case the last row in y-direction has been reached the resolution of the source image has been successfully converted and the process flow goes to the last step 310. In case the last row in y-direction has not yet reached, the process flow goes to step 309 wherein the “virtual” position of the next row in y-direction of the destination image is calculated and then the process flow goes back to step 305 wherein the location of the first pixel of the new y-row of the destination image and the correspondent color values of said pixel line are calculated. Step 310 describes the display of the zoomed region of interest in the destination image.
It is obvious to those skilled in art that rows and columns could be interchanged as well. This means that the interpolation, described above could be performed also in y-direction from the nearest column of the source image.
While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that to various changes in form and details may be made without departing from the spirit and scope of the invention.

Claims (53)

What is claimed is:
1. A method to zoom a region of interest from a digital source image, wherein a resolution of the region of interest is either decimated reduced or enlarged to fit into a destination image, comprising:
providing a digital camera to implement the following steps:
(1) define defining, with a digital camera, a size and a location of said the region of interest as part of said the source image;
(2) calculate scale of conversion in x- and y-direction;
(3) calculate number of rows of pixels of said destination image according to scale of conversion desired in y-direction;
(4) calculate number of pixels contained in a row of pixels of said destination image according to scale of conversion desired in x-direction;
(5) calculate interpolating, with the digital camera, multiple pixels in the source image to generate color values of each pixel along the rows of pixels of the destination image by interpolation from nearest row of pixels of said source image wherein the color values of the pixels of the destination image being located corresponding to locations within the region of interest in the source image;
replicating, with the digital camera, a first, or correspondingly a last, pixel of a nearest row in the source image for use as color values of pixels in the destination image corresponding to locations between the left side edge of the source image and the a first pixel of the nearest row of pixels of the region of interest of the source image and the color values of the pixels of the destination image being located between the right side edge of the source image and the a last pixel of the nearest row of the source image are achieved by replicating the color values of said first, or correspondingly said last, pixel of the nearest row of the source image; and
(6) displaydisplaying, with the digital camera, the zoomed region of interest in saidthe destination image.
2. The method of claim 1 wherein interpolating the color values of each pixel along rows of pixels of the destination image is performed by a linear interpolation method has been used from a nearest row of pixels of the source image.
3. The method of claim 1 wherein the color values of the pixels of the destination image being located between the left side edge of the source image and the first pixel of the nearest row of pixels of the region of interest of the source image and the color values of the pixels of the destination image being located between the right side edge of the source image and the last pixel of the nearest row of the source image are achieved by interpolating the color values of said the first, or correspondingly said the last, pixel of the nearest row of the source image with a neighboring pixels pixel outside the region of interest of the source image.
4. The method of claim 1 wherein said the digital image is a color image using any color space.
5. The method of claim 4 wherein said the color space is a R-G-B color space.
6. The method of claim 4 wherein said the color space is an YCbCr color space.
7. The method of claim 1 wherein said the digital image is a video image.
8. The method of claim 1 wherein said the digital image is a still image from a digital camera.
9. The method of claim 1 wherein said the region of interest has the shape of a rectangle.
10. The method of claim 1 wherein said the destination image has the shape of a rectangle.
11. The method of claim 1 wherein said method invented is used the digital camera is configured to convert the resolution of the region of interest in any direction.
12. The method of claim 1 wherein said method invented is implemented using the digital camera is configured to use one common software program.
13. A method to zoom a region of interest from a digital source image, wherein a resolution of the region of interest is either decimated reduced or enlarged to fit into a destination image, providing a digital camera to implement the following steps the method comprising:
(1) definedefining, with a digital camera, a size and a location of saidthe region of interest as part of saidthe source image;
(2) calculate scale of conversion in x-and y-direction;
(3) calculate number of columns of pixels of said destination image according to scale of conversion desired in x-direction;
(4) calculate number of pixels contained in a column of pixels of said destination image according to scale of conversion desired in y-direction;
(5) calculate interpolating, with the digital camera, multiple pixels in the source image to generate color values of columns of pixels of said the destination image by interpolation from nearest column of pixels of source image wherein the color values of the pixels of the destination image being located corresponding to locations within the region of interest in the source image;
replicating, with the digital camera, a first, or correspondingly a last, pixel of a nearest column in the source image for use as color values of pixels in the destination image corresponding to locations between the upper side edge of the source image and the first pixel of the nearest column of pixels of the source image and the color values of the pixels of the destination image being located between the bottom side edge of the source image and the last pixel of the nearest column of the source image are achieved by replicating the color values of said first, or correspondingly said last, pixel of the nearest column of the source image.; and
(6) displaydisplaying, with the digital camera, the zoomed region of interest in saidthe destination image.
14. The method of claim 13 wherein interpolating the color values of each pixel along rows of pixels of the destination image is performed by a linear interpolation method has been used from the nearest column of pixels of the source image.
15. The method of claim 13 wherein the color values of the pixels of the destination image being located between the left side edge of the source image and the first pixel of the nearest row of pixels of the region of interest of the source image and the color values of the pixels of the destination image being located between the right side edge of the source image and the last pixel of the nearest row of the source image are achieved by interpolating the color values of said the first, or correspondingly said the last, pixel of the nearest row of the source image with a neighboring pixels pixel outside the region of interest of the source image.
16. The method of claim 13 wherein said digital image is a color image using any color space.
17. The method of claim 16 wherein said the color space is a R-G-B color space.
18. The method of claim 16 wherein said the color space is an YCbCr color space.
19. The method of claim 13 wherein said the digital image is a video image.
20. The method of claim 13 wherein said the digital image is a still image from a digit digital camera.
21. The method of claim 13 wherein said method invented is used the digital camera is configured to convert the resolution of the region of interest in any direction.
22. The method of claim 13 wherein said the region of interest has the shape of a rectangle.
23. The method of claim 13 wherein said the destination image has the shape of a rectangle.
24. The method of claim 13 wherein said method invented is implemented using the digital camera is configured to use one common software program.
25. A method to zoom a region of interest from a digital source image, wherein a resolution of the region of interest is either decimated reduced or enlarged to fit into a destination image, comprising:
providing a digital camera to implement the following steps:
(1) define size and location of said region of interest as part of said source image;
(2) calculate the scale of conversion of the resolution in x-and y-direction;
(3) calculate number of rows of pixels of said destination image according to scale of conversion desired in y-direction;
(4) calculate number of pixels contained in a row of pixels of said destination image according to scale of conversion desired in x-direction;
(5) calculate x, y virtual starting point of said destination pixel for each frame;
(6) calculate calculating, with a digital camera, a virtual location of first destination pixel for a new row in an x-direction and interpolate;
replicating, with the digital camera, a first, or correspondingly, a last, pixel of a nearest row of a source image to generate a new color values value of color space of said the first destination pixel from nearest source pixels located at nearest row of source pixels in y-direction wherein the color values of the pixels of the destination image being located corresponding to a location between the left side edge of the source image and the first pixel of the nearest row of pixels of the source image and the color values of the pixels of the destination image being located or between the right side edge of the source image and the last pixel of the nearest row of the source image are achieved by replicating the color values of said first, or correspondingly said last, pixel of the nearest row of the source image;
(7) calculatecalculating, with the digital camera, a virtual position of next destination pixel in the x-direction according to a scale factor and interpolatebetween the region of interest of the source image and the destination image, wherein the virtual position of next destination pixel corresponds to a location within the region of interest in the source image;
interpolating, with the digital camera, new color values of color space used of said the next destination pixel from nearest source pixels located at a nearest row of source pixels in the y-direction wherein the color values of the pixels of the destination image being located between the left side edge of the source image and the first pixel of the nearest row of pixels of the source image and the color values of the pixels of the destination image being located between the right side edge of the source image and the last pixel of the nearest row of the source image are achieved by replicating the color values of said first, or correspondingly said last, pixel of the nearest row of the source image; and
(8) go to next step (9) if last destination pixel in x-direction has been reached otherwise go to step (6);
(9) go to step (11) if last row of destination pixels has been reached otherwise go to next step (10);
(10) calculate virtual location of next row in y-direction according to scale factor in y-direction and go to step (5); and
(11) display displaying, with the digital camera, the zoomed region of interest in said the destination image.
26. The method of claim 25 wherein a interpolating the new color values of color space is performed through linear interpolation method has been used.
27. The method of claim 25 wherein the color values of the pixels of the destination image being located between the left side edge of the source image and the first pixel of the nearest row of pixels of the region of interest of the source image and the color values of the pixels of the destination image being located between the right side edge of the source image and the last pixel of the nearest row of the source image are achieved by interpolating the color values of said the first, or correspondingly said the last, pixel of the nearest row of the source image with a neighboring pixels pixel outside the region of interest of the source image.
28. The method of claim 25 wherein said the digital image is a color image using any color space.
29. The method of claim 28 wherein said the color space is a R-G-B color space.
30. The method of claim 25 wherein said the color space is an YCbCr color space.
31. The method of claim 25 wherein said the digital image is a video image.
32. The method of claim 25 wherein said the digital image is a still image from a digital camera.
33. The method of claim 25 wherein said method invented is used the digital camera is configured to convert the resolution of the region of interest in any direction.
34. The method of claim 25 wherein said the region of interest has the shape of a rectangle.
35. The method of claim 25 wherein said the destination image has the shape of a rectangle.
36. The method of claim 25 wherein said method invented is implemented using the digital camera is configured to use one common software program.
37. A method to zoom a region of interest from a digital source image, wherein a resolution of the region of interest is either decimated reduced or enlarged to fit into a destination image, comprising:
providing a digital camera to implement the following steps:
(1) define size and location of said region of interest as part of said source image;
(2) calculate the scale of decimation in x-and y-direction;
(3) calculate number of columns of pixels of said destination image according to scale of conversion desired in x-direction;
(4) calculate number of pixels contained in a column of pixels of said destination image according to scale of conversion desired in y-direction;
(5) calculate x, y virtual starting point of a destination pixel for each frame;
(6) calculate calculating, with a digital camera, a virtual location of first destination pixel for new column in a y-direction and interpolate new;
determining, with the digital camera, a color values value of color space of said the first destination pixel, wherein the determining of the color value comprises selecting, based on a location of the first destination pixel relative to the region of interest, between interpolating the color value from nearest source pixels located at nearest column of source pixels in a x-direction replicating the color value corresponding to the first destination pixel in the source image;
(7) calculatecalculating, with the digital camera, a virtual position of next destination pixel in the y-direction according to a scale factor and interpolate newbetween the region of interest and the destination image;
determining, with the digital camera, a color values value of color space used of said the next destination pixel, wherein the determining of the color value comprises selecting, based on a location of the next destination pixel relative to the region of interest, between interpolating the color value from nearest source pixels located at nearest column of source pixels in x-direction or replicating the color value corresponding to the next destination pixel in the source image; and
(8) go to next step (9) if last destination pixel in y-direction has been reached otherwise go to step (6);
(9) go to step (11) if last column of destination pixels has been reached otherwise go to next step (10);
(10) calculate virtual location of next column in x-direction according to scale factor in x-direction and go to step (5); and
(11) display displaying, with a digital camera, the zoomed region of interest in said the destination image.
38. An apparatus comprising:
a digital camera configured to reduce or enlarge a region of interest in a source image to fit into a destination image and to interpolate color values for pixels in the destination image corresponding to locations within the region of interest from multiple pixels in the source image, wherein the digital camera is configured to replicate a color value of a first pixel or a last pixel of a nearest row of the source image to achieve the color values of the pixels of the destination image located between a left side edge of the source image and the first pixel of the nearest row of pixels in the region of interest of the source image or to achieve the color values of the pixels of the destination image being located between a right side edge of the source image and the last pixel of the nearest row of the source image.
39. The apparatus of claim 38, wherein the digital camera is configured to display the enlarged region of interest in the destination image.
40. The apparatus of claim 38, wherein the digital camera is configured to display the reduced region of interest in the destination image.
41. The apparatus of claim 38, wherein the digital camera is configured to determine a scaling factor between the region of interest in the source image and the destination image, and to reduce or enlarge the region of interest to fit into the destination image based on the scaling factor.
42. The apparatus of claim 38, wherein the digital camera is configured to identify a location of the region of interest in the source image from a point in the source image and a size of sides of the region of interest.
43. The apparatus of claim 38, wherein the digital camera is configured to determine a number of rows or columns in the destination image.
44. The apparatus of claim 43, wherein the digital camera is configured to eliminate at least one row or column from the source image to fit the region of interest in the destination image.
45. The apparatus of claim 43, wherein the digital camera is configured to interpolate at least one additional row or column from the source image to fit the region of interest in the destination image.
46. An apparatus comprising:
a digital camera configured to reduce or enlarge a region of interest in a source image to fit into a destination image and to interpolate color values for pixels in the destination image corresponding to locations within the region of interest from multiple pixels in the source image, wherein the digital camera is configured to replicate a color value of a first pixel or a last pixel of a nearest column of the source image to achieve the color values of the pixels of the destination image located between an upper side edge of the source image and the first pixel of the nearest column of pixels in the region of interest of the source image or to achieve the color values of the pixels of the destination image being located between a bottom side edge of the source image and the last pixel of the nearest column of the source image.
47. The apparatus of claim 46, wherein the digital camera is configured to display the enlarged region of interest in the destination image.
48. The apparatus of claim 46, wherein the digital camera is configured to display the reduced region of interest in the destination image.
49. The apparatus of claim 46, wherein the digital camera is configured to determine a sealing factor between the region of interest in the source image and the destination image, and to reduce or enlarge the region of interest to fit into the destination image based on the scaling factor.
50. The apparatus of claim 46, wherein the digital camera is configured to identify a location of the region of interest in the source image from a point in the source image and a size of sides of the region of interest.
51. The apparatus of claim 46, wherein the digital camera is configured to determine a number of rows or columns in the destination image.
52. The apparatus of claim 51, wherein the digital camera is configured to eliminate at least one row or column from the source image to fit the region of interest in the destination image.
53. The apparatus of claim 51, wherein the digital camera is configured to interpolate at least one additional row or column from the source image to fit the region of interest in the destination image.
US13/101,064 2004-03-30 2011-05-04 Zoom algorithm Active 2026-05-16 USRE44983E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/101,064 USRE44983E1 (en) 2004-03-30 2011-05-04 Zoom algorithm

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP04392014A EP1583031A1 (en) 2004-03-30 2004-03-30 Zoom algorithm
EP04392014 2004-03-30
US10/830,154 US7529427B2 (en) 2004-03-30 2004-04-22 Zoom algorithm
US13/101,064 USRE44983E1 (en) 2004-03-30 2011-05-04 Zoom algorithm

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/830,154 Reissue US7529427B2 (en) 2004-03-30 2004-04-22 Zoom algorithm

Publications (1)

Publication Number Publication Date
USRE44983E1 true USRE44983E1 (en) 2014-07-01

Family

ID=34878353

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/830,154 Ceased US7529427B2 (en) 2004-03-30 2004-04-22 Zoom algorithm
US13/101,064 Active 2026-05-16 USRE44983E1 (en) 2004-03-30 2011-05-04 Zoom algorithm

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/830,154 Ceased US7529427B2 (en) 2004-03-30 2004-04-22 Zoom algorithm

Country Status (2)

Country Link
US (2) US7529427B2 (en)
EP (1) EP1583031A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1583031A1 (en) 2004-03-30 2005-10-05 Dialog Semiconductor GmbH Zoom algorithm
US7502063B2 (en) 2004-08-09 2009-03-10 Aptina Imaging Corporation Camera with scalable resolution
US8160364B2 (en) * 2007-02-16 2012-04-17 Raytheon Company System and method for image registration based on variable region of interest
US8086073B2 (en) * 2008-02-07 2011-12-27 Seiko Epson Corporation Non-uniform image resizer
US8571280B2 (en) * 2010-02-22 2013-10-29 Canon Kabushiki Kaisha Transmission of medical image data
US20190028721A1 (en) * 2014-11-18 2019-01-24 Elwha Llc Imaging device system with edge processing
US10609270B2 (en) 2014-11-18 2020-03-31 The Invention Science Fund Ii, Llc Devices, methods and systems for visual imaging arrays
CN111028129B (en) * 2019-11-18 2023-09-15 中国航空工业集团公司西安航空计算技术研究所 TLM microstructure for GPU pixel rectangular scaling and turning algorithm
CN114331832B (en) * 2021-11-26 2024-09-06 格兰菲智能科技股份有限公司 Image scaling method and device

Citations (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4633503A (en) 1984-03-19 1986-12-30 The United States Of America As Represented By The Secretary Of The Navy Video zoom processor
US4661987A (en) 1985-06-03 1987-04-28 The United States Of America As Represented By The Secretary Of The Navy Video processor
US4809345A (en) * 1982-04-30 1989-02-28 Hitachi, Ltd. Method of and apparatus for enlarging/reducing two-dimensional images
US5097518A (en) * 1990-02-27 1992-03-17 Eastman Kodak Company Technique for performing digital image scaling by logically combining or replicating pixels in blocks of differing groupsizes
US5113455A (en) * 1990-02-27 1992-05-12 Eastman Kodak Company Digital image scaling by stepwise pixel movement
US5125043A (en) * 1989-06-23 1992-06-23 Microterm, Inc. Image processing with real time zoom logic
US5307167A (en) 1991-06-21 1994-04-26 Samsung Electronics Co., Ltd. Digital zooming system utilizing image buffers and employing an approximated bilinear interpolation method
US5384862A (en) * 1992-05-29 1995-01-24 Cimpiter Corporation Radiographic image evaluation apparatus and method
US5457772A (en) 1992-10-13 1995-10-10 Hewlett-Packard Company Method to convert bitmaps to monochrome data
EP0709825A2 (en) 1994-09-07 1996-05-01 Harris Corporation Video scaling method and device
US5544294A (en) * 1993-12-28 1996-08-06 Samsung Electronics Co., Ltd. Method for generating a subpixel mask for computer graphics system and apparatus thereof
US5548689A (en) 1992-10-13 1996-08-20 Hewlett-Packard Company Method to convert bitmaps to monochrome data
US5602870A (en) 1993-06-09 1997-02-11 Eastman Kodak Company Digital signal processing
US5655061A (en) * 1995-11-15 1997-08-05 Xerox Corporation System and method for providing a high addressable printing system
US5689425A (en) 1992-10-28 1997-11-18 Quad/Tech, Inc. Color registration system for a printing press
US5691768A (en) 1995-07-07 1997-11-25 Lucent Technologies, Inc. Multiple resolution, multi-stream video system using a single standard decoder
EP0811950A1 (en) 1996-06-05 1997-12-10 Sony Corporation Picture processing apparatus and method for enlarging or reducing a picture at any enlarging or reducing ratio
US5742708A (en) * 1995-11-15 1998-04-21 Xerox Corporation Method and system for performing perspective projection conversion
US5754710A (en) * 1993-08-06 1998-05-19 Fuji Xerox Co., Ltd. Image resolution conversion method and appratus thereof
US5774133A (en) * 1991-01-09 1998-06-30 3Dlabs Ltd. Computer system with improved pixel processing capabilities
US6011566A (en) 1994-09-01 2000-01-04 Unisys Corporation System and method to display raster images with negligible delay time and reduced memory requirements
US6047085A (en) 1994-07-21 2000-04-04 Kabushiki Kaisha Toshiba Image identifying apparatus
US6061749A (en) * 1997-04-30 2000-05-09 Canon Kabushiki Kaisha Transformation of a first dataword received from a FIFO into an input register and subsequent dataword from the FIFO into a normalized output dataword
US6091513A (en) 1997-11-27 2000-07-18 Fujitsu Limited Apparatus and method for converting image size and recording medium recording image size converting program therein and capable of being read by computer
US6101235A (en) 1998-05-27 2000-08-08 General Electric Company Methods and apparatus for altering spatial characteristics of a digital image
US6181376B1 (en) * 1997-10-14 2001-01-30 Intel Corporation Method of determining missing color values for pixels in a color filter array
US6252906B1 (en) 1998-07-31 2001-06-26 Thomson Licensing S.A. Decimation of a high definition video signal
US20010020950A1 (en) 2000-02-25 2001-09-13 International Business Machines Corporation Image conversion method, image processing apparatus, and image display apparatus
US20020033973A1 (en) 2000-09-15 2002-03-21 Dolan John E. Robust document boundary determination
US6393545B1 (en) * 1919-04-30 2002-05-21 Canon Kabushiki Kaisha Method apparatus and system for managing virtual memory with virtual-physical mapping
US20020075285A1 (en) * 1999-04-09 2002-06-20 Morrison Teresa M. Pixel zoom system and method for a computer graphics system
US6424381B1 (en) 1998-06-26 2002-07-23 Lsi Logic Corporation Filtering decimation technique in a digital video system
US20020101618A1 (en) 2000-12-25 2002-08-01 Takayuki Endo Method and system for removing isolated pixel portions in image
US6453074B1 (en) 1997-03-31 2002-09-17 Canon Kabushiki Kaisha System for image decimation including selective filtering
US20020136451A1 (en) 2001-03-22 2002-09-26 Dolan John E. Efficient document boundary determination
US20020154123A1 (en) * 2001-01-19 2002-10-24 Michal Harasimiuk Image scaling
US6498868B1 (en) * 1998-06-11 2002-12-24 Xerox Corporation Image scaling using pattern matching to select among scaling algorithms
US6546157B1 (en) * 1998-10-29 2003-04-08 Mitsubishi Denki Kabushiki Kaisha Number-of-pixels conversion apparatus and display apparatus using the same
US6650772B1 (en) 1996-05-13 2003-11-18 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and image processing system
US6681056B1 (en) * 1999-03-30 2004-01-20 International Business Machines Corporation Method and system for digital image acquisition and continuous zoom display from multiple resolutional views using a heterogeneous image pyramid representation
US20050058371A1 (en) * 2003-09-11 2005-03-17 Chin-Hui Huang Fast edge-oriented image interpolation algorithm
EP1583031A1 (en) 2004-03-30 2005-10-05 Dialog Semiconductor GmbH Zoom algorithm
EP1585310A1 (en) 2004-03-30 2005-10-12 Dialog Semiconductor GmbH Image resolution conversion
US7196821B2 (en) 2000-10-06 2007-03-27 Seiko Epson Corporation Image processing device, printing control device, image processing method, and recorded medium
US7218355B2 (en) 2002-09-04 2007-05-15 Darien K. Wallace Deinterlacer using block-based motion detection
US7365880B2 (en) * 2003-04-04 2008-04-29 Kabushiki Kaisha Toshiba Image processing apparatus and image processing method
EP4392014A1 (en) 2021-08-24 2024-07-03 DSM IP Assets B.V. Novel use of at least a human milk oligosaccharide

Patent Citations (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6393545B1 (en) * 1919-04-30 2002-05-21 Canon Kabushiki Kaisha Method apparatus and system for managing virtual memory with virtual-physical mapping
US4809345A (en) * 1982-04-30 1989-02-28 Hitachi, Ltd. Method of and apparatus for enlarging/reducing two-dimensional images
US4633503A (en) 1984-03-19 1986-12-30 The United States Of America As Represented By The Secretary Of The Navy Video zoom processor
US4661987A (en) 1985-06-03 1987-04-28 The United States Of America As Represented By The Secretary Of The Navy Video processor
US5125043A (en) * 1989-06-23 1992-06-23 Microterm, Inc. Image processing with real time zoom logic
US5097518A (en) * 1990-02-27 1992-03-17 Eastman Kodak Company Technique for performing digital image scaling by logically combining or replicating pixels in blocks of differing groupsizes
US5113455A (en) * 1990-02-27 1992-05-12 Eastman Kodak Company Digital image scaling by stepwise pixel movement
US5774133A (en) * 1991-01-09 1998-06-30 3Dlabs Ltd. Computer system with improved pixel processing capabilities
US5307167A (en) 1991-06-21 1994-04-26 Samsung Electronics Co., Ltd. Digital zooming system utilizing image buffers and employing an approximated bilinear interpolation method
US5384862A (en) * 1992-05-29 1995-01-24 Cimpiter Corporation Radiographic image evaluation apparatus and method
US5740267A (en) * 1992-05-29 1998-04-14 Echerer; Scott J. Radiographic image enhancement comparison and storage requirement reduction system
US5457772A (en) 1992-10-13 1995-10-10 Hewlett-Packard Company Method to convert bitmaps to monochrome data
US5548689A (en) 1992-10-13 1996-08-20 Hewlett-Packard Company Method to convert bitmaps to monochrome data
US5689425A (en) 1992-10-28 1997-11-18 Quad/Tech, Inc. Color registration system for a printing press
US5602870A (en) 1993-06-09 1997-02-11 Eastman Kodak Company Digital signal processing
US5754710A (en) * 1993-08-06 1998-05-19 Fuji Xerox Co., Ltd. Image resolution conversion method and appratus thereof
US5544294A (en) * 1993-12-28 1996-08-06 Samsung Electronics Co., Ltd. Method for generating a subpixel mask for computer graphics system and apparatus thereof
US6047085A (en) 1994-07-21 2000-04-04 Kabushiki Kaisha Toshiba Image identifying apparatus
US6011566A (en) 1994-09-01 2000-01-04 Unisys Corporation System and method to display raster images with negligible delay time and reduced memory requirements
EP0709825A2 (en) 1994-09-07 1996-05-01 Harris Corporation Video scaling method and device
US5691768A (en) 1995-07-07 1997-11-25 Lucent Technologies, Inc. Multiple resolution, multi-stream video system using a single standard decoder
US5742708A (en) * 1995-11-15 1998-04-21 Xerox Corporation Method and system for performing perspective projection conversion
US5655061A (en) * 1995-11-15 1997-08-05 Xerox Corporation System and method for providing a high addressable printing system
US6650772B1 (en) 1996-05-13 2003-11-18 Fuji Xerox Co., Ltd. Image processing apparatus, image processing method, and image processing system
EP0811950A1 (en) 1996-06-05 1997-12-10 Sony Corporation Picture processing apparatus and method for enlarging or reducing a picture at any enlarging or reducing ratio
US6453074B1 (en) 1997-03-31 2002-09-17 Canon Kabushiki Kaisha System for image decimation including selective filtering
US6061749A (en) * 1997-04-30 2000-05-09 Canon Kabushiki Kaisha Transformation of a first dataword received from a FIFO into an input register and subsequent dataword from the FIFO into a normalized output dataword
US6181376B1 (en) * 1997-10-14 2001-01-30 Intel Corporation Method of determining missing color values for pixels in a color filter array
US6091513A (en) 1997-11-27 2000-07-18 Fujitsu Limited Apparatus and method for converting image size and recording medium recording image size converting program therein and capable of being read by computer
US6101235A (en) 1998-05-27 2000-08-08 General Electric Company Methods and apparatus for altering spatial characteristics of a digital image
US6498868B1 (en) * 1998-06-11 2002-12-24 Xerox Corporation Image scaling using pattern matching to select among scaling algorithms
US6424381B1 (en) 1998-06-26 2002-07-23 Lsi Logic Corporation Filtering decimation technique in a digital video system
US6252906B1 (en) 1998-07-31 2001-06-26 Thomson Licensing S.A. Decimation of a high definition video signal
US6546157B1 (en) * 1998-10-29 2003-04-08 Mitsubishi Denki Kabushiki Kaisha Number-of-pixels conversion apparatus and display apparatus using the same
US6681056B1 (en) * 1999-03-30 2004-01-20 International Business Machines Corporation Method and system for digital image acquisition and continuous zoom display from multiple resolutional views using a heterogeneous image pyramid representation
US20020075285A1 (en) * 1999-04-09 2002-06-20 Morrison Teresa M. Pixel zoom system and method for a computer graphics system
US20010020950A1 (en) 2000-02-25 2001-09-13 International Business Machines Corporation Image conversion method, image processing apparatus, and image display apparatus
US20020033973A1 (en) 2000-09-15 2002-03-21 Dolan John E. Robust document boundary determination
US7196821B2 (en) 2000-10-06 2007-03-27 Seiko Epson Corporation Image processing device, printing control device, image processing method, and recorded medium
US7046399B2 (en) 2000-12-25 2006-05-16 Ricoh Company, Ltd Method and system for removing isolated pixel portions in image
US20020101618A1 (en) 2000-12-25 2002-08-01 Takayuki Endo Method and system for removing isolated pixel portions in image
US20020154123A1 (en) * 2001-01-19 2002-10-24 Michal Harasimiuk Image scaling
US6987880B2 (en) 2001-03-22 2006-01-17 Sharp Laboratories Of America, Inc. Efficient document boundary determination
US20020136451A1 (en) 2001-03-22 2002-09-26 Dolan John E. Efficient document boundary determination
US7218355B2 (en) 2002-09-04 2007-05-15 Darien K. Wallace Deinterlacer using block-based motion detection
US7365880B2 (en) * 2003-04-04 2008-04-29 Kabushiki Kaisha Toshiba Image processing apparatus and image processing method
US20050058371A1 (en) * 2003-09-11 2005-03-17 Chin-Hui Huang Fast edge-oriented image interpolation algorithm
EP1583031A1 (en) 2004-03-30 2005-10-05 Dialog Semiconductor GmbH Zoom algorithm
EP1585310A1 (en) 2004-03-30 2005-10-12 Dialog Semiconductor GmbH Image resolution conversion
US7529427B2 (en) 2004-03-30 2009-05-05 Digital Imaging Systems Gmbh Zoom algorithm
US7567732B2 (en) 2004-03-30 2009-07-28 Digital Imaging Systems Gmbh Image resolution conversion
EP4392014A1 (en) 2021-08-24 2024-07-03 DSM IP Assets B.V. Novel use of at least a human milk oligosaccharide

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Stolowitz Ford Cowger LLP; Related Case Listing; Aug. 24, 2011; 1 Page.
U.S. Patent Application, filed Apr. 22, 2004, U.S. Appl. No. 10/830,329, assigned to the same assignee, "Image Resolution Conversion".

Also Published As

Publication number Publication date
US20050226539A1 (en) 2005-10-13
US7529427B2 (en) 2009-05-05
EP1583031A1 (en) 2005-10-05

Similar Documents

Publication Publication Date Title
USRE44983E1 (en) Zoom algorithm
US6756985B1 (en) Image processor and image display
JP2011504682A (en) Resize image sequence
JP2919428B2 (en) Image transformation device
EP1977372B1 (en) Method and apparatus for scaling down a bayer domain image
KR20040070565A (en) Image warping method and apparatus
JP2000244814A (en) Image compositing device and recording medium where image compositing method is recorded
JP3746311B2 (en) Input video image data filtering method
JP2000184185A (en) Device and method for converting resolution and computer-readable storing device
JP2008067230A (en) Image processing apparatus, image processing method, and program
JPH03160575A (en) Picture display device
KR100809199B1 (en) Method and device for converting a color image
JP2005045513A (en) Image processor and distortion correction method
JP2009100407A (en) Image processing apparatus and method thereof
JP2005012561A (en) Image processing apparatus, image processing method, and image projector
JP5042251B2 (en) Image processing apparatus and image processing method
JP5676233B2 (en) Image processing apparatus, image processing method, and imaging apparatus
US8194150B2 (en) Moving image processing apparatus and video camera apparatus using the same
US7567732B2 (en) Image resolution conversion
JP6524644B2 (en) Image processing apparatus and electronic device
Lee et al. Performance comparison of various interpolation methods for color filter arrays
JP4689243B2 (en) Image processing apparatus, image processing method, and digital camera
JP3526936B2 (en) Image magnifier
JP4567279B2 (en) Digital camera
KR20040065806A (en) Cubic convolution interpolation apparatus and method

Legal Events

Date Code Title Description
AS Assignment

Owner name: YOULIZA, GEHTS B.V. LIMITED LIABILITY COMPANY, DEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIGITAL IMAGING SYSTEMS GMBH;REEL/FRAME:032236/0057

Effective date: 20110328

AS Assignment

Owner name: GULA CONSULTING LIMITED LIABILITY COMPANY, DELAWAR

Free format text: MERGER;ASSIGNOR:YOULIZA, GEHTS B.V. LIMITED LIABILITY COMPANY;REEL/FRAME:037028/0896

Effective date: 20150828

FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12

AS Assignment

Owner name: INTELLECTUAL VENTURES ASSETS 192 LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GULA CONSULTING LIMITED LIABILITY COMPANY;REEL/FRAME:066791/0498

Effective date: 20240315

AS Assignment

Owner name: TP-LINK USA CORPORATION, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 192 LLC;REEL/FRAME:067142/0902

Effective date: 20240326