JP3512612B2 - Image transmission / reception system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image transmitting / receiving system including an image transmitting device for transmitting image data and an image receiving / displaying device for receiving and displaying the transmitted image data, and particularly, an image transmitting / receiving system for capturing images at different resolutions. The present invention relates to an image transmission / reception system including an image transmission device that transmits a plurality of still image data and an image reception display device that displays a high-definition image by interpolating the received image data and the image data that has already been received.

[0002]

2. Description of the Related Art Conventionally, various image transmission methods have been developed. However, in practical situations where high quality and high definition images are required such as when transmitting medical samples to a remote place, still image A non-compressed transmission method is suitable. In this method, the transmitting side transmits the sampled still image on a pixel-by-pixel basis for each screen, and the receiving side receives the sampled still image.
Display in pixel units.

For example, the transmitting side picks up a still image in black and white,
512 × 512 pixels of 512 in the vertical direction and 512 in the horizontal direction are taken in as one frame, and the luminance is set to 0 to 255 and quantized into 8 bits, so that 512 × 512 image data of 8 bits are transmitted as one frame and received. Side is this one
Upon receiving the image data of the frame, 512 × 512 pixels are displayed with 256 levels of brightness.

With respect to the still image non-compression transmission system, development of a transmission / reception device for compressing and transmitting an image at high speed has become popular due to higher performance of hardware and the like. 261,
Although image compression methods based on standardization such as JPEG and MPEG have been widely used in recent years, they are not suitable for transmission of high-quality and high-definition images due to blocking noise and mosquito noise.

[0005]

However, in the above-described conventional non-compression transmission system, even if an attempt is made to enlarge the display on the receiving side, it is not possible to obtain a resolution higher than the sampling interval when a still image is picked up on the transmitting side. . Therefore, for example, in telemedicine applications, the receiving side needs to be able to arbitrarily magnify and reduce the image of the medical sample, and the image of the sample needs to be a high-quality / high-definition image. However, in the conventional uncompressed transmission system, even if the image is enlarged on the receiving side, it is not possible to observe the image of the sample at a resolution equal to or higher than the sampling interval at the time of image capturing on the transmitting side.

That is, in the prior art, even if the transmitting side picks up an image of a medical sample at various magnifications and samples and transmits a plurality of image data, a part of the image of the sample is received at the receiving side. In order to magnify and observe,
Only the still image can be displayed based on the transmitted image data that includes the relevant portion and has the highest resolution, and it is not possible to obtain a resolution higher than that obtained from the highest resolution image data. There was a problem.

Therefore, the present invention has been made in view of the above problems.
Provided is an image transmission / reception system capable of displaying an image at a resolution equal to or higher than the resolution of each received image data when the transmission side transmits two image data including the same target. The purpose is to do.

[0008]

In order to solve the above-mentioned problems, an image transmitting / receiving system according to the present invention transmits two image data obtained by photographing and digitizing at different angles of view so as to include the same object. , Receiving both image data
An image transmitting / receiving system for displaying one image, a photographing means, an image storing means for taking in both image data from the photographing means, a transmitting means for transmitting both image data stored in the image storing means, both image data A receiving means for receiving the received image data, a received image storage means for storing the received both image data, an overlapping range information acquiring means for acquiring overlapping range information regarding an overlapping range of a photographing object appearing in the both image data, and both image data Matching information acquisition means for acquiring data matching information, which is information relating to either or both of the enlargement ratio and the position, and both image data in the overlapping range indicated by the overlapping range information with reference to the data matching information. Information for adjusting the positional deviations of both images so that the degree of matching of the images becomes equal to or greater than a predetermined degree, and the adjustment information for calculating the matching of both image data is calculated. Output means, both image data stored in the received image storage means, and image combination display means for displaying one image based on the overlapping range information and the adjustment information, the image combination display means, An approximation function calculation unit that calculates an approximation function for creating image data for display based on the data values of both image data in the overlap range indicated by the overlap range information and the adjustment information, and based on the approximation function. And an image display unit for displaying one image as an image, the approximation function is a function indicating a correlation between pixel coordinates and luminance, and the overlap of both image data adjusted based on the adjustment information. The combination of the coordinates of all pixels and the luminance in the range is characterized by satisfying the approximate function.

As a result, the present image transmitting / receiving system can synthesize one image data by utilizing the two image data that have been photographed, so that it is used as compared with the case where an image is displayed based on only one image data. It is possible to display a precise image because of the large amount of data.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. <Structure> FIG. 1 is a block diagram of an image transmitting / receiving system according to an embodiment of the present invention. Image transmission / reception system 100
0 is composed of an image transmitting apparatus 100 for transmitting an image and an image receiving / displaying apparatus 200 for receiving and displaying the transmitted image.

The image transmitting apparatus 100 comprises a camera 101, which is a 1/2 inch CCD camera with a zoom lens, and
A first image memory 102 having 12 × 512 pixels and capable of storing 8-bit luminance data per pixel; a second image memory 103 having the same capacity as the first image memory 102;
An additional information creation unit 104 which receives the control information from the first image memory 102, compares the contents of the first image memory 102 and the second image memory 103, and performs other processing to create additional information to be added to the image data and transmitted. , A transmission unit 1 for transmitting the image data and the additional information which are the contents of the first image memory
05 and. The contents of the additional information will be described later.

The transmitting unit 105 transmits the image data, which is the contents of the first image memory, line by line in order from the pixel data with the smallest Y coordinate. The image receiving / displaying device 200 also includes a receiving / combining unit 201 that receives the transmitted image data, a received image memory 202 that stores the received image, and an operation receiving unit that receives a display enlargement / display reduction instruction from the user. 204 and the reception combining unit 201
And an image display unit 203 for displaying the image on the display screen by obtaining the spline approximation formula for displaying the image.

Here, the receiving / synthesizing unit 201 receives the image data and the additional information from the transmitting apparatus, adds a time-series number to these one image information set, and stores them in the received image memory 202. A spline approximation formula for calculating an image to be displayed is derived from the image information set already stored in the received image memory 202 and the newly received image information set, and is passed to the image display unit 203.

The image display unit 203 has a display screen, displays an image based on the spline approximation formula for display, and when the operation receiving unit 204 receives an instruction to enlarge or reduce the display from the user, The display of the image is enlarged or reduced accordingly. <Operation of Image Transmission Device> The operation of the image transmission device in the image transmission / reception system having the above-described configuration will be described below with reference to the drawings.

FIG. 2 is a flowchart showing the operation of the image transmitting apparatus according to the embodiment of the present invention. The data of the previous captured image is stored in the second image memory 103, and the data is all 0 at the initial stage. The image transmitting apparatus 100 displays the monochrome image from the camera 101 in 512
One frame of × 512 pixels is fetched, the luminance is quantized by 8 bits, and then stored in the first image memory 102 (step S301).

After capturing the image from the camera 101, the additional information creating unit 104 receives the rotation control information and the zoom control information from the camera 101 (step S302), and when the enlarged image is captured from the previous time, that is, the zoom control information is If it is larger than the previous zoom magnification (step S3
03), if the fields of view of the cameras overlap (step S
304), and the coordinates of the overlapping portion are calculated (step S30).
5). On the other hand, if the zoom control information is smaller than the previous zoom magnification or the field of view of the camera does not overlap, the process proceeds to the data transmission process described later (steps S303, S304, S3).
08).

Here, the zoom control information refers to a zoom magnification, and the rotation control information refers to a set of a horizontal direction H degree and a vertical direction V degree, which are camera directions. Hereinafter, the determination as to whether the fields of view of the cameras overlap will be described. Since the camera has a 1/2 inch optical system, the focal length f1 of the lens
The horizontal viewing angle is ± arctan (3.2 /
f1), and the vertical viewing angle is ± arctan
Since it is (2.4 / f1), the visual field in the horizontal direction is H-
arctan (3.2 / f1) to H + arctan
(3.2 / f1), and the visual field in the vertical direction is V-ar
ctan (2.4 / f1) to V + arctan (2.4
/ F1). Here, arctan is arctangent, the horizontal plus direction is clockwise, and the vertical plus direction is downward from the sky.

On the other hand, the field of view can be similarly obtained at the time of the previous data acquisition, and the value is held in the work area in the additional information creating unit 104 and compared with the field of view of the data acquired this time. By doing so, duplication of data will be detected. Since the previous data cannot be taken in at the initial stage, it is assumed that there is no data duplication.

The viewing angles at the time of the previous data acquisition are the horizontal direction Hs_pre to He_pre and the vertical direction Vs_pr.
e to Ve_pre, the viewing angle at the time of current data acquisition, the horizontal direction Hs_now to He_now, and the vertical direction V
If s_now to Ve_now, Hc_pre = (Hs_pre + He_pre) / 2, Vc_pre = (Vs_pre + Ve_pre) / 2, Hd_pre = | Hs_pre-He_now_pre / | Hs_pre / | Hs_pre / | Hs_pre / | Vc_now = (Vs_now + Ve_now) / 2, Hd_now = | Hs_now-He_now | / 2, Vd_now = | Vs_now-Ve_now | / 2, and two expressions using these expressions, | Hc_pre-Hc_now | <(Hd_re |
d_now), | Vc_pre-Vc_now | <(Vd_pre + V
If both d_now) are satisfied, it means that the image data stored in the first image memory 102 and the image data stored in the second image memory 103 have an overlapping portion in the viewing angle of image capturing.

The calculation process of the coordinates of the overlapping portion of the data (step S305) is performed by the additional information creating unit 104, and the start coordinates of the overlapping portion of the data are based on the coordinates of the image of one frame in the second image memory 103. (Xstt_adrs, Ystt_adrs) and end coordinates (Xend_adrs, Yend_adrs) are calculated, and are calculated as follows.

Xstt_adrs = int (511
(Hs_now-Hs_pre) / (He_pre-H
s_pre)), Ystt_adrs = int (511 · (Vs_now)
-Vs_pre) / (Ve_pre-Vs_pr
e)), Xend_adrs = int (511 · (He_now
-Hs_pre) / (He_pre-Hs_pr
e)), Yend_adrs = int (511 · (Ve_now
-Vs_pre) / (Ve_pre-Vs_pre)) where int is an integer process, and Xstt_adr
s, Ystt_adrs, Xend_adrs, Yen
Each of d_adrs is an integer of 0 or more and 511 or less.

After calculating the coordinates of the overlapping portion of the data, the additional information creating unit 104 determines the overlapping portion of the data of the first image memory 102 and the data of the second image memory 103 from the content of the image data of the second image memory 103. An image that approximates the data of the first image memory 102 is synthesized using a spline function (step S306). Hereinafter, this procedure will be described.

First, the following formula for a cubic spline approximation curve is created for the horizontal direction of the image. u1 (x) = au1x ² + bu1x + cu1 + cx11
(X-a11) ³ ₊ + cx12 (x-a12) ³ ₊ ... +
cx1n (x−a1n) ³ ₊ where a11, a12, ..., A1n are Ystt_
Xstt_adrs to Xend_ad in adrs
It is the coordinate value of rs. The coordinate values are integers. Also,
au1, bu1, cu1, cx11 to cx1n are constants that are determined by designating the smoothness of the spline curve and the degree of data agreement, and the equation of the spline approximation curve should match the luminance value of each pixel of the second image memory 103 as much as possible. To decide.

The expression of such a spline approximation curve is calculated up to Yend_adrs by changing the Y coordinate. u2 (x) = au2x ² + bu2x + cu2 + cx21
(X-a21) ³ ₊ + cx22 (x-a22) ³ ₊ ... +
_{^{cx2n (x-a2n) 3 +}} · · · · um (x) = aumx 2 + bumx + cum + cxm1
(X-am1) ³ ₊ + cxm2 (x-am2) ³ ₊ ... +
cxmn (x-amn) ³ ₊ where a11 to amn are Xstt_adrs to Xe.
nd_adrs, Ystt_adrs to Yend_ad
It is the coordinate value of all pixels of rs.

Next, in the vertical direction of the image as well as in the horizontal direction, the following cubic spline approximation curve formula is prepared. v1 (y) = av1y ² + bv1y + cv1 + cy11
(Y-a11) ³ ₊ + cy21 (y-a21) ³ ₊ ... +
_{^{cym1 (y-am1) 3 +}} · · · · vn (y) = avny 2 + bvny + cvn + cy1n
(Y-a1n) ³ ₊ + cy2n (y-a2n) ³ ₊ ... +
cymn (y-amn) ³ _{+ In} these formulas, av1 to avn and bv1 to b are the same as above.
vn, cv1 to cvn, and cy11 to cymn are constants determined by designating the smoothness of the spline curve and the data matching degree.

These expressions have meaning as expressions for approximating the brightness of the portion whose coordinates do not coincide with the pixels forming the image data of the second image memory based on the data of the second image memory. Therefore, by using these equations, the data of the first image memory in the overlapping portion of the data of the first image memory and the data of the second image memory can be approximately calculated.

Therefore, using these equations, x = Xstt_adr for the data of the first image memory in the overlapping portion.
The brightness is approximately calculated by s + k · px and y = Ystt_adrs + k · py. Where k is the zoom magnification and p
x = 0 to 1x, 1x is the number of pixels in the horizontal direction of the data of the first image memory in the portion where the image data overlaps, and p
y = 0 to ly, ly is the number of pixels in the vertical direction of the data of the first image memory in the portion where the image data overlap.

As a result, (ly + 1) × (lx + 1) approximate data corresponding to the data of the overlapping portion of the first image memory is obtained. The purpose of this approximation is to compare the data in the first image memory with the data in the second image memory for a match / mismatch. That is, the data in the first image memory and the data in the second image memory are images obtained by capturing images with different zoom magnifications. Since the sampling intervals are different, one data is approximated to the other data And the actual data of the other.

After calculating the approximate data, the additional information creating unit 104 performs data matching between the approximate data and the actual data of the overlapping portion of the first image memory (step S307). The data matching will be described below. Let w (py, px) be the approximate data of the data of the first image memory in the already calculated overlapping portion, and z (pj, p) be the actual data of the first image memory in the overlapping portion.
In the case of i), data matching is performed by the following formula.

Η <(z · w) / (| z | · | w |) Here, w is a Δy and a Δ as w (py + Δy, px + Δx) considering the phase shift when matching both data.
Data matching is performed by changing x. Also, z ・ w
Is an inner product of z (pj, pi) and w (py + Δy, px + Δx) as a multidimensional vector, and is | z | and | w.
| Is the calculated size.

If the critical value η for matching in the above inequality is exceeded, the data are considered to match, and in the present embodiment, η = 0.9. The coincidence of data means that the image captured from the camera 101 in the second image memory 103 and the image captured from the camera 101 in the first image memory 102 are the same, and the zoom magnifications are the same. It doesn't matter whether or not.

It is assumed that Δy and Δx are changed and determined so that η becomes the highest. Therefore, as a result of the data matching, whether the contents of the first image memory and the contents of the second image memory match or do not match and the phases Δy and Δx are obtained. After data matching, data transmission processing is performed. That is, the transmitting unit 105 collectively transmits the data, which is the content of the first image memory, and the following additional information (step S308).

Here, the contents of the additional information are as follows. (1) Matching result of the contents of the first image memory and the contents of the second image memory: 1 (match), 0 (mismatch) (2) The contents of the first image memory and the contents of the second image memory match The address (X coordinate, Y coordinate) in the second image memory for the portion, and the address (Xstt_adr) of the data of the pixel having the smallest X coordinate and Y coordinate.
s, Ystt_adrs) (3) Phase shift value (Δx, Δy) of the data of the first image memory with respect to the sampling interval of the data of the second image memory content at the X and Y coordinates (4) The second of the second image memory content Enlargement ratio of one image memory content (zoom magnification k) (5) Field-of-view range (Hs) of the image which is the first image memory content
_Now, He_now, Vs_now, Ve_no
w) After transmitting the data by the transmitting unit 105, the image transmitting apparatus moves the contents of the first image memory to the second image memory (step S309).

By the processing up to this point, the process from image capture of one frame to transmission is completed, and the image transmission device 100
Returns to the process of step S301 to capture the next image. <Operation of Image Receiving / Displaying Device> The operation of the image receiving / displaying device of the image transmitting / receiving system according to the embodiment will be described below with reference to the drawings.

FIG. 3 is a flow chart showing the operation of the image receiving and displaying apparatus according to the embodiment of the present invention. The receiving / combining unit 201 receives the data transmitted from the image transmitting apparatus 100 (step S401), and refers to the additional information to obtain information as to whether or not the currently received data matches the immediately received data. If they do not match (step S402), the received data is displayed on the display screen (step S404).

Here, the data is displayed on the display screen by creating a spline approximation formula from the data received by the receiving / synthesizing unit 201 and passing it to the image display unit 203 so that the image display unit 203 displays the pixels on the display screen. This is performed by calculating the brightness of each pixel based on the spline approximation formula according to the number and display magnification and displaying the image. The display magnification is determined according to the user's operation of enlarging or reducing the display accepted by the operation accepting unit 204. Also, the display screen is 1024 ×
It is 1024.

On the other hand, if they match (step S4)
02), since the previously received data has already been stored in the received image memory, the data obtained by combining the previously received data and the currently received data is displayed on the display screen (step S403). Here, the display of the synthesized data is
By creating a spline approximation formula using both the data received by the reception synthesis unit 201 and the data received last time, and passing the spline approximation formula to the image display unit 203, the image display unit 203 determines the number of pixels of the display screen and the display magnification. This is performed by calculating the brightness of each pixel based on the spline approximation formula and displaying the image.

In this case, since a large amount of interpolation data generated by the influence of the difference in sampling interval between the two image data and the phase shift of the image data can be used, it is possible to display an image with high resolution. This means that, for example, a data group obtained by sampling the horizontal visual field range Hst to Hend in three divisions and Hst to Hend.
From the data group obtained by sampling the space in 4 divisions,
It is based on the same principle that a finer spline approximation formula between Hstt and Hend can be derived by using both of them than deriving the spline approximation formula by using either one alone. Hereinafter, this principle will be described.

FIG. 4 is a schematic diagram of the principle for deriving a finely detailed spline approximation formula by combining two image data. In order to explain this principle, the images 501 and 502 are images to be captured as 4 pixels in the horizontal direction. Images 501 and 502 show images obtained by photographing the vicinity of the human heart. Since the horizontal direction is set to 4 pixels for the sake of description, the heart mark near the human heart in the figure only shows the image of the photographed portion, and is different from the accurate image data itself. An image 502 is an image obtained by enlarging and capturing a lower left part 3/4 of the image 501, and an example data position 503 indicates a data position when the horizontal visual field range Hstt to Hend corresponds to three pixels. Is shown in
Similarly, in the data position example 504, data positions when Hstt to Hend correspond to four pixels are indicated by black circles, and correspond to the image 501 and the image 502, respectively. Note that α in the figure indicates the width of the pixel. Further, the vertical position is the position of Hstt and the data position example 503-
The positions 505 are all the same, and only the position in the vertical direction is focused and described here.

This data position example 503 and data position example 5
The data position example 505, which is a combination of 04 and the data position example 504, naturally has more data positions than the data position example 503. This data position is a position where the image data has a brightness value at this position. Therefore, the larger the number of data positions, the finer the approximation between Hstt and Hend. Note that this data position example 5
03 is the pixel coordinate 4 with reference to the data position example 504.
It is multiplied by / 3 to match the sampling intervals of both data. Further, in this description, there is no phase difference between both data positions.

FIG. 5 is a diagram showing the correlation between the data position and the brightness corresponding to the example of the data position shown in FIG. Data example 603 is for data location example 503, data example 604 is for data location example 504, data example 605 is for data location example 5
Data example 606 corresponds to each of
The spline curve which interpolated 5 is shown. Data example 6
Reference numeral 07 shows the luminance of each pixel when it is displayed on the display screen in which the horizontal density of pixels is twice that of the data position example 504 based on the curve shown in the data example 606. The data example 607 obtained in this way has high accuracy that cannot be obtained from only the data example 603 or the data example 604.

Therefore, based on the principle described above, the image receiving / displaying device can display a high quality / high resolution image. Actually, the two image data are matched with each other based on the received two image data, the phase shift value and the enlargement ratio in the additional information, and the pixel position and the luminance of the pixel are calculated based on the luminance value at each coordinate in both image data. A spline approximation formula, which is a relational formula, is calculated, and an image is displayed based on this approximation formula.

After displaying the image, the image receiving and displaying device 20
0 adds a time-series number to the received data and stores it in the received image memory (step S405). In addition,
Although the operation of enlarging or reducing the display by the user is not shown in the flowchart, it can be performed at any time. In this way, the image receiving / displaying apparatus 200 according to the present embodiment uses not only the single image data transmitted, but also other image data already received before the data is received. Since a spline approximation formula for display is derived, it is possible to display an image with high resolution.

Although the image transmission / reception system according to the present invention has been described above based on the embodiments, it goes without saying that the present invention is not limited to these embodiments. That is, (1) In the embodiment, the camera is a 1/2 inch optical system, and the capacities of the first image memory and the second image memory are 512 ×
512, the image captured from the camera 101 is quantized into 8 bits, and a monochrome image is handled, and the display screen is 1024 × 1024. However, the display screen is not limited to this, and each other It may be. (2) In the embodiment, the approximation by the spline function is used for matching the contents of the first image memory and the contents of the second image memory, but the present invention is not limited to this, and the matching may be performed by another method. Also, the critical value of data matching may be another value instead of 0.9. (3) In the embodiment, the target to be combined with the data received by the image receiving / displaying device is the previously received data.
It may be combined with any data already received, or may be combined with a plurality of data. In addition,
In order to search the already received data to be combined, it may be performed by comparing the visual field ranges in the additional information and determining the presence or absence of the overlapping portion of the visual fields. (4) In the embodiment, the image transmitting device transmits the additional information including various data in addition to the image data, but the present invention is not limited to this, and only the visual field range of the image transmitted as the image data is transmitted as the additional information. In this case, the second image memory can be omitted in the image transmitting device, and the data matching process (steps S303 to S307) and the data transfer process to the second image memory (step S309) can be performed. It can be omitted. In this case, on the side of the image receiving / displaying device that has received the data to be transmitted, the image data having the same field of view as the image data currently received is searched from among the data already stored in the received image memory, and the image data currently received is received. It will be combined with the image data and displayed. Therefore, the zoom magnification is calculated from the visual field range, the same data matching processing as in steps S305 to S307 is performed for the overlapping portion of the visual field ranges using this, the phase difference between the image data is calculated, and the spline approximation is performed based on these. The formula will be derived.

That is, in a series of image transmitting / receiving systems for transmitting a plurality of image data captured from a camera with various zoom magnifications for the same object, displaying them by combining them, the plurality of image data is transmitted. Data matching processing of data, phase difference calculation processing between image data, calculation processing of spline approximation formula for image display may be provided. (5) In the embodiment, the image receiving / displaying device is provided with the operation receiving unit 204, but the operation receiving unit 204 may be omitted, and for example, the image data received by the number of pixels of the display screen of the image receiving / displaying device may be received. When the image display unit 203 displays image data at a predetermined magnification, the effect of the present invention of displaying a high quality / high resolution image is exerted. (6) The processing procedure of the image transmitting apparatus 100 (the procedure of the flowchart of FIG. 2) and the processing procedure of the image receiving / displaying apparatus 200 (the procedure of the flowchart of FIG. 3) in the embodiment are realized by a machine language program and recorded. It may be recorded on a medium and used as a target for distribution / sales. Such recording media include IC cards, optical disks, floppy disks,
Although there is a ROM or the like, the machine language program recorded in these is used by being installed in general-purpose hardware. The general-purpose hardware referred to here is a general personal computer or the like, and sequentially executes the installed machine language program to realize any of the functions of the image transmission device and the image reception display device described in the embodiments. .

[0046]

As is apparent from the above description, the image transmitting / receiving system according to the present invention transmits two image data obtained by photographing and digitizing at different angles of view so as to include the same object. An image transmission / reception system for receiving both image data and displaying one image, comprising: a photographing means;
An image storage means for capturing both image data from the photographing means,
A transmitting means for transmitting both image data stored in the image storing means, a receiving means for receiving both image data, a received image storing means for storing both received image data, and a photographing appearing in both image data An overlapping range information acquiring unit that acquires overlapping range information regarding a target overlapping range, and a matching information acquiring unit that acquires data matching information that is information regarding one or both of the enlargement ratio and the position of both image data, For aligning both image data by adjusting the positional deviation of both images so that the degree of alignment of both image data in the overlapping range indicated by the overlapping range information becomes a predetermined degree or more by referring to the data matching information. One image based on the adjustment information calculation means for calculating the adjustment information, both image data stored in the received image storage means, the overlapping range information and the adjustment information. Image combining display means for displaying, and the image combining display means for display based on the data value of both image data in the overlap range indicated by the overlap range information and the adjustment information. It has an approximate function calculation unit that calculates an approximate function for creating image data, and an image display unit that displays one image based on the approximate function, and the approximate function includes the coordinates of pixels and the brightness. It is a function indicating a correlation, and a set of coordinates and brightness of all pixels in the overlapping range of both image data adjusted based on the adjustment information satisfies the approximation function.

As a result, the present image transmitting / receiving system can synthesize one image data by utilizing the two image data taken, so that it is used as compared with the case of displaying an image based on only one image data. It is possible to display a precise image because of the large amount of data. Here, the overlapping range information acquiring unit obtains information about the visual field range from the photographing unit to calculate overlapping range information, and the data matching information and the adjustment information are acquired by the matching information acquiring unit. It may be characterized in that it includes magnification information acquired from the means.

As a result, the present image transmitting / receiving system uses the information about these operations even if the camera or the like, which is a means for photographing an image, freely rotates, zooms, etc.
It is possible to synthesize and display one high-resolution image from one image. An image transmission / reception system according to the present invention is an image transmission / reception system including an image transmission device that sequentially transmits captured image data and an image reception display device that receives the image data and displays it on a display screen.
The image transmitting apparatus obtains photographing information regarding a visual field range and zoom magnification from the photographing means, a second image storage means, a first image storage means for fetching image data from the photographing means, and the photographing means. An image including image information stored in the first image storage means and image data stored in the second image storage means based on the information, and including the information indicating the comparison result and the shooting information. Image attachment information creating means for creating attachment information, image data stored in the first image storage means, and the image attachment information, and the image data is stored in the second image storage means. Means for receiving the received image storage means, the image data and the image additional information, and the information indicating the comparison result in the image additional information indicates that the image data is duplicated. In this case, image combining display means for combining images using the image data, the image attachment information, and the previously received image data and image attachment information stored in the received image storage means and displaying the images on the display screen. And a received image storage means for storing the received image data and image attached information in the received image storage means.

As a result, the image transmitting / receiving system of the present invention creates, on the transmitting side, information such as whether or not the image indicated by the image data to be transmitted has an overlapping range with the image indicated by the image data transmitted last time and adds it to the image data. Therefore, the receiving side can quickly determine whether or not it is possible to combine two image data and display one image only when there is an overlapping range.

Further, the image composition display device according to the present invention is
What is claimed is: 1. An image composition display device for displaying one image based on two image data obtained by photographing and digitizing at different angles of view so as to include the same object, and storage means for storing both image data, Overlapping range information acquisition means for acquiring overlapping range information regarding the overlapping range of the imaging target appearing in the image data, and data matching information that is information regarding one or both of the enlargement ratio and position of both image data. With reference to the matching information acquisition means and the data matching information, the positional deviation of both images is adjusted so that the matching degree of both image data in the overlapping range indicated by the overlapping range information becomes a predetermined degree or more. Adjustment information calculation means for calculating adjustment information for matching image data, and one image based on both image data, the overlapping range information, and the adjustment information. Characterized in that it comprises a Shimesuru image synthesizing display unit.

Here, the image composition display means generates an approximate function for creating image data for display based on the data value of both image data in the overlap range indicated by the overlap range information and the adjustment information. An approximation function calculation unit for calculating and an image display unit for displaying one image based on the approximation function, wherein the approximation function is a function indicating a correlation between pixel coordinates and luminance, The set of the coordinates and brightness of all pixels in the overlapping range of both image data adjusted based on the adjustment information may satisfy the approximate function.

As a result, the present image compositing display device can compose one image data by utilizing the two image data, so that the data used in comparison with the case where the image is displayed based on only one image data is used. It is possible to display a precise image as much as the number of. As described above, the present invention is a technique for synthesizing one image data with high resolution by complementing two image data with each other, which can be used in any image display system and has a high practical value, especially for remote medical treatment. It is very useful in applications where it is necessary to sequentially send and receive images and which requires high resolution images.

[Brief description of drawings]

FIG. 1 is a configuration diagram of an image transmission / reception system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing an operation of the image transmitting apparatus according to the embodiment of the present invention.

FIG. 3 is a flowchart showing an operation of the image receiving / displaying device according to the embodiment of the present invention.

FIG. 4 is a schematic diagram of a principle for deriving a fine fine spline approximation formula by combining two image data.

5 is a diagram showing a correlation between data position and luminance corresponding to the data position example shown in FIG.

[Explanation of symbols]

100 image transmitter 101 camera 102 first image memory 103 Second image memory 104 Additional information creation unit 105 transmitter 200 Image receiving and displaying device 201 Reception synthesis unit 202 Received image memory 203 image display section 204 Operation reception section 1000 image transmission / reception system

Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) H04N 1/38-1/393

Claims (6)

(57) [Claims] 1. Transmitting two image data obtained by photographing and digitizing at different angles of view so as to include the same object,
An image transmission / reception system for receiving both image data and displaying one image, comprising: a photographing means; an image storage means for fetching both image data from the photographing means; and both image data stored in the image storage means. A transmitting means for transmitting, a receiving means for receiving both image data, a received image storing means for storing both received image data, and an overlap for acquiring overlapping range information regarding an overlapping range of a photographing object appearing in both image data. Range information acquisition means, matching information acquisition means for acquiring data matching information, which is information relating to one or both of the magnification and position of both image data, and the overlapping range with reference to the data matching information The positional deviation of both images was adjusted so that the degree of matching of both image data in the overlapping range indicated by the information was equal to or higher than a predetermined degree, and both image data were matched. Adjustment information calculating means for calculating the adjustment information, and both image data stored in the received image storage means, and an image composition display means for displaying one image based on the overlapping range information and the adjustment information. wherein the image synthesizing display unit, both the image data in the overlap range in which the overlapping range information indicates
Image for display based on the data value of and the adjustment information
Approximation function calculation to calculate the approximation function to create the data
Image display for displaying one image based on the output part and the approximation function
And the approximation function calculation unit is configured to detect both images based on the adjustment information.
After adjusting the data position deviation, adjust both image data
Coordinates and brightness of all pixels in one of the
Using the pair with degrees as the basis for the calculation of the approximation function
The overlapping range of the other of the adjusted image data
The set of coordinates and brightness of all pixels in
It is used as a basis for calculation, and the correlation between pixel coordinates and brightness is used.
An image transmitting / receiving system, characterized in that the approximate function is calculated so as to indicate the relationship. Wherein said approximation function calculating unit, as a set of coordinates and luminance of all the pixels in the overlapping range of the two image data adjusted based on the adjustment information meets the approximate function
The image transmission / reception system according to claim 1 , wherein the approximate function is calculated . 3. The overlap range information acquisition unit obtains information about a field of view range from the photographing unit to calculate overlap range information, and the data matching information and the adjustment information are stored in the matching information acquiring unit. The image transmitting / receiving system according to claim 2, wherein the image transmitting / receiving system includes magnification information acquired from the photographing means. 4. An image composition display device for displaying one image based on two image data obtained by photographing and digitizing at different angles of view so as to include the same object, and storing both image data. A storage unit, an overlapping range information acquiring unit that acquires overlapping range information regarding an overlapping range of an imaging target that appears in both image data, and data matching that is information regarding one or both of an enlargement ratio and a position of both image data. Information acquisition means for acquiring the information for use, and the position shift of both images so that the degree of matching of both image data in the overlapping range indicated by the overlapping range information with reference to the data matching information becomes a predetermined degree or more. Based on the both image data, the overlapping range information, and the adjustment information, and the adjustment information calculation means for calculating the adjustment information for adjusting the two image data. And an image synthesizing display unit for displaying one image Te, the image synthesizing display unit, both the image data in the overlap range in which the overlapping range information indicates
Image for display based on the data value of and the adjustment information
Approximation function calculation to calculate the approximation function to create the data
Image display for displaying one image based on the output part and the approximation function
And the approximation function calculation unit is configured to detect both images based on the adjustment information.
After adjusting the data position deviation, adjust both image data
Coordinates and brightness of all pixels in one of the
Using the pair with degrees as the basis for the calculation of the approximation function
The overlapping range of the other of the adjusted image data
The set of coordinates and brightness of all pixels in
It is used as a basis for calculation, and the correlation between pixel coordinates and brightness is used.
An image compositing display device, characterized in that the approximate function is calculated so as to indicate the relationship. Wherein said approximation function calculating unit, as a set of coordinates and luminance of all the pixels in the overlapping range of the two image data adjusted based on the adjustment information meets the approximate function
The image compositing display device according to claim 4 , wherein the approximate function is calculated . 6. An image combination display processing program for realizing an image combination display processing for displaying one image based on two image data obtained by photographing and digitizing different fields of view so as to include the same object. A recording medium having recorded therein, wherein the image composition display processing program includes an overlap range information acquisition step of acquiring overlap range information regarding an overlap range of an imaging target appearing in both image data, an enlargement ratio of both image data, and A matching information acquisition step of acquiring data matching information, which is information relating to one or both of the positions, and the matching degree of both image data in the overlapping range indicated by the overlapping range information with reference to the data matching information. The adjustment information that adjusts the positional deviation of both images so as to be a predetermined degree or more and calculates adjustment information for aligning both image data. Calculation steps and, viewed including an image synthesizing display step of displaying one image on the basis of the overlapping range information and two image data and the adjustment information, the image synthesizing display step, duplicate the overlapping range information indicates Both image data in the range
Image for display based on the data value of and the adjustment information
Approximation function calculation to calculate the approximation function to create the data
Output sub-step and the near-field calculated by the approximate function calculation sub-step.
Image display subsystem that displays one image based on similarity function
And the step of calculating the approximation function based on the adjustment information.
After adjusting the position shift of both image data,
All pixels in one of the overlapping areas of both image data
As a basis for the calculation of the approximate function, the set of coordinates and luminance of
Before using the other of the adjusted image data
The set of coordinates and brightness of all pixels in the overlapping range is also described above.
Pixel coordinates and brightness used as the basis for calculating the approximation function
A recording medium , wherein the approximate function is calculated so as to show a correlation with .