JP4053117B2 - Image processing device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention is provided in an image diagnostic system or the like that displays a lumen of a luminal organ or the like based on three-dimensional volume data obtained from an imaging apparatus such as an X-ray CT apparatus or a nuclear magnetic resonance apparatus (MRI apparatus). In particular, the present invention relates to a suitable image processing apparatus, and is an image that improves the operability of an image diagnostic system by searching for and displaying the shortest path from a desired start point of a complicatedly intertwined luminal organ to a target organ. The present invention relates to a processing apparatus.
[0002]
[Prior art]
Conventionally, based on tomographic images obtained from an X-ray CT apparatus, an MRI apparatus, or the like, for example, only outline information of an organ such as a bronchus lumen is extracted, and an internal image of this organ is not a parallel projection method. An image diagnostic system is known that displays a stereoscopic image as if it was actually looking inside by inserting an endoscope by using a perspective projection method (perspective).
[0003]
For example, when observing a target organ such as an organ in which a tumor has occurred, this diagnostic imaging system sequentially creates and displays a lumen image from the entrance of the target organ to the target site such as a tumor. To do. As a result, the lumen image is displayed in such a manner that the viewpoint sequentially moves in the lumen until the target site is reached.
[0004]
Alternatively, when the target site is designated on the image obtained by viewing the target organ from the outside by the operator, the diagnostic imaging system creates and displays a lumen image including the target site. As a result, the target site can be observed in the form of moving the viewpoint directly to the target site.
[0005]
[Problems to be solved by the invention]
However, the conventional diagnostic imaging system sequentially creates and displays the lumen images until reaching the target site when observing the target organ. Regarding the organ, there is a problem that it takes time until the image of the target part is actually displayed.
[0006]
This problem can be solved by designating the target site and displaying it directly as described above, but in this case, the route to reach the target site cannot be displayed. Information indicating a route to reach the target site is information required for planning an operation plan and is desired to be displayed.
[0007]
The present invention has been made in view of the above-described problems, and can search and display the shortest route to a target site in a short time, and sequentially display lumen images along the shortest route. Accordingly, an object of the present invention is to provide an image processing apparatus that can shorten the time required to display an image of a target region.
[0008]
In order to solve the above-described problem, an image processing apparatus according to the present invention includes a parallel projection image creation unit that creates a three-dimensional image of an object using a parallel projection method based on image information supplied from outside. , while designated as a starting point an arbitrary point in the desired tubular body in the three-dimensional image created by the parallel projection image generation means, a designating means for designating a desired target as a target as an end point, the A straight line is formed from the tubular body designated by the designation means toward the target, a ray vector is formed from a position where the straight line is in contact with the inner tube of the tubular body, and a plane parallel to the ray vector is detected, and detects the center of this plane as the center point, by connecting the respective center points of the respective tubular bodies in a line, reaches the target from a specified tubular body by said specifying means until A path detection means for detecting a plurality of paths along the shape of the tubular body between the, among the plurality of paths detected by the path detection unit, a shortest path detecting means for detecting a shortest path, least, the The apparatus has a composition display means for combining and displaying the shortest path detected by the shortest path detection means on the three-dimensional image of the object created by the parallel projection image creation means.
[0009]
In such an image processing apparatus, the path detection unit detects a plurality of paths along the shape of the tubular body between the tubular body designated by the designation unit and reaching the target, and the shortest path detection unit. However, the shortest route is detected among the plurality of routes detected by the route detecting means. Then, the composite display means synthesizes and displays at least the shortest path detected by the shortest path detection means on the three-dimensional image of the object created by the parallel projection image creation means. Accordingly, the shortest path from the tubular body designated by the designation means to the target can be displayed by being synthesized with the three-dimensional image of the object, and a doctor can prepare a surgical plan. It is possible to quickly provide effective information.
[0010]
Further, the image processing apparatus according to the present invention generates a perspective projection image that creates a three-dimensional image of an object using a perspective projection method based on image information supplied from the outside in order to solve the above-described problem. And control means for controlling the perspective projection image creation means so as to create at least a predetermined interval of an inner tube image of the tubular body along the shortest path detected by the shortest path detection means. It has a configuration.
[0011]
In such an image processing apparatus, the control means controls the perspective projection image creation means so as to create an inner tube image of the tubular body along the shortest path detected by the shortest path detection means at predetermined intervals. To do. As a result, an inner tube image can be created and displayed along the shortest path, so that the inner tube image of the tubular body from the tubular body designated by the designation means to the target can be quickly displayed. The time required for displaying the inner tube image can be shortened.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of an image processing apparatus according to the present invention will be described in detail with reference to the drawings.
[0013]
The image processing apparatus according to the present invention can be applied to, for example, an image diagnostic system. FIG. 1 is a block diagram showing the main part of the diagnostic imaging system of this embodiment. For example, image data (volume data) from an imaging apparatus such as an X-ray CT apparatus or an MRI apparatus, or magneto-optical from these imaging apparatuses. The contour data of the organ surface extracted based on the image data recorded and reproduced on a storage medium such as a disk is supplied via the input terminal 1.
[0014]
Specifically, as this contour data is conceptually shown in FIG. 2, a three-dimensional image is created based on a plurality of tomographic images obtained from an imaging apparatus such as an X-ray CT apparatus or an MRI apparatus. An image of the target organ is extracted from the dimensional image, and the contour of the image is extracted and supplied to the input terminal 1. The contour data supplied via the input terminal 1 is supplied to the center line extraction unit 2, the perspective image creation unit 3, and the parallel projection image creation unit 7, respectively.
[0015]
Based on the supplied contour data, the perspective image creation unit 3 creates a lumen image, which is a three-dimensional image inside the luminal organ by the so-called perspective projection method as shown in FIG. Is supplied to the image switching unit 9 and the image saving unit 11. Further, the parallel projection image creation unit 7 creates an outline display image that is a three-dimensional image showing the appearance of the luminal organ by the so-called parallel projection method as shown in FIG. 3A based on the contour data, This is supplied to the image switching unit 9 via the search route synthesis unit 8 and the search route synthesis unit 8. The image switching unit 9 selects an image designated by the operator from the lumen image and the outer shape display image, and supplies the selected image to the image display monitor 10. As a result, an outline display image or a lumen image as shown in FIGS. 3A and 3B is displayed on the monitor.
[0016]
In addition, when the rotation angle or the viewpoint position is designated for the lumen image or the outline display image, the display image is changed and displayed correspondingly. When an arbitrary point is clicked on the outline display image using, for example, a mouse device, the perspective image creation unit 3 creates a lumen image corresponding to the clicked position and displays it on the monitor. .
[0017]
Here, when the operator wants to know the shortest path from an arbitrary luminal organ of a plurality of luminal organs communicating with the target organ to the target organ, as shown in FIG. The external display image is displayed and operated, and the start point / end point specifying unit 6 is operated to specify an arbitrary point on the desired luminal organ as the start point S and the target organ is specified as the end point.
[0018]
When this designation is made, the centerline extraction unit 2 first advances the search point linearly from the start point S toward the back of the target organ as shown in FIG. Next, when the search point is advanced in a straight line in this manner, it collides with the wall of the lumen organ, so that a ray vector from the wall surface of the collided lumen organ is calculated as shown in FIG. Create (assum) a plane parallel to the ray vector. Thereby, since the point where the contour of the organ lumen intersects the plane is obtained, the center point of the plane is obtained from the contour of the lumen. Next, as shown in FIG. 4C, the center point and the start point S are connected by a straight line, and this is defined as a center line along the organ lumen.
[0019]
The center point does not calculate the center point of the plane parallel to the ray vector, but creates a circle that contacts the wall of the lumen organ where the search point collides, and uses the center of this circle as the center point. You may make it ask.
[0020]
By sequentially repeating such operations and sequentially connecting the center points, search vectors corresponding to all the luminal organs connected to the target organ can be obtained. As shown in e), the luminal organ may be branched. In this case, the center line extraction unit 2 performs a branching process described below.
[0021]
That is, when trying to find the center line at this branch, a plurality of inner wall surfaces appear as contacts on the search vector. For this reason, in this case, as branching processing, a parabolic vector is calculated for all the contacts to obtain each center point, and all the obtained center points are connected to the start point S as shown in FIG. The search vector is formed as follows. Thereby, as shown in FIG. 5A, search vectors A to C corresponding to all the luminal organs leading to the target organ can be obtained. When the center line extraction unit 2 obtains the search vectors A to C in this way, it supplies the search vector data indicating them to the shortest path calculation unit 4 shown in FIG.
[0022]
When each search vector data is supplied, the shortest path calculation unit 4 determines the length (distance) from the start point S to the target organ along the center line of the extracted lumen organ based on each search vector data. ) Is detected. Of the search vector data in which the length from the start point S to the target organ is detected by this tracking processing, for example, as shown in FIG. 5B, the length from the start point S to the target organ is the shortest. Search vector data (search vector data of a route having the smallest center line length) is detected, and this search vector data is used as search vector data (shortest route data) indicating the shortest route to the target organ. 8 is supplied.
[0023]
In addition to the shortest path data, the search path synthesis unit 8 is supplied with an outline display image from the parallel projection image creation unit 7. The search route synthesis unit 8 performs mapping processing of the shortest route data on the outline display image, and supplies this to the image display monitor 10 via the image switching unit 9. As a result, as shown in FIG. 3A, an arrow indicating the shortest path from the start point S designated by the operator to the target organ is displayed on the corresponding luminal organ of the outline display image.
[0024]
Thus, in the diagnostic imaging system of the present embodiment, the operator designates a desired point as a start point on a monitor-displayed outline display image, and designates a desired target organ as an end point. The centerline extraction unit and the shortest path calculation unit can search for the shortest path from the start point to the target organ and display an arrow indicating the shortest path in an overlapping manner on the outline display image. Therefore, doctors and the like can make a surgical plan while looking at the arrow indicating the shortest path, and can greatly contribute to future medical use.
[0025]
Next, the diagnostic imaging system of this embodiment can display a lumen image along the shortest path.
[0026]
That is, when the operator designates the display of the lumen image together with a desired interval such as the number of pixels, mm, and inches after the search of the shortest route, the search route automatic trace unit 5 causes the designated number of pixels or The perspective image creation unit 3 is controlled to create a lumen image of the lumen organ corresponding to the shortest path at every desired interval. When the perspective image creation unit 3 sequentially creates the lumen images at every desired interval, the perspective image creation unit 3 supplies them to the image display monitor 10 via the image switching unit 9 (automatic tracing). Thereby, the lumen image of the lumen organ corresponding to the shortest path can be sequentially displayed on the monitor along the shortest path.
[0027]
As described above, the diagnostic imaging system of the present embodiment can automatically display the lumen images created at predetermined intervals along the shortest path sequentially. the pause fingers 示等 automatic trace made by persons, perspective image creation unit 3 suspends the creation of bore image along the shortest path in response to this instruction, again, the lumen image It will be in a standby state until a creation instruction is given.
[0028]
Further, when an instruction to change the display direction is given during automatic tracing, the perspective image creation unit 3 creates a lumen image corresponding to the designated display direction and displays it on the monitor. Further, when an instruction to create a lumen image along a route other than the shortest route is given, the perspective image creation unit 3 creates a lumen image along the designated route and displays this on the monitor. . As a result, even in the middle of the process once determined (the process of creating a lumen image along the shortest path), it is possible to change the display direction, create a lumen image along a different path, and the like. Thus, the operability of the diagnostic imaging system can be improved.
[0029]
Furthermore, the diagnostic imaging system of the present embodiment can record and reproduce the lumen image (and the outline display image) created along the shortest path or a path other than the shortest path.
[0030]
That is, when recording of the lumen image is instructed by the operator, the perspective image creation unit 3 creates an image of the lumen image created along the shortest path or the lumen image created along a path other than the shortest path. The data is supplied to the save unit 11. When the lumen image is created, the image saving unit 11, together with additional information such as, for example, a patient identification number, imaging date / time, patient name, and image number continuously assigned to the lumen image, An image is recorded on a recording medium such as a magneto-optical disk.
[0031]
In the diagnostic imaging system, for example, a first reproduction mode for reproducing only one lumen image designated by inputting the image number by an operator, for example, is created and recorded along the shortest path. A second reproduction mode for sequentially reproducing the lumen images at predetermined time intervals, and a third mode in which all or part of the lumen images created and recorded along the shortest path are displayed on one screen at a time. A playback mode and the like are provided.
[0032]
First, when the operator wants to display a desired single lumen image, the operator designates the first reproduction mode and inputs the image number of the desired lumen image. When this designation and input are performed, the image saving unit 11 reproduces a lumen image corresponding to the image number input by the operator from among the plurality of lumen images recorded on the recording medium, Display control is performed on the display monitor 10. Thus, one lumen image desired by the operator can be displayed on the monitor.
[0033]
Further, when the operator wants to continuously reproduce the lumen image created and recorded along the shortest path every predetermined time, the operator designates the second reproduction mode. When this designation is performed, the image saving unit 11 sequentially reproduces the lumen images created along the shortest path recorded on the recording medium at predetermined time intervals, and displays them on the image display monitor 10. To do. Thereby, a series of lumen images along the shortest path can be continuously displayed. Note that the interval between image reproduction before and after the continuous reproduction may be a time predetermined on the system side or may be arbitrarily selected by the operator.
[0034]
Further, when the operator wants to display all or a part of the lumen image created and recorded along the shortest path on one screen at a time, the operator designates the third reproduction mode. When this designation is performed, the image saving unit 11 reproduces all or a part (two or more) of the lumen images created along the shortest path recorded on the recording medium, and performs a thinning process or the like. Thus, display control is performed on the image display monitor 10 as image information for one screen. Thereby, a series of lumen images along the shortest path can be divided and displayed on one screen (multi-screen display). In this multi-screen display, for example, the operator may select a plurality of lumen images by inputting an image number and display them at a time.
[0035]
If the luminal organs are intricately intertwined, even if the lumen image is reproduced, it will not be understood which part of the whole display part corresponds to, but the diagnostic imaging system, By designating the desired luminal organ site as the start point S and designating the target organ as the end point, the shortest path from the start point S to the target organ is automatically searched and displayed, and the shortest path A lumen image can be automatically created and displayed at predetermined intervals along the line. For this reason, it is possible to perform reproduction while recognizing which part of the whole lumen image being reproduced corresponds to.
[0036]
In addition, since the lumen image created in this way is created along the searched shortest path, the time required for creating the lumen image of the target region can be shortened. This can contribute to shortening of the time required for the preparation of a surgical plan.
[0037]
Finally, in the description of the above-described embodiment, the created lumen image is displayed on a monitor and recorded on a recording medium. This is because the created lumen image is displayed on a color printer device, an X-ray film, or the like. It may be output to an output medium and printed or recorded, etc. In addition, various modifications can be made depending on the design or the like as long as it does not depart from the technical idea of the present invention. Of course.
[0038]
【The invention's effect】
The image processing apparatus according to the present invention can search for and display the shortest route to a target site in a short time even in a complicated organ such as a blood vessel or a bronchus. For this reason, it can contribute to the drafting of an operation plan.
[0039]
Further, by sequentially displaying the lumen images along the searched shortest path, it is possible to shorten the time required to display the target site image.
[Brief description of the drawings]
FIG. 1 is a block diagram of an image diagnostic system according to an embodiment to which an image processing apparatus according to the present invention is applied.
FIG. 2 is a diagram conceptually showing input data supplied to the diagnostic imaging system of the embodiment.
FIG. 3 is a diagram showing a lumen image, an outer shape display image, and a shortest path to a target organ that is mapped and controlled on the outer shape display image in the image diagnosis system of the embodiment.
FIG. 4 is a diagram for explaining how to search for the shortest path to the target organ.
FIG. 5 is a diagram illustrating a state in which the shortest path is selected from a plurality of paths to the target organ.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Input terminal, 2 ... Centerline extraction part, 3 ... Perspective image creation part 4 ... Shortest path calculation part, 5 ... Search path | route automatic trace part, 6 ... Start point end point designation part 7 ... Parallel projection image creation part, 8 ... Search Route synthesis unit, 9 ... Image switching unit 10 ... Image display monitor, 11 ... Image save unit

Claims (3)

Based on the image information supplied from the outside, parallel projection image generation means for generating a three-dimensional image of the object using the parallel projection method, the desired tubular in the three-dimensional image created by the parallel projection image generation means while it designated as a starting point to any point in the body, and designation means for designating a desired target as a target as the end point, to form a straight line toward the target from a specified tubular member by the designating means The straight line is formed from the point where the straight line contacts the inner tube of the tubular body, a plane parallel to the radial vector is detected, the center of the plane is detected as the center point , and each tubular body is detected. A route detection hand for detecting a plurality of routes along the shape of the tubular body from the tubular body designated by the designating means to reaching the target by connecting the center points with a line. When, among the plurality of paths detected by the path detection unit, a shortest path detecting means for detecting a shortest path, at least, the shortest path detected by the shortest path detecting unit, by the parallel projection image generation means An image processing apparatus comprising: composite display means for combining and displaying a generated three-dimensional image of an object. In the branch portion where the plurality of tubular bodies are concentrated, the path detecting means is configured to detect from the plurality of locations of the inner tube of the tubular body that the straight line formed from the designated tubular body toward the target contacts. , to form the actinomycete vector respectively, the detected respective plane parallel to the actinomycetes vector, image processing apparatus according to claim 1, wherein the center of each plane and detects each as the center point. Based on image information supplied from the outside, a perspective projection image creation means for creating a three-dimensional image of the object using a perspective projection method, and at least along the shortest path detected by the shortest path detection means 3. The apparatus according to claim 1, further comprising a control unit that controls the perspective projection image generation unit so as to form an inner tube image of the tubular body at predetermined intervals. 4. Image processing apparatus.

Images