JP2013192673A - Medical image diagnostic apparatus, image processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a medical image diagnostic apparatus, image processing apparatus and program allowing an operator to easily recognize a position in the whole lumen to which a displayed fly-through image corresponds while moving a view point.SOLUTION: An ultrasonic diagnostic apparatus includes: a virtual endoscopic image generating part; a lumenal image generating part; and a control part. The virtual endoscopic image generating part generates a virtual endoscopic image of the inside of a lumen included in three-dimensional image data projected from a prescribed direction of line of sight. The lumenal image generating part extracts the whole lumen by reversing the luminance of inside and outside of the lumen on the whole lumen whose virtual endoscopic image is generated, and generates a lumenal image in which the contour of the lumen from a view point is visualized with the view point being a prescribed position outside the extracted whole lumen. The control part displays the virtual endoscopic image and the lumenal image on a monitor.

Description

  Embodiments described herein relate generally to a medical image diagnostic apparatus, an image processing apparatus, and a program.

  Conventionally, there is a medical image processing apparatus that displays three-dimensional image data collected by a medical image diagnostic apparatus. The medical image diagnostic apparatus referred to here is an ultrasonic diagnostic apparatus, an X-ray computed tomography (CT) apparatus, a magnetic resonance imaging (MRI) apparatus, an X-ray diagnostic apparatus, or the like.

  In recent years, in an ultrasonic diagnostic apparatus, 3D data (volume data) is collected using a 2D array probe (two dimensional array probe) or a mechanical 4D probe (mechanical four dimensional probe), and the collected volume data is used. Intrahepatic portal veins and breast ducts are observed. In such intraluminal observation, for example, flythrough display for displaying the inside of the lumen as if viewed through an endoscope is used.

  In the fly-through display, a viewpoint and a line-of-sight direction are set in a lumen included in volume data, and a projection image (virtual endoscopic image) is generated and displayed. In the milling-through display, the virtual endoscopic image generated while moving the viewpoint position along the lumen is updated to display a fly-through image shown as a moving image. However, in the above-described conventional technique, it may be difficult to determine which position in the entire lumen the fly-through image displayed while moving the viewpoint position.

JP 2008-220416 A

  A problem to be solved by the present invention is a medical image diagnostic apparatus and image processing that make it possible to easily grasp which position in the entire lumen corresponds to a fly-through image displayed while moving the viewpoint position It is to provide an apparatus and a program.

  The medical image diagnostic apparatus according to the embodiment includes virtual endoscopic image generation means, lumen image generation means, and display control means. The virtual endoscopic image generating means generates a virtual endoscopic image obtained by projecting the inside of the lumen included in the three-dimensional image data from a predetermined line-of-sight direction. The lumen image generation means extracts the entire lumen by inverting the luminance inside and outside the lumen with respect to the entire lumen from which the virtual endoscopic image is generated. Using a predetermined external position as a viewpoint position, a lumen image in which the appearance of the lumen from the viewpoint position is depicted is generated. The display control means displays the virtual endoscopic image and the lumen image on a predetermined display unit.

FIG. 1 is a diagram for explaining the overall configuration of the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 2 is a diagram for explaining a problem in the prior art. FIG. 3 is a diagram illustrating an example of the configuration of the image generation unit according to the first embodiment. FIG. 4 is a diagram for explaining an example of processing by the lumen image generation unit according to the first embodiment. FIG. 5A is a diagram illustrating an example of a MAP image according to the first embodiment. FIG. 5B is a diagram illustrating an example of a MAP image according to the first embodiment. FIG. 6 is a diagram illustrating an example of display of a MAP image according to the first embodiment. FIG. 7 is a diagram illustrating an example of the display of the MAP image on the touch command screen according to the first embodiment. FIG. 8 is a diagram illustrating an example of a display of a MAP image in which the range inside the lumen according to the first embodiment is superimposed. FIG. 9 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 10 is a diagram for explaining an example of processing performed by the virtual endoscopic image generation unit according to the second embodiment. FIG. 11 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus according to the second embodiment. FIG. 12 is a diagram for explaining an example of control by the control unit according to the third embodiment. FIG. 13A is a diagram illustrating an example of a fly-through image display according to the third embodiment. FIG. 13B is a diagram illustrating an example of a fly-through image display according to the third embodiment. FIG. 14 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus according to the third embodiment.

  Hereinafter, embodiments of a medical image diagnostic apparatus will be described in detail with reference to the accompanying drawings. Hereinafter, an ultrasonic diagnostic apparatus will be described as an example of the medical image diagnostic apparatus.

(First embodiment)
First, the configuration of the ultrasonic diagnostic apparatus according to the present embodiment will be described. FIG. 1 is a diagram for explaining a configuration of an ultrasonic diagnostic apparatus 100 according to the first embodiment. As shown in FIG. 1, the ultrasonic diagnostic apparatus 100 according to the first embodiment includes an ultrasonic probe 1, a monitor 2, an input apparatus 3, and an apparatus main body 10.

  The ultrasonic probe 1 includes a plurality of piezoelectric vibrators, and the plurality of piezoelectric vibrators generate ultrasonic waves based on a drive signal supplied from a transmission / reception unit 11 included in the apparatus main body 10 described later. The ultrasonic probe 1 receives a reflected wave from the subject P and converts it into an electrical signal. The ultrasonic probe 1 includes a matching layer provided on the piezoelectric vibrator, a backing material that prevents propagation of ultrasonic waves from the piezoelectric vibrator to the rear, and the like. The ultrasonic probe 1 is detachably connected to the apparatus main body 10.

  When ultrasonic waves are transmitted from the ultrasonic probe 1 to the subject P, the transmitted ultrasonic waves are reflected one after another at the discontinuous surface of the acoustic impedance in the body tissue of the subject P, and the ultrasonic probe is used as a reflected wave signal. 1 is received by a plurality of piezoelectric vibrators. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance at the discontinuous surface where the ultrasonic wave is reflected. Note that the reflected wave signal when the transmitted ultrasonic pulse is reflected on the moving blood flow or the surface of the heart wall depends on the velocity component of the moving body in the ultrasonic transmission direction due to the Doppler effect. And undergoes a frequency shift.

  Here, the ultrasound probe 1 according to the present embodiment is an ultrasound probe capable of scanning the subject P in two dimensions with ultrasound and scanning the subject P in three dimensions. Specifically, the ultrasonic probe 1 according to this embodiment swings a plurality of piezoelectric vibrators that scan the subject P in two dimensions at a predetermined angle (swing angle), thereby causing the subject P to move. This is a mechanical scan probe that scans in three dimensions. Alternatively, the ultrasonic probe 1 according to the present embodiment is a two-dimensional ultrasonic probe that can ultrasonically scan the subject P in three dimensions by arranging a plurality of piezoelectric vibrators in a matrix. . Note that the two-dimensional ultrasonic probe can scan the subject P two-dimensionally by focusing and transmitting ultrasonic waves.

  As shown in FIG. 1, the input device 3 includes a trackball 3a, a switch 3b, a dial 3c, a touch command screen 3d, and the like, and is connected to the device main body 10 via an interface unit 18 described later. The input device 3 accepts various setting requests from an operator of the ultrasonic diagnostic apparatus, and transfers the accepted various setting requests to the apparatus main body 10. For example, the dial 3c has a rotary encoder, and accepts the setting of the viewpoint position when generating a lumen image. For example, the touch command screen 3d displays a lumen image and accepts changes in various settings of the lumen image. The lumen image will be described in detail later.

  For example, the input device 3 according to the present embodiment gives instructions from the operator regarding the setting of the start point and end point in the lumen and the setting of the viewpoint and the line-of-sight direction for setting the lumen that the observer desires to observe. Accept.

  The monitor 2 displays a GUI (Graphical User Interface) for an operator of the ultrasonic diagnostic apparatus 100 to input various setting requests using the input apparatus 3, and displays an ultrasonic image generated in the apparatus main body 10. Or display. For example, the monitor 2 displays a MAP image generated by processing of the image generation unit 14 described later. The MAP image will be described later in detail.

  The apparatus main body 10 is an apparatus that generates an ultrasonic image based on the reflected wave received by the ultrasonic probe 1. Specifically, the apparatus main body 10 according to the present embodiment is an apparatus that can generate a three-dimensional ultrasonic image (volume data) based on three-dimensional reflected wave data received by the ultrasonic probe 1. As shown in FIG. 1, the apparatus body 10 includes a transmission / reception unit 11, a B-mode processing unit 12, a Doppler processing unit 13, an image generation unit 14, an image memory 15, an internal storage unit 16, and a control unit 17. And an interface unit 18.

  The transmission / reception unit 11 includes a trigger generation circuit, a delay circuit, a pulsar circuit, and the like, and supplies a drive signal to the ultrasonic probe 1. The pulsar circuit repeatedly generates rate pulses for forming transmission ultrasonic waves at a predetermined rate frequency. The delay circuit also sets the delay time for each piezoelectric vibrator necessary for determining the transmission directivity by focusing the ultrasonic wave generated from the ultrasonic probe 1 into a beam shape, and for each rate pulse generated by the pulser circuit. Give to. The trigger generation circuit applies a drive signal (drive pulse) to the ultrasonic probe 1 at a timing based on the rate pulse. In other words, the delay circuit arbitrarily adjusts the transmission direction from the piezoelectric vibrator surface by changing the delay time given to each rate pulse.

  The transmission / reception unit 11 has a function capable of instantaneously changing the transmission frequency, the transmission drive voltage, and the like in order to execute a predetermined scan sequence based on an instruction from the control unit 17 described later. In particular, the change of the transmission drive voltage is realized by a linear amplifier type transmission circuit capable of instantaneously switching its value or a mechanism for electrically switching a plurality of power supply units.

  The transmission / reception unit 11 includes an amplifier circuit, an A / D converter, an adder, and the like, and performs various processes on the reflected wave signal received by the ultrasonic probe 1 to generate reflected wave data. The amplifier circuit amplifies the reflected wave signal for each channel and performs gain correction processing. The A / D converter performs A / D conversion on the gain-corrected reflected wave signal and gives a delay time necessary for determining reception directivity to the digital data. The adder performs an addition process of the reflected wave signal processed by the A / D converter to generate reflected wave data. By the addition processing of the adder, the reflection component from the direction corresponding to the reception directivity of the reflected wave signal is emphasized.

  As described above, the transmission / reception unit 11 controls transmission directivity and reception directivity in ultrasonic transmission / reception. Here, the transmission / reception unit 11 according to the present embodiment transmits a three-dimensional ultrasonic beam from the ultrasonic probe 1 to the subject P, and three-dimensionally receives the three-dimensional reflected wave signal received by the ultrasonic probe 1. The reflected wave data is generated.

  The B-mode processing unit 12 receives the reflected wave data from the transmission / reception unit 11 and performs logarithmic amplification, envelope detection processing, and the like to generate data (B-mode data) in which the signal intensity is expressed by brightness. . Here, the B-mode processing unit 12 can change the frequency band to be visualized by changing the detection frequency. Further, the B-mode processing unit 12 can perform detection processing with two detection frequencies in parallel on one reflected wave data.

  The Doppler processing unit 13 performs frequency analysis on velocity information from the reflected wave data received from the transmission / reception unit 11, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and mobile body information such as average velocity, dispersion, and power. Is generated for multiple points (Doppler data).

  Note that the B-mode processing unit 12 and the Doppler processing unit 13 according to the present embodiment can process both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the B-mode processing unit 12 according to the present embodiment can generate three-dimensional B-mode data from the three-dimensional reflected wave data. In addition, the Doppler processing unit 13 according to the present embodiment can generate three-dimensional Doppler data from the three-dimensional reflected wave data.

  The image generation unit 14 generates an ultrasound image from the data generated by the B mode processing unit 12 and the Doppler processing unit 13. That is, the image generation unit 14 generates a B-mode image in which the intensity of the reflected wave is represented by luminance from the B-mode data generated by the B-mode processing unit 12. Specifically, the image generation unit 14 generates a three-dimensional B-mode image from the three-dimensional B-mode data generated by the B-mode processing unit 12.

  In addition, the image generation unit 14 generates a color Doppler image as an average velocity image, a dispersed image, a power image, or a combination image representing moving body information from the Doppler data generated by the Doppler processing unit 13. Specifically, the image generation unit 14 generates a three-dimensional color Doppler image from the three-dimensional Doppler data generated by the Doppler processing unit 13. Hereinafter, the three-dimensional B-mode image and the three-dimensional color Doppler image generated by the image generation unit 14 are collectively referred to as “volume data”.

  In addition, the image generation unit 14 can generate various images for displaying the generated volume data on the monitor 2. Specifically, the image generation unit 14 can generate an MPR image and a rendering image from the volume data.

  That is, when the ultrasonic probe 1 performs ultrasonic three-dimensional scanning on the imaging region of the subject P, the transmission / reception unit 11 generates three-dimensional data. Then, the image generation unit 14 displays, as an image for displaying volume data on the monitor 2, for example, an MPR image in three orthogonal cross sections or a contact surface of the ultrasonic probe 1 with respect to the subject P according to an instruction from the operator. A rendering image when a viewpoint is used and a rendering image when an arbitrary place is a viewpoint are generated.

  In addition, the image generation unit 14 generates a fly-through image, a MAP image, or the like depicting a lumen included in the volume data. The generation of fly-through images and MAP images by the image generation unit 14 will be described in detail later. The image generation unit 14 can also generate a composite image in which character information, scales, body marks, and the like of various parameters are combined with the ultrasonic image.

  The image memory 15 is a memory that stores the ultrasonic image generated by the image generation unit 14. The image memory 15 can also store data generated by the B-mode processing unit 12 and the Doppler processing unit 13.

  The internal storage unit 16 stores a control program for performing ultrasonic transmission / reception, image processing and display processing, diagnostic information (for example, patient ID, doctor's findings, etc.), various data such as a diagnostic protocol and various body marks. To do. The internal storage unit 16 is also used for storing images stored in the image memory 15 as necessary.

  The control unit 17 is a control processor (CPU: Central Processing Unit) that realizes a function as an information processing apparatus (computer), and controls the entire processing of the ultrasonic diagnostic apparatus. Specifically, the control unit 17 is based on various setting requests input from the operator via the input device 3 and various control programs and various data read from the internal storage unit 16. The processing of the processing unit 12, the Doppler processing unit 13, and the image generation unit 14 is controlled. The control unit 17 also includes an ultrasonic image stored in the image memory 15, various images stored in the internal storage unit 16, a GUI for performing processing by the image generation unit 14, a processing result of the image generation unit 14, and the like. Is displayed on the monitor 2.

  The interface unit 18 is an interface to the input device 3. Various setting information and various instructions from the operator received by the input device 3 are transferred to the control unit 17 by the interface unit 18.

  The overall configuration of the ultrasonic diagnostic apparatus according to the first embodiment has been described above. With this configuration, the ultrasonic diagnostic apparatus according to the first embodiment is configured to display a fly-through image displayed while moving the viewpoint position by the processing of the image generation unit 14 described in detail below. It is configured so that the position corresponding to the position can be easily grasped.

  Here, first, a fly-through image in the prior art will be described. FIG. 2 is a diagram for explaining a problem in the prior art. FIG. 2 shows a state where the monitor 2 displays the fly-through image and the MPR image having three orthogonal cross sections at the viewpoint position of the fly-through image. Here, in FIG. 2, the lower right image shows a milling-through image, and the upper left and lower and right upper images show three orthogonal cross-sectional MPR images.

  For example, in the prior art, the fly-through image and the MPR image having three orthogonal cross sections shown in FIG. 2 are generated while the viewpoint position is moved, and are updated to the generated image and displayed. That is, since the observer observes only the image at a certain position in the lumen, it is difficult to grasp the position in the entire lumen of the fly-through image currently observed.

  Therefore, in the present embodiment, a MAP image depicting the whole lumen is generated by the processing of the image generation unit 14 described in detail below, and displayed to the observer so that it is displayed at the present time. It is possible to easily grasp the position of the fly-through image in the entire lumen.

  FIG. 3 is a diagram illustrating an example of the configuration of the image generation unit 14 according to the first embodiment. As illustrated in FIG. 3, the image generation unit 14 includes a core line setting unit 141, a virtual endoscope image generation unit 142, and a lumen image generation unit 143.

  The core line setting unit 141 sets a core line in a lumen included in three-dimensional image data collected by three-dimensionally scanning a subject with a transmission signal transmitted from the ultrasound probe 1. Specifically, the core line setting unit 141 reads the volume data stored in the image memory 15 or the internal storage unit 16, extracts the lumen included in the volume data, and sets the core line in the extracted lumen.

  Here, first, in order to perform the processing of the core wire setting unit 141, the observer designates volume data to be processed via the input device 3, and further, three orthogonal sections (A surface, B surface, C). Screen) MPR image display request. The control unit 17 notified of the display request from the input device 3 controls the image generation unit 14 to generate an MPR image having three orthogonal cross sections from the volume data designated by the operator. The monitor 2 displays the MPR image of the three orthogonal cross sections generated by the image generation unit 14 under the control of the control unit 17.

  The observer sets the starting point for the core line setting unit 141 to set the core line in the lumen drawn in the MPR image displayed on the monitor 2 by using the drawing function of the input device 3. The control unit 17 acquires position information in the volume data of the start point received by the input device 3, and notifies the core line setting unit 141 of the acquired position information of the start point.

  The core line setting unit 141 acquires the luminance of the volume data at the start point, and sequentially specifies voxels having luminance that falls within a predetermined threshold range with respect to the acquired luminance. Thereby, the core line setting unit 141 extracts a lumen region included in the volume data. That is, the core wire setting unit 141 extracts a lumen region by performing a morphological operation (Dilation, Erosion, Opening, Closing). Then, the core wire setting unit 141 sets a core wire in the lumen region. For example, the core line setting unit 141 sets the core line by thinning the lumen region. In other words, the core line setting unit 141 sets the position information of the core line in the volume data as the core line information of the lumen region.

  The core wire setting unit 141 can select the setting direction of the core wire based on a preset selection condition when the lumen region is branched. For example, assume that the operator sets a branch point in a branching lumen region. In such a case, the core wire setting unit 141 extracts a lumen region that branches in two directions. And the core wire setting part 141 can set two core wires which are divided into two at a branch point as a core wire.

  Here, when “setting direction of core wire: length priority” is set as the selection condition, the core wire setting unit 141 can set the longer core wire by comparing the lengths of the two core wires. Set the direction core. Alternatively, when “core line setting direction: lumen thickness priority” is set as the selection condition, the core line setting unit 141 has a thick lumen among the two lumens branching in two directions. Set the direction core.

  In addition, the case where the process of the core wire setting part 141 mentioned above is manually performed by the operator may be sufficient. Moreover, this embodiment may be a case where the operator specifies the setting direction of the core wire when the lumen region is branched. For example, the observer designates the setting direction of the core line by moving the cursor in a desired direction on the cross-sectional image near the branch point displayed on the monitor 2.

  The virtual endoscope image generation unit 142 generates a virtual endoscope image from an arbitrary viewpoint and line-of-sight direction along the core line set by the core line setting unit 141. Specifically, the virtual endoscopic image generation unit 142 moves the viewpoint in a certain direction along the trajectory of the core line at a certain distance interval and a certain time interval, and moves through the lumen from each line-of-sight direction. Each projected virtual endoscopic image is generated using volume data.

  Here, first, the viewpoint and the line-of-sight direction are set by the observer in order for the virtual endoscope image generation unit 142 to perform processing. Then, the virtual endoscopic image generation unit 142 generates a virtual endoscopic image in which the inside of the lumen is projected in the visual line direction set from the viewpoint on the set core line. At this time, the virtual endoscopic image generation unit 142 performs radial projection from the viewpoint radially toward the range of the near plane and the far plane determined by the FOV (Field Of View) angle that is the viewing angle centered on the line-of-sight direction. . Then, the virtual endoscopic image generation unit 142 generates and generates virtual endoscopic images in which the inside of the lumen is projected from each gaze direction while moving the viewpoint at a constant distance interval and a constant time interval. The virtual endoscopic image is stored in the image memory 15.

  And the control part 17 orthogonally crosses the virtual endoscopic image which projected the inside of the lumen from each gaze direction produced | generated by the virtual endoscopic image production | generation part 142 in the viewpoint position where the said virtual endoscopic image was produced | generated. Three-section MPR images are displayed on the monitor 2. Here, the control unit 17 updates the virtual endoscopic image at a time interval when the viewpoint is moved when the virtual endoscopic image generation unit 142 generates the virtual endoscopic image, so that the line of sight in the lumen can be seen. It is possible to display a moving image that can be observed while moving in the direction (flythrough image). When a fly-through image is displayed, the MPR image having three orthogonal cross sections is also updated as the viewpoint moves.

  The lumen image generation unit 143 extracts the entire lumen by inverting the luminance inside and outside the lumen with respect to the entire lumen in which the virtual endoscopic image is generated, and extracts the entire lumen Using a predetermined external position as a viewpoint position, a lumen image in which the appearance of the lumen from the viewpoint position is depicted is generated. Specifically, the lumen image generation unit 143 sets a predetermined position that is perpendicular to the line-of-sight direction and the same circumference as the viewpoint position when the virtual endoscopic image is generated, as the viewpoint position, and An image in which the entire lumen is projected from the viewpoint position is generated as the lumen image. FIG. 4 is a diagram for explaining an example of processing by the lumen image generation unit 143 according to the first embodiment. FIG. 4 shows processing after the lumen included in the volume data is extracted by the core line setting unit 141. FIG. 4 shows processing for a lumen in which a virtual endoscopic image is generated by the virtual endoscopic image generation unit 142.

  For example, the lumen image generation unit 143 performs luminance inversion processing on the volume data 200 including the lumen shown in FIG. 4A, and as shown in FIG. Extract only 300. For example, the lumen image generation unit 143 converts the luminance determined as the inside of the lumen 300 to the maximum luminance when the lumen 300 is extracted by the core line setting unit 141, and the outside of the lumen 300. The luminance determined as is converted to the minimum luminance. As a result, only the lumen 300 is extracted, and the appearance of the lumen 300 can be rendered.

  Then, as shown in FIG. 4C, the lumen image generation unit 143 is a plane perpendicular to the line-of-sight direction 301 when the virtual endoscopic image is generated for the extracted lumen 300. , A predetermined position on the circle 400 centering on the intersection 302 between the line-of-sight direction 301 and the surface is a viewpoint position, and a lumen image (hereinafter referred to as a MAP image) in which the entire lumen is projected from the viewpoint position is Generate. For example, the lumen image generation unit 143 generates a MAP image with the point 401 and the point 402 shown in FIG. Note that the position of the surface can be arbitrarily set. For example, the viewpoint position for generating a virtual endoscopic image may be set.

  Hereinafter, an example of the MAP image will be described with reference to FIGS. 5A and 5B. 5A and 5B are diagrams illustrating an example of a MAP image according to the first embodiment. FIG. 5A shows a MAP image when the point 401 in FIG. FIG. 5B shows a MAP image when the point 402 in FIG. 4C is set as the viewpoint position.

  For example, as illustrated in FIG. 5A, the lumen image generation unit 143 generates a MAP image in which the entire lumen is projected from the point 401 (upper side of the lumen) in FIG. A MAP image in which a branch is drawn is generated. Here, as shown in FIG. 5A, the lumen image generation unit 143 superimposes an arrow indicating the viewpoint position and the line-of-sight direction of the virtual endoscopic image currently displayed as a fly-through image on the MAP image. Generate an image. For example, the lumen image generation unit 143 generates an arrow image indicating the viewpoint position and line-of-sight direction of the virtual endoscopic image in a layer different from the MAP image, and generates an image in which the generated arrow is superimposed on the MAP image. To do. Then, the lumen image generation unit 143 generates an arrow image every time the virtual endoscopic image is updated in the fly-through image, so that the current fly-through image depicts which position of the entire lumen. It is possible to specify whether or not

  Further, for example, as shown in FIG. 5B, the lumen image generation unit 143 generates a MAP image in which the entire lumen is projected from a point 402 (side of the lumen) in FIG. Similarly to the MAP image in FIG. 5A, the MAP image in FIG. 5B generates an image in which arrows indicating the viewpoint position and the line-of-sight direction of the virtual endoscopic image currently displayed as a fly-through image are superimposed. Is possible.

  The MAP images shown in FIGS. 5A and 5B are merely examples. For example, a MAP image can be generated with an arbitrary point on the circle 400 in FIG. 4C as the viewpoint position. The viewpoint position on the circle can be freely changed by the operator. For example, it is possible to link the movement of the rotary encoder of the dial 3c and the movement of the viewpoint position on the circle 400, and the operator can freely change the viewpoint position by rotating the dial 3c.

  Also, the radius of the circle 400 can be set arbitrarily. For example, the radius of the circle 400 can be freely changed by linking the reduction and expansion of the radius of the circle 400 with the rotary encoder of the dial 3c and rotating the dial 3c by the operator. Thereby, for example, the MAP image can be freely enlarged or reduced. Note that the change of the viewpoint position and the radius of the circle using the dial 3c described above is merely an example. That is, the trackball 3a may be used, or the touch command screen 3d may be used.

  The ultrasonic diagnostic apparatus 100 according to the present embodiment displays the above-described fly-through image and the MAP image at the same time, and the fly-through image displayed while moving the viewpoint position corresponds to which position of the entire lumen. You can easily figure out what to do. FIG. 6 is a diagram illustrating an example of display of a MAP image according to the first embodiment. For example, as illustrated in FIG. 6, the control unit 17 generates a fly-through image 21 that is a moving image of the virtual endoscopic image generated by the virtual endoscopic image generation unit 142 and a lumen image generation unit 143. The displayed MAP image 22 is displayed on the monitor 2.

  Thus, the observer can observe the fly-through image while grasping the shape of the entire lumen, and to which position of the entire lumen the fly-through image displayed while moving the viewpoint position corresponds. Can be easily grasped.

  Further, the control unit 17 updates the position of the arrow on the MAP image every time the virtual endoscopic image is updated in the fly-through image 21. That is, the arrow on the MAP image is displayed in conjunction with the fly-through image. Therefore, the observer can more easily grasp which position in the entire lumen corresponds to the fly-through image displayed while moving the viewpoint position.

  In the above-described example, the case where the position of the arrow on the MAP image is updated each time the virtual endoscopic image is updated has been described. However, the ultrasonic diagnostic apparatus 100 according to the present embodiment is not limited to the virtual endoscope. It is also possible to update the MAP image in conjunction with the update of the image. For example, it is possible to update to a MAP image whose viewpoint position has been changed in conjunction with the display of the fly-through image.

  In such a case, the lumen image generation unit 143 generates a MAP image in which the viewpoint position is changed in conjunction with the change in the viewpoint position when the viewpoint position in the virtual endoscopic image is changed. That is, the lumen image generation unit 143 generates a MAP image from the moved viewpoint position after moving the viewpoint position according to the viewpoint position where the virtual endoscopic image is generated.

  The control unit 17 displays the virtual endoscopic image and the MAP image on the monitor 2 while synchronizing and updating the virtual endoscopic image and the MAP image. Thereby, the control part 17 can display on the monitor 2 the MAP image which a viewpoint position moves in conjunction with a fly-through image.

  Here, the ultrasonic diagnostic apparatus 100 according to the first embodiment can also display a MAP image on the touch command screen 3d. FIG. 7 is a diagram illustrating an example of display of a MAP image on the touch command screen 3d according to the first embodiment. For example, as shown in FIG. 7, the control unit 17 displays the fly-through image 21 on the monitor 2 and displays the MAP image 22 on the touch command screen 3d.

  Here, in the ultrasonic diagnostic apparatus 100 according to the first embodiment, it is possible to move the fly-through image 21 to an arbitrary position using the touch command screen 3d. For example, as shown in FIG. 7, when the operator moves the arrow on the MAP image displayed on the touch command screen 3d with a finger, the fly-through image displayed on the monitor 2 is moved to an arbitrary position. It is possible to move to.

  In such a case, the virtual endoscopic image generation unit 142 generates a virtual endoscopic image based on an arrow moving operation received by the touch command screen 3d. Then, the virtual endoscopic image generated by the control unit 17 is displayed on the monitor 2. For example, when the operator turns the direction of the arrow in the reverse direction, the virtual endoscopic image generation unit 142 projects the inside of the lumen with the line-of-sight direction reversed from the current viewpoint position. Is stored in the image memory 15. The control unit 17 reads the virtual endoscopic image generated from the image memory 15 and displays it on the monitor 2. Similarly, for example, when the operator moves the position of the arrow, the virtual endoscopic image generation unit 142 moves the viewpoint position from the current viewpoint position to the destination of the arrow, and changes the direction of the arrow. A virtual endoscopic image in which the inside of the lumen is projected as the viewing direction is generated and stored in the image memory 15. The control unit 17 reads the virtual endoscopic image generated from the image memory 15 and displays it on the monitor 2.

  In addition to the arrows, the ultrasound diagnostic apparatus 100 according to the first embodiment can also display information indicating the range inside the lumen depicted in the current fly-through image superimposed on the MAP image. It is. FIG. 8 is a diagram illustrating an example of a display of a MAP image in which the range inside the lumen according to the first embodiment is superimposed. FIG. 8 shows a case where a fly-through image and a MAP image are displayed on the monitor 2.

  For example, as illustrated in FIG. 8, the ultrasonic diagnostic apparatus 100 according to the first embodiment includes a fly-through image 21 and a MAP image in which a range 22 a inside the lumen depicted on the current fly-through image is superimposed. 22 is displayed on the monitor 2. In such a case, the lumen image generation unit 143 generates an image of the range 22a based on the viewpoint position, the line-of-sight direction, and the FOV when the virtual endoscope image currently displayed in the fly-through image is generated. , It is generated in a layer different from the MAP image. The lumen image generation unit 143 generates an image in which the image of the range 22a is superimposed on the MAP image, and stores the image in the image memory 15. The control unit 17 reads the MAP image in which the range 22 a is superimposed from the image memory 15 and displays it on the monitor 2.

  Next, processing of the ultrasonic diagnostic apparatus 100 according to the first embodiment will be described with reference to FIG. FIG. 9 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus 100 according to the first embodiment. As shown in FIG. 9, in the ultrasonic diagnostic apparatus 100 according to the first embodiment, when the MAP image display mode is ON (Yes at Step S101), the core line setting unit 141 displays the lumen included in the volume data. The core line is set to (step S102), and the lumen is extracted.

  Then, the virtual endoscopic image generation unit 142 generates a fly-through image by generating a virtual endoscopic image while moving the viewpoint position along the core line set by the core line setting unit 141 (Step S1). S103). Subsequently, the lumen image generation unit 143 inverts the luminance of the lumen in which the fly-through image is generated (step S104), and extracts only the lumen.

  Then, the lumen image generation unit 143 generates a MAP image in which the extracted lumen is projected from a predetermined viewpoint position (step S105). Thereafter, the control unit 17 causes the fly-through image generated by the virtual endoscopic image generation unit 142 and the MAP image generated by the lumen image generation unit 143 to be displayed in parallel on the monitor 2 (step S106). The process is terminated. If the MAP image display mode is OFF (No at Step S101), only the fly-through image is displayed.

  As described above, according to the first embodiment, the virtual endoscopic image generation unit 142 generates a virtual endoscopic image obtained by projecting the inside of the lumen included in the three-dimensional image data from a predetermined gaze direction. To do. Then, the lumen image generation unit 143 extracts the entire lumen by inverting the luminance inside and outside the lumen with respect to the entire lumen in which the virtual endoscopic image is generated, and extracts the extracted lumen A MAP image in which the appearance of the lumen from the viewpoint position is drawn with a predetermined position outside the whole as the viewpoint position is generated. Then, the control unit 17 displays the virtual endoscopic image and the MAP image on the monitor 2. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment can observe the fly-through image while grasping the shape of the entire lumen, and the fly-through image displayed while moving the viewpoint position is displayed on the tube. It is possible to easily grasp the position corresponding to the entire cavity.

  Further, according to the first embodiment, the lumen image generation unit 143 is a predetermined position that is perpendicular to the line-of-sight direction when the virtual endoscope image is generated and is on the same circumference. Is used as a viewpoint position, and an image in which the entire lumen is projected from the viewpoint position is generated as a MAP image. Then, the control unit 17 displays the virtual endoscopic image and the MAP image on the monitor 2. Therefore, the ultrasound diagnostic apparatus 100 according to the first embodiment can easily generate a MAP image depicting the entire lumen in consideration of the line-of-sight direction of the fly-through image.

  Further, according to the first embodiment, the display control unit superimposes and displays the arrow indicating the viewpoint position and the line-of-sight direction when the virtual endoscopic image is generated on the MAP image. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment makes it possible to more easily grasp the position in the entire lumen corresponding to the fly-through image displayed while moving the viewpoint position. .

  Further, according to the first embodiment, the dial 3c accepts an operation for changing a radius of a circle that determines a viewpoint position when generating a MAP image, and an operation for changing the viewpoint position on the circle. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment can display the MAP image desired by the operator, and the fly-through image displayed while moving the viewpoint position is at which position of the entire lumen. It makes it possible to make it easier to understand what is equivalent.

  Further, according to the first embodiment, the control unit 17 causes the touch command screen 3d to display the MAP image on which the arrow indicating the viewpoint position and the line-of-sight direction when the virtual endoscopic image is generated is superimposed. And then. The touch command screen 3d accepts an operation for changing the viewpoint position and the line-of-sight direction of the virtual endoscopic image. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment makes it possible to display a virtual endoscopic image at a position desired by the operator in the entire lumen.

  Further, according to the first embodiment, the control unit 17 superimposes and displays the information indicating the range inside the lumen depicted in the virtual endoscopic image on the MAP image. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment makes it possible to easily grasp which range of the entire lumen is depicted by the image inside the lumen depicted at the present time. .

  Further, according to the first embodiment, the lumen image generation unit 143 changes the viewpoint position in conjunction with the change in the viewpoint position when the viewpoint position in the virtual endoscopic image is changed. Generate an image. Then, the control unit 17 causes the monitor 2 to display the virtual endoscopic image and the MAP image in conjunction with each other. Therefore, the ultrasonic diagnostic apparatus 100 according to the first embodiment can update and display the MAP image in accordance with the fly-through image, and an image inside the lumen drawn at the present time can be displayed for the entire lumen. It is possible to make it easier to grasp which position is drawn.

(Second Embodiment)
In the first embodiment described above, the case where the MAP image is generated by inverting the luminance of the lumen that generated the fly-through image has been described. In the second embodiment, a case where luminance inversion is applied when displaying a fly-through image will be described. Note that the ultrasonic diagnostic apparatus according to the second embodiment differs from the ultrasonic diagnostic apparatus 100 according to the first embodiment only in the processing content of the virtual endoscopic image generation unit 142 shown in FIG. . Hereinafter, the ultrasonic diagnostic apparatus according to the second embodiment will be described as the ultrasonic diagnostic apparatus 100a, and the virtual endoscope image generation unit will be described as the virtual endoscope image generation unit 142a.

  The virtual endoscopic image generation unit 142a generates a virtual endoscopic image in which the luminance and the line-of-sight direction are reversed when the viewpoint position for generating the virtual endoscopic image is arranged outside the lumen. Specifically, the virtual endoscopic image generation unit 142a sets the luminance of the virtual endoscopic image when the viewpoint position when generating the virtual endoscopic image is set outside the lumen by the operator. The projected image is generated by reversing and rotating the viewing direction by 180 °. FIG. 10 is a diagram for explaining an example of processing by the virtual endoscopic image generation unit 142a according to the second embodiment.

  For example, when the viewpoint position is set outside the lumen by the operator, the display becomes a single-sided medium as shown in FIG. 10A, and not only the inside of the lumen but also the direction and position cannot be known. . Therefore, the virtual endoscopic image generation unit 142a according to the second embodiment first determines whether or not the viewpoint position set by the operator is inside the lumen. For example, the virtual endoscopic image generation unit 142a determines whether or not the coordinates of the viewpoint position set by the operator are coordinates corresponding to the inside of the lumen extracted by the core line setting unit 141.

  Here, when the coordinates of the viewpoint position set by the operator are not the coordinates corresponding to the inside of the lumen, the virtual endoscopic image generation unit 142a uses the three-dimensional image used for generating the virtual endoscopic image. Invert the brightness of the data. Then, the virtual endoscopic image generation unit 142a further rotates the line-of-sight direction by 180 °, and generates an image projected from the set viewpoint position. Thereby, the virtual endoscopic image generation unit 142a can generate an image capable of observing the lumen from the outside, for example, as illustrated in FIG.

  Next, processing of the ultrasonic diagnostic apparatus 100a according to the second embodiment will be described with reference to FIG. FIG. 11 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus 100a according to the second embodiment. As shown in FIG. 11, in the ultrasonic diagnostic apparatus 100a according to the second embodiment, when the viewpoint position is set outside the lumen (Yes in step S201), the virtual endoscope image generation unit 142a The brightness of the virtual endoscopic image in the fly-through image is inverted (step S202).

  Then, the virtual endoscopic image generation unit 142a rotates the line-of-sight direction by 180 degrees (step S203), and generates an image projected from the set viewpoint position. Thereafter, the control unit 17 displays the image generated by the virtual endoscope image generation unit 142a on the monitor 2 (step S204), and ends the process. When the viewpoint position is inside the lumen (No at Step S201), a virtual endoscope image is generated without performing the above-described processing.

  As described above, according to the second embodiment, the virtual endoscopic image generation unit 142a is configured such that the brightness and the viewpoint position when generating the virtual endoscopic image are arranged outside the lumen. A virtual endoscopic image with the line-of-sight direction reversed is generated. Therefore, the ultrasonic diagnostic apparatus 100a according to the second embodiment can easily grasp the position of the lumen even when the viewpoint position is set outside the lumen, and can improve examination efficiency. to enable.

(Third embodiment)
In the first embodiment described above, a case where an arrow indicating a viewpoint position and a line-of-sight direction when a virtual endoscopic image is generated and a range inside a lumen depicted in a fly-through image are superimposed on a MAP image will be described. did. In the third embodiment, a case where the position of a medical device is superimposed on a MAP image will be described. Note that the ultrasonic diagnostic apparatus according to the third embodiment differs from the ultrasonic diagnostic apparatus 100 according to the first embodiment only in the processing contents of the control unit 17 shown in FIG. Hereinafter, the ultrasonic diagnostic apparatus according to the third embodiment will be described as the ultrasonic diagnostic apparatus 100b, and the control unit will be described as the control unit 17a.

  The control unit 17a superimposes and displays information indicating the position of the medical device inside the lumen on the MAP image. Specifically, the control unit 17a causes the image generation unit 14 to generate an image indicating a medical device included in the volume data in a layer different from the MAP image. Furthermore, the control unit 17a causes the image generation unit 14 to generate an image in which an image indicating a medical device is superimposed on the MAP image. And the control part 17a displays the MAP image on which the image which shows a medical device was superimposed on a predetermined | prescribed display part.

  FIG. 12 is a diagram for explaining an example of control by the control unit 17 according to the third embodiment. In addition, in FIG. 12, it shows about the case where a catheter is used as a medical device. For example, as illustrated in FIG. 12, the control unit 17a extracts the catheter 303 included in the volume data based on the luminance. That is, in the diagnosis using the ultrasonic diagnostic apparatus 100b, since the catheter 303 is depicted with high luminance, the control unit 17a extracts the catheter 303 based on the luminance.

  Then, the control unit 17a controls the image generation unit 14 to generate a medical device image depicting the extracted catheter 303. For example, the control unit 17a causes the lumen image generation unit 143 to generate a medical device image in which the extracted catheter 303 is projected at the viewpoint position and the line-of-sight direction when the MAP image is generated. At this time, as shown in FIG. 12, it is also possible to generate a medical device image in which only the distal end 304 of the catheter is depicted.

  Then, as illustrated in FIG. 12, the control unit 17a generates an image in which the image of the distal end 304 of the catheter 303 is superimposed on the MAP image 22. Thereafter, the control unit 17a causes the monitor 2 to display the MAP image 22 on which the distal end 304 of the catheter 303 is superimposed. Here, in conjunction with the movement of the catheter 303, the control unit 17a causes the monitor 2 to display an image obtained by moving the distal end 304 of the catheter 303 on the MAP image 22.

  In the third embodiment described above, the case where the catheter is displayed superimposed on the MAP image has been described. However, the embodiment is not limited to this, and may be a case where a catheter is superimposed on a fly-through image, for example. 13A and 13B are diagrams illustrating an example of a fly-through image display according to the third embodiment.

  For example, as illustrated in FIG. 13A, the control unit 17a reverses the brightness of the fly-through image 21 and causes the monitor 2 to display an image in which the distal end 304 of the catheter 303 is superimposed on an image depicting the outside of the lumen. It is possible. Further, for example, as illustrated in FIG. 13B, the control unit 17 a can display an image in which the tip 304 of the catheter 303 is superimposed on the fly-through image 21 on the monitor 2. In such a case, the control unit 17a controls the virtual endoscopic image generation unit 142 to generate a medical device image.

  Next, processing of the ultrasonic diagnostic apparatus 100b according to the third embodiment will be described with reference to FIG. FIG. 14 is a flowchart illustrating a processing procedure performed by the ultrasonic diagnostic apparatus according to the third embodiment. As shown in FIG. 14, in the ultrasonic diagnostic apparatus 100b according to the third embodiment, when the medical device display mode is ON (Yes in step S301), the control unit 17a selects a medical device included in the volume data. The rendered medical device image is generated (step S302).

  Then, the control unit 17a generates an image in which the medical device image is superimposed on the MAP image (Step S303). Thereafter, the control unit 17a displays the MAP image on which the medical device is superimposed on the monitor 2 (step S304), and ends the process. If the medical device display mode is OFF, the process of superimposing the medical devices is not executed (No at step S301).

  As described above, according to the third embodiment, the control unit 17a superimposes and displays information indicating the position of the catheter inside the lumen on the MAP image. Therefore, the ultrasonic diagnostic apparatus 100b according to the third embodiment makes it possible to easily display the position of the medical device in the lumen.

(Fourth embodiment)
The first, second, and third embodiments have been described so far, but may be implemented in various different forms other than the first, second, and third embodiments described above.

  In the first to third embodiments described above, the case where the ultrasonic diagnostic apparatus is used as the medical image diagnostic apparatus has been described. However, the embodiment is not limited to this, and for example, an X-ray CT apparatus, an MRI apparatus, an X-ray diagnostic apparatus, or the like may be used as a medical image diagnostic apparatus.

  In the first to third embodiments described above, the case has been described in which an image obtained by projecting the entire lumen on a two-dimensional plane is used as the MAP image. However, the embodiment is not limited to this, and for example, a three-dimensional image obtained by perspective projection of the entire lumen may be used as the MAP image.

  As described above, according to the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment, the medical image diagnostic apparatus, the image processing apparatus, and the program of the present embodiment It is possible to easily grasp the position of the entire lumen corresponding to the fly-through image displayed while moving.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Ultrasonic probe 10 Apparatus main body 14 Image generation part 17 Control part 100, 100a, 100b Ultrasound diagnostic apparatus 141 Core wire setting part 142, 142a Virtual endoscopic image generation part 143 Lumen image generation part

Claims (11)

Virtual endoscopic image generation means for generating a virtual endoscopic image obtained by projecting the inside of a lumen included in the three-dimensional image data from a predetermined viewing direction;
For the entire lumen in which the virtual endoscopic image is generated, the entire lumen is extracted by inverting the luminance inside and outside the lumen, and a predetermined position outside the extracted lumen is viewed A lumen image generating means for generating a lumen image in which an appearance of the lumen from the viewpoint position is depicted,
Display control means for displaying the virtual endoscopic image and the lumen image on a predetermined display unit;
A medical image diagnostic apparatus comprising: The lumen image generation means sets a predetermined position that is perpendicular to the line-of-sight direction and on the same circumference as the viewpoint position when the virtual endoscopic image is generated, from the viewpoint position to the viewpoint position. Generating an image projecting the entire lumen as the lumen image;
The medical image diagnostic apparatus according to claim 1, wherein the display control unit displays the virtual endoscopic image and the lumen image on a predetermined display unit.   3. The display control unit according to claim 1, wherein the display control unit superimposes and displays information indicating a viewpoint position and a line-of-sight direction when the virtual endoscopic image is generated on the lumen image. Medical image diagnostic equipment.   The receiving apparatus according to claim 2, further comprising: an operation for changing a radius of a circle that defines a viewpoint position when generating the lumen image; and an operation for changing the viewpoint position on the circle. 4. The medical image diagnostic apparatus according to 3. The display control means displays on the touch command screen the lumen image on which information indicating a viewpoint position and a line-of-sight direction when the virtual endoscopic image is generated is superimposed,
The medical image diagnosis apparatus according to claim 3, wherein the touch command screen receives an operation for changing a viewpoint position and a line-of-sight direction of the virtual endoscopic image.   6. The display control unit according to claim 1, wherein information indicating a range inside the lumen depicted in the virtual endoscopic image is superimposed and displayed on the lumen image. The medical image diagnostic apparatus described in 1. The lumen image generation means generates a lumen image in which the viewpoint position is changed in conjunction with the change of the viewpoint position when the viewpoint position in the virtual endoscopic image is changed,
The medical image according to any one of claims 1 to 6, wherein the display control unit displays the virtual endoscopic image and the lumen image in a predetermined display unit in conjunction with each other. Diagnostic device.   The virtual endoscopic image generation means generates a virtual endoscopic image in which luminance and line-of-sight direction are reversed when a viewpoint position when generating the virtual endoscopic image is arranged outside the lumen. The medical image diagnostic apparatus according to claim 1, wherein the medical image diagnostic apparatus is a medical image diagnostic apparatus.   The medical image according to any one of claims 1 to 8, wherein the display control unit displays information indicating a position of a medical device inside the lumen so as to be superimposed on the lumen image. Diagnostic device. Virtual endoscopic image generation means for generating a virtual endoscopic image obtained by projecting the inside of a lumen included in the three-dimensional image data from a predetermined viewing direction;
For the entire lumen in which the virtual endoscopic image is generated, the entire lumen is extracted by inverting the luminance inside and outside the lumen, and a predetermined position outside the extracted lumen is viewed A lumen image generating means for generating a lumen image in which an appearance of the lumen from the viewpoint position is depicted,
Display control means for displaying the virtual endoscopic image and the lumen image on a predetermined display unit;
An image processing apparatus comprising: A virtual endoscope image generation procedure for generating a virtual endoscope image obtained by projecting the inside of a lumen included in the three-dimensional image data from a predetermined line-of-sight direction;
For the entire lumen in which the virtual endoscopic image is generated, the entire lumen is extracted by inverting the luminance inside and outside the lumen, and a predetermined position outside the extracted lumen is viewed A lumen image generation procedure for generating a lumen image in which the appearance of the lumen from the viewpoint position is depicted,
A display control procedure for displaying the virtual endoscopic image and the lumen image on a predetermined display unit;
An image processing program for causing a computer to execute.

Images