WO2017030276A1

WO2017030276A1 - Medical image display device and medical image processing method

Info

Publication number: WO2017030276A1
Application number: PCT/KR2016/006087
Authority: WO
Inventors: 남우현; 오지훈; 박용섭; 이재성
Original assignee: 삼성전자(주)
Priority date: 2015-08-17
Filing date: 2016-06-09
Publication date: 2017-02-23

Abstract

The present invention relates to a medical image display device and a medical image processing method. The medical image display device comprises: a display unit for displaying a first medical image obtained by photographing an image of an object including at least one anatomical entity; and at least one processor for extracting reference area information corresponding to the anatomical entity from at least one second medical image which is a reference image of the first medical image, detecting an area corresponding to the anatomical entity from the first medical image on the basis of the extracted reference area information, and controls the display unit such that the detected area of the anatomical entity is displayed to be distinguished from an area which does not correspond to the anatomical entity. Thus, the present invention allows distinctive displaying of an anatomical entity which is not been identified in a non-contrast medical image in the prior art. Therefore, the present invention allows a lymph node tracking test with respect to even a patient on which a contrast medium is difficult to use, allows an early diagnosis of various diseases, and can further improve the accuracy of a diagnosis.

Description

Medical image display device and medical image processing method

The present invention relates to a medical image display apparatus for displaying a screen including a medical image and a medical image processing method thereof.

The medical image display apparatus is a device for acquiring an internal structure of an object as an image. The medical image display device is a non-invasive inspection device, and photographs and processes structural details, internal tissues, and fluid flow in the body and shows them to the user. A user such as a doctor may diagnose a patient's health condition and a disease by using the medical image output from the medical image display apparatus.

Medical image display devices include magnetic resonance imaging (MRI) devices, computed tomography (CT) devices, X-ray (X-ray) devices, and ultrasound to provide magnetic resonance imaging. Device and the like.

Magnetic resonance imaging (MRI) is a device for photographing a subject using a magnetic field, and is widely used for accurate disease diagnosis because it shows bones, disks, joints, nerve ligaments, etc. in three dimensions at a desired angle.

The magnetic resonance imaging apparatus acquires a magnetic resonance (MR) signal by using a high frequency multi-coil including RF coils, a permanent magnet, a gradient coil, and the like. The magnetic resonance image is reconstructed by sampling the magnetic resonance signal (MR signal).

Computed tomography (CT) device can provide a cross-sectional image of the object, and has the advantage that the internal structure of the object (for example, organs, such as kidneys, lungs, etc.) do not overlap, compared to the general X-ray device, the disease Widely used for the precise diagnosis of

The computed tomography apparatus radiates X-rays to the object and detects X-rays passing through the object. Then, the image is restored using the detected X-rays.

The X-ray imaging apparatus images the inside of the object by radiating X-rays to the object and detecting X-rays passing through the object.

The ultrasound apparatus transmits an ultrasound signal to the object and receives an ultrasound signal reflected from the object to form a two-dimensional or three-dimensional ultrasound image of the object of interest in the object.

As described above, the medical images acquired by the various medical image display apparatuses express the object in various ways according to the type and the photographing method of the medical image display apparatus. The doctor reads the medical image to determine whether the patient's illness or health is abnormal. Therefore, it is necessary for a doctor to provide a medical image display device that can facilitate the diagnosis of a doctor so that a medical image suitable for diagnosing a patient can be selected and read.

According to an embodiment of the present invention, a medical image display apparatus includes: a display unit configured to display a first medical image of an object including at least one anatomical object; Extracting reference region information corresponding to the anatomical entity from at least one second medical image that is a reference image of the first medical image, and extracting the region corresponding to the anatomical entity from the first medical image based on the extracted reference region information. At least one processor may be configured to detect and control the display unit to display the detected anatomical region separately from the non-anatomical region. As a result, a division display function for an object that has not been identified in the medical image using information extracted from the reference image is provided.

The processor generates a third medical image including display area information on the anatomical object detected in the first medical image by matching the first medical image with the second medical image, and generates the third medical image based on the display area information. 3 The display unit may be controlled to display an area of the anatomical object detected in the medical image separately from an area that is not an anatomical object. As a result, it is possible to display an individual object by the image generated using medical registration.

There are a plurality of anatomical objects, and the display unit may allow regions of the plurality of anatomical objects to be displayed separately. Thus, it is possible to distinguish the identification of the unidentified objects, thereby providing convenience for diagnosis.

The plurality of anatomical entities may comprise at least one of blood vessels and lymph nodes. As a result, there is an effect in which blood vessels and lymph nodes, which are important clinical judgment factors, are divided and displayed.

The first medical image may be a non-contrast medical image. Thus, it is possible to distinguish and display anatomical objects in non-contrast medical images taken by a subject of concern about side effects of the contrast agent.

The second medical image may be a contrast-enhanced medical image. Thus, the contrast-enhanced medical image, which is easy to distinguish the individual by segmentation, may be used as a reference image.

The second medical image may be a medical image obtained by photographing an object from which the first medical image is acquired at another time point. Thus, the past history of the patient can be utilized for the present diagnosis.

In the display unit, an area of the anatomical object detected by at least one of color, pattern, pointer, highlight, and animation effect may be displayed separately from an area that is not an anatomical object. Thus, various division display functions are provided according to the user's preference.

The division mark of the area of the anatomical object may be activated or deactivated by user selection. Thus, the user selection convenience for the object display function.

The apparatus may further include a user input unit configured to receive a user input, and the processor may control the display unit to adjust the level of the division display of the anatomical object in response to the user input. Thus, it is possible to provide a function corresponding to the taste of the user.

The processor may further detect the lesion extension region in the region of the anatomical entity, and control the display unit so that the lesion extension region detected in the region of the anatomical entity is identifiably displayed. Thus, the information on the progress of the lesion is further provided to provide convenience of the diagnosis of the lesion.

The processor may extract reference region information corresponding to the anatomical object by using brightness values of pixels of the second medical image. As a result, necessary information can be obtained by efficiently utilizing the information of the pre-stored video.

The processor may perform image registration using a predetermined conversion model parameter to maximize the result of the similarity measurement function between the first medical image and the second medical image. Thus, the accuracy of the matched image generated as a result of the image registration process is improved.

The processor may perform image registration using a predetermined conversion model parameter such that a result value of the cost function of the first medical image and the second medical image is minimized. As a result, the possibility of error of the matched image generated as a result of the image matching process is lowered.

The processor may be configured to map a coordinate system between the first medical image and the second medical image, and maintain the image characteristics of the second medical image with respect to the first medical image and the second medical image to which the coordinate system is mapped. Homogeneous matching may be performed. Thus, a registration image is provided in which lymph nodes and blood vessels are separately displayed.

The processor may further perform a heterogeneous registration on the first medical image and the second medical image on which the homogeneous registration has been performed, by modifying the image characteristics of the second medical image to completely match the first medical image. Thus, it is possible to provide the user with quantification and results of lesion expansion in lymph nodes.

On the other hand, the medical image processing method according to an embodiment of the present invention comprises the steps of: displaying a first medical image photographed on an object including at least one anatomical object; Extracting reference region information corresponding to the anatomical object from at least one second medical image that is a reference image of the first medical image; Detecting a region corresponding to the anatomical entity in the first medical image based on the extracted reference region information, and displaying the detected anatomical entity's region separately from the non-anatomical entity. . As a result, a division display function for an object that has not been identified in the medical image using information extracted from the reference image is provided.

And matching the first medical image with the second medical image to generate a third medical image including display area information on the anatomical object detected in the first medical image, and displaying the divided medical images. The region of the anatomical entity detected in the third medical image generated based on the display region information may be displayed separately from the region which is not the anatomical entity. As a result, it is possible to display an individual object by the image generated using medical registration.

The anatomical objects are plural, and the step of displaying the anatomical objects separately may include displaying the areas of the plurality of anatomical objects separately. Thus, it is possible to distinguish the identification of the unidentified objects, thereby providing convenience for diagnosis.

The distinguishing display may be performed by distinguishing the detected anatomical region from the non-anatomical region by at least one of color, pattern, pointer, highlight, and animation effect. Thus, various division display functions are provided according to the user's preference.

The method may further include receiving a user selection of activating or deactivating the division mark of the anatomical object. Thus, the user selection convenience for the object display function.

The method may further include receiving a user input for adjusting a level of the division mark of the anatomical object. Thus, it is possible to provide a function corresponding to the taste of the user.

The method may further include detecting a lesion extension region in the region of the anatomical entity that is displayed separately, and causing the lesion extension region detected in the region of the anatomical entity to be distinguishably displayed. Thus, the information on the progress of the lesion is further provided to provide convenience of the diagnosis of the lesion.

In the extracting of the reference region information, the reference region information corresponding to the anatomical object may be extracted using the brightness values of the pixels of the second medical image. As a result, necessary information can be obtained by efficiently utilizing the information of the pre-stored video.

In the generating of the third medical image, image registration may be performed so that a result value of the similarity measurement function between the first medical image and the second medical image is maximized using a predetermined conversion model parameter. Thus, the accuracy of the matched image generated as a result of the image registration process is improved.

In the generating of the third medical image, image registration may be performed such that a result value of a cost function of the first medical image and the second medical image is minimized using a predetermined conversion model parameter. As a result, the possibility of error of the matched image generated as a result of the image matching process is lowered.

The generating of the third medical image comprises: mapping coordinate systems of the first medical image and the second medical image; The method may include performing homogeneous matching on the first medical image and the second medical image to which the coordinate system is mapped to the first medical image while maintaining the image characteristics of the second medical image. Thus, a registration image is provided in which lymph nodes and blood vessels are separately displayed.

The generating of the third medical image may include performing heterogeneous matching on the first medical image and the second medical image on which the homogeneous registration has been performed, by modifying image characteristics of the second medical image to completely match the first medical image. It may further comprise a step. Thus, it is possible to provide the user with quantification and results of lesion expansion in lymph nodes.

Meanwhile, in a recording medium on which a program for performing a medical image processing method is recorded as a computer-readable program according to an embodiment of the present invention, the medical image processing method may include capturing an object including at least one anatomical object. Displaying a first medical image; Extracting reference region information corresponding to the anatomical object from at least one second medical image that is a reference image of the first medical image; Detecting a region corresponding to the anatomical entity in the first medical image based on the extracted reference region information, and displaying the detected anatomical entity's region separately from the non-anatomical entity. . As a result, a division display function for an object that has not been identified in the medical image using information extracted from the reference image is provided.

In the distinguishing display, the detected anatomical region may be distinguished from the non-anatomical region by at least one of color, pattern, pointer, highlight, and animation effect. Thus, various division display functions are provided according to the user's preference.

According to the embodiment of the present invention, lymph node follow-up is possible even in patients with weak renal function who are burdened to actively use the contrast agent.

In addition, the possibility of misdiagnosis related to non-image based lymph node disease determination can be reduced, thereby improving the diagnosis system (Under / Over-estimation) and improving the accuracy of diagnosis.

In addition, the present embodiment can be applied to non-images for general examination, and is used for early diagnosis of cancer diseases such as cancer metastasis.

1 is a view for explaining a medical image display apparatus according to an embodiment of the present invention,

2 is a view schematically showing an MRI apparatus according to an embodiment of the present invention,

3 is a view showing a CT device according to an embodiment of the present invention,

4 is a view schematically showing the configuration of the CT device of FIG.

FIG. 5 is a diagram schematically illustrating a configuration of a communication unit that performs communication with an external device in a network system.

6 is a diagram illustrating a system including a first medical device, a second medical device, and a medical image registration device according to an embodiment of the present invention.

7 is a diagram conceptually illustrating lymph nodes and blood vessel distribution of a thoracic region.

FIG. 8 is a diagram illustrating contrast-enhanced CT images taken of a chest region.

9 is a diagram illustrating non-contrast CT images taken of a chest region.

10 is a block diagram showing the configuration of a medical image display apparatus according to an embodiment of the present invention.

FIG. 11 is a block diagram illustrating a configuration of an image processor of FIG. 10.

12 is a view showing a first medical image according to an embodiment of the present invention,

13 is a view showing a second medical image according to an embodiment of the present invention,

14 is a diagram illustrating a second medical image from which an object is extracted;

15 is a diagram for explaining an image registration process according to the present embodiment;

16 conceptually illustrates a homogeneous matching process,

17 conceptually illustrates a heterogeneous matching process,

18 is a flowchart illustrating processes of performing a matching process in an embodiment of the present invention.

19 is a view showing a third medical image according to an embodiment of the present invention,

20 is a view showing a fourth medical image,

FIG. 21 is an enlarged view of a portion of an object area in FIG. 20.

FIG. 22 is a diagram illustrating a screen displayed according to driving of an application having a medical diagnosis function in a medical image display apparatus according to an embodiment of the present invention.

23 to 26 illustrate various examples of using image registration for diagnosis in a medical image display apparatus according to an embodiment of the present invention.

27 is a flowchart illustrating a medical image processing method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention is not limited to the embodiments described herein, and may be implemented in various different forms.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

In addition, the term “comprises” or “having” in an embodiment is intended to designate that there exists a feature, number, step, action, component, or combination thereof described on the specification, and one or more other features, numbers It is not intended to exclude the possibility of the presence or addition of steps, actions, components or combinations thereof.

The term "part" as used herein refers to a hardware component such as software, FPGA, or ASIC, and "part" plays a role. However, "part" is not meant to be limited to software or hardware. The “unit” may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a "part" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. The functionality provided within the components and "parts" may be combined into a smaller number of components and "parts" or further separated into additional components and "parts".

As used herein, "image" refers to multi-dimensional data consisting of discrete image elements (e.g., pixels in a two-dimensional image and voxels in a three-dimensional image). For example, the image may include a medical image of an object acquired by X-ray, CT, MRI, ultrasound, and other medical imaging systems.

Also, as used herein, an "object" may include a person or an animal, or a part of a person or an animal. For example, the subject may include organs such as the liver, heart, uterus, brain, breast, abdomen, or blood vessels. Also, the "object" may include a phantom. Phantom means a material having a volume very close to the density and effective atomic number of an organism, and may include a sphere phantom having properties similar to the body.

In addition, in the present specification, the "user" may be a doctor, a nurse, a clinical pathologist, a medical imaging expert, or the like, and may be a technician who repairs a medical device, but is not limited thereto.

Hereinafter, in order to clearly describe the present invention with reference to the drawings, parts not directly related to the configuration of the present invention may be omitted, and like reference numerals refer to the same or similar elements throughout the specification. Shall be.

1 is a view for explaining a medical image display apparatus 100 according to an embodiment of the present invention.

According to an embodiment of the present invention, the medical image display apparatus 100 may be a device for obtaining a medical image and displaying the medical image on the screen. For example, as shown in FIG. 1, the medical image display apparatus 100 includes a magnetic resonance imaging apparatus (hereinafter referred to as an MRI apparatus) 101 and a computed tomography apparatus (hereinafter referred to as a CT apparatus) 102. , X-ray (hereinafter referred to as X-ray or X-ray) imaging device (not shown), angiography device (not shown), ultrasonic device 103, etc. It is not limited to this.

The MRI apparatus 101 is an apparatus that obtains an image of a tomography region of an object by expressing intensity of a magnetic resonance (MR) signal with respect to a radio frequency (RF) signal generated in a magnetic field of a specific intensity in contrast.

Since the CT device 102 may provide a cross-sectional image of the object, the CT device 102 may express the internal structure of the object (for example, an organ such as a kidney or a lung) without overlapping as compared to a general X-ray imaging apparatus. For example, the CT device 102 may provide a relatively accurate cross-sectional image of an object by acquiring and processing an image having a thickness of 2 mm or less at several tens or hundreds per second.

The X-ray imaging apparatus refers to a device that transmits X-rays through a human body to image an internal structure of the human body. Angiography apparatus is a device that allows the blood vessels (arteries and veins) of a subject to be injected with a contrast agent through a 2 mm thin tube called a catheter through X-rays.

The ultrasound apparatus 103 transmits an ultrasound signal from a body surface of the object toward a predetermined part of the body, and uses the information of an ultrasound signal (hereinafter, also referred to as an ultrasound echo signal) reflected from tissues of the body to detect a monolayer of soft tissue, Means a device for obtaining an image of blood flow.

According to an embodiment of the present invention, the medical image display apparatus 100 may be implemented in various forms. For example, the medical image display apparatus 100 described herein may be implemented in the form of a mobile terminal as well as a fixed terminal. An example of a mobile terminal may be a smartphone, a smart pad, a tablet PC, a laptop computer, a PDA, and the like.

According to an embodiment of the present invention, the medical image display apparatus 100 may exchange medical image data with a hospital server connected to a medical image information system (PACS) or another medical apparatus in the hospital. have. In addition, the medical image display apparatus 100 may perform data communication with a server or the like according to a digital imaging and communications in medicine (DICOM) standard.

According to an embodiment of the present invention, the medical image display apparatus 100 may include a touch screen. The touch screen may be configured to detect not only the touch input position and the touched area but also the touch input pressure. In addition, the touch screen may be configured to detect proximity touch as well as real-touch.

In this specification, a real touch is a touch pen (eg, a pointing device, a stylus, a haptic pen) that is actually provided on the screen as a user's body (eg, a finger) or a touch tool. , An electronic pen, etc.) is touched, and proximity-touch refers to a case in which the user's body or a touch tool does not actually touch the screen but approaches a predetermined distance from the screen (for example, Detectable spacing refers to hovering of 30 mm or less.

The touch screen may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

According to an embodiment of the present invention, the medical image display apparatus 100 may detect a gesture input as a user's teach input to the medical image through the touch screen.

The touch input of a user described herein includes a tap, a click that touches harder than a tap, a touch and hold, a double tap, a double click, and a touch. Drag, drag and drop, slide, flicking, panning, swipe, pinch, etc. Includes all of them. Input such as drag, slide, flicking, swipe, etc. may consist of a press on which the finger (or touch pen) touches the touch screen, a movement of a certain distance, and a release from the touch screen. Includes all curve-shaped movements. The various touch inputs are included in the gesture input.

According to an embodiment of the present invention, the medical image display apparatus 100 may provide some or all of the buttons for controlling the medical image in the form of a graphical user interface (GUI).

2 is a diagram schematically showing an MRI apparatus 101 according to an embodiment of the present invention.

In the present embodiment, a magnetic resonance image (MRI) refers to an image of an object acquired using the nuclear magnetic resonance principle.

The MRI apparatus 101 is an apparatus that obtains an image of a tomography region of an object by expressing the intensity of a magnetic resonance (MR) signal with respect to a radio frequency (RF) signal generated in a magnetic field of a specific intensity in contrast. For example, if a subject is placed in a strong magnetic field and then irradiates the subject with an RF signal that resonates only a particular nucleus (eg, a hydrogen nucleus, etc.), the MR signal is emitted from the particular nucleus. 101 may obtain the MR image by receiving the MR signal. The MR signal refers to an RF signal radiated from the object. The magnitude of the MR signal may be determined by the concentration of a predetermined atom (eg, hydrogen, etc.) included in the subject, a relaxation time T1, a relaxation time T2, and a flow of blood flow.

The MRI apparatus 101 includes different features from other imaging apparatuses. Unlike imaging devices such as CT where the acquisition of the image depends on the direction of the detection hardware, the MRI device 101 may acquire a 2D image or a 3D volume image directed to an arbitrary point. In addition, unlike CT, X-ray, PET, and SPECT, the MRI apparatus 101 does not expose radiation to the subject and the inspector, and may acquire an image having high soft tissue contrast, thereby causing abnormality. Neuralological images, intravascular images, musculoskeletal images, oncologic images, etc., in which a clear description of tissue is important can be obtained.

As shown in FIG. 1, the MRI apparatus 101 according to the present embodiment includes a gantry 220, a signal transceiver 230, a monitor 240, a system controller 250, and an operating unit 260. It may include.

The gantry 220 blocks electromagnetic waves generated by the main magnet 222, the gradient coil 224, the RF coil 226, and the like from radiating to the outside. A static magnetic field and a gradient magnetic field are formed in the bore in the gantry 220, and an RF signal is irradiated toward the object 210.

The main magnet 222, the gradient coil 224 and the RF coil 226 may be disposed along a predetermined direction of the gantry 220. The predetermined direction may include a coaxial cylindrical direction or the like. The object 210 may be positioned on a table 228 that can be inserted into the cylinder along the horizontal axis of the cylinder.

The main magnet 222 generates a static magnetic field or a static magnetic field for aligning the directions of the magnetic dipole moments of the nuclei included in the object 210 in a predetermined direction. As the magnetic field generated by the main magnet is stronger and more uniform, a relatively precise and accurate MR image of the object 210 may be obtained.

The gradient coil 224 includes X, Y, and Z coils that generate gradient magnetic fields in the X-, Y-, and Z-axis directions that are perpendicular to each other. The gradient coil 224 may induce resonance frequencies differently for each part of the object 210 to provide location information of each part of the object 210.

The RF coil 226 may radiate an RF signal to the patient and receive an MR signal emitted from the patient. In detail, the RF coil 226 transmits an RF signal having a frequency equal to the frequency of the precession toward the atomic nucleus during precession to the patient, stops transmitting the RF signal, and receives the MR signal emitted from the patient. Can be.

For example, the RF coil 226 generates an electromagnetic signal, for example, an RF signal having a radio frequency corresponding to the type of the nuclear nucleus, such as an RF signal, in order to transition a nuclear nucleus from a low energy state to a high energy state. 210 may be applied. When an electromagnetic signal generated by the RF coil 226 is applied to a certain nucleus, the nucleus can transition from a low energy state to a high energy state. Thereafter, when the electromagnetic wave generated by the RF coil 226 disappears, the atomic nucleus to which the electromagnetic wave is applied may radiate an electromagnetic wave having a Lamor frequency while transitioning from a high energy state to a low energy state. In other words, when the application of the electromagnetic wave signal to the atomic nucleus is stopped, in the atomic nucleus to which the electromagnetic wave is applied, a change in the energy level from a high energy to a low energy may occur and an electromagnetic wave having a lamore frequency may be emitted. The RF coil 226 may receive an electromagnetic wave signal radiated from atomic nuclei inside the object 210.

The RF coil 226 may be implemented as one RF transmission / reception coil having a function of generating an electromagnetic wave having a radio frequency corresponding to the type of the atomic nucleus and a function of receiving the electromagnetic wave radiated from the atomic nucleus. Further, it may be implemented as a transmitting RF coil having a function of generating an electromagnetic wave having a radio frequency corresponding to the type of atomic nucleus and a receiving RF coil having a function of receiving electromagnetic waves radiated from the atomic nucleus.

In addition, the RF coil 226 may be a form fixed to the gantry 220, it may be a removable form. The detachable RF coil 226 may include RF coils for portions of the object, including head RF coils, chest RF coils, leg RF coils, neck RF coils, shoulder RF coils, wrist RF coils and ankle RF coils, and the like. have.

In addition, the RF coil 226 may communicate with an external device in a wired and / or wireless manner, and may also perform dual tune communication according to a communication frequency band.

In addition, the RF coil 226 may include a cage coil, a surface coil, and a transverse electromagnetic coil (TEM coil) according to the structure of the coil.

In addition, the RF coil 226 may include a transmission-only coil, a reception-only coil, and a transmission / reception combined coil according to an RF signal transmission / reception method.

In addition, the RF coil 226 may include RF coils of various channels, such as 16 channels, 32 channels, 72 channels, and 144 channels.

Hereinafter, a case where the RF coil 226 is a radio frequency multi coil including N coils corresponding to the first to Nth channels, which are the plurality of channels, will be described as an example. Here, the high frequency multi-coil may be referred to as a multichannel RF coil.

The gantry 220 may further include a display 229 positioned outside the gantry 220 and a display (not shown) positioned inside the gantry 220. Predetermined information may be provided to a user or an object through a display positioned inside and / or outside the gantry 220.

The signal transceiver 230 may control the gradient magnetic field formed in the gantry 220, that is, the bore according to a predetermined MR sequence, and may control the transmission and reception of the RF signal and the MR signal.

The signal transceiver 230 may include a gradient magnetic field amplifier 232, a transceiver switch 234, an RF transmitter 236, and an RF data acquirer 238.

The gradient amplifier 232 drives the gradient coil 224 included in the gantry 220, and outputs a pulse signal for generating the gradient magnetic field under the control of the gradient magnetic field controller 254. Can be supplied to By controlling the pulse signal supplied from the gradient amplifier 232 to the gradient coil 224, gradient magnetic fields in the X-axis, Y-axis, and Z-axis directions can be synthesized.

The RF transmitter 236 and the RF data acquirer 238 may drive the RF coil 226. The RF transmitter 236 may supply an RF pulse of a Larmor frequency to the RF coil 226, and the RF data acquirer 238 may receive an MR signal received by the RF coil 226.

The transmission / reception switch 234 may adjust the transmission and reception directions of the RF signal and the MR signal. For example, the RF signal may be irradiated to the object 210 through the RF coil 226 during the transmission mode, and the MR signal may be received from the object 210 through the RF coil 226 during the reception mode. . The transmission / reception switch 234 may be controlled by a control signal from the RF control unit 256.

The monitoring unit 240 may monitor or control the gantry 220 or the devices mounted on the gantry 220. The monitoring unit 240 may include a system monitoring unit 242, an object monitoring unit 244, a table control unit 246, and a display control unit 248.

The system monitoring unit 242 may include a state of a static magnetic field, a state of a gradient magnetic field, a state of an RF signal, a state of an RF coil, a state of a table, a state of a device measuring body information of an object, a state of a power supply, a state of a heat exchanger, It can monitor and control the condition of the compressor.

The object monitoring unit 244 monitors the state of the object 210. In detail, the object monitoring unit 244 may include a camera for observing the movement or position of the object 210, a respiration meter for measuring the respiration of the object 210, an ECG meter for measuring the electrocardiogram of the object 210, Or it may include a body temperature meter for measuring the body temperature of the object 210.

The table controller 246 controls the movement of the table 228 in which the object 210 is located. The table controller 246 may control the movement of the table 228 according to the sequence control of the sequence controller 252. For example, in moving imaging of an object, the table controller 246 may continuously or intermittently move the table 228 according to the sequence control by the sequence controller 252. The object may be photographed with an FOV larger than the field of view (FOV) of the gantry.

The display controller 248 controls the display 229 positioned outside and / or inside the gantry 220. In detail, the display controller 248 may control on / off of the display 229 located at the outside and / or the inside of the gantry 220 or a screen to be output to the display 229. In addition, when the speaker is located inside or outside the gantry 220, the display controller 248 may control the on / off of the speaker or the sound to be output through the speaker.

The system controller 250 includes a sequence controller 252 for controlling a sequence of signals formed in the gantry 220, and a gantry controller 258 for controlling the gantry 220 and the devices mounted on the gantry 220. can do.

The sequence controller 252 controls the gradient magnetic field controller 254 for controlling the gradient magnetic field amplifier 232, and the RF controller 256 for controlling the RF transmitter 236, the RF data acquisition unit 238, and the transmission / reception switch 234. It may include. The sequence controller 252 may control the gradient magnetic field amplifier 232, the RF transmitter 236, the RF data acquirer 238, and the transmit / receive switch 234 according to the pulse sequence received from the operating unit 260.

Here, the pulse sequence means a continuation of a signal repeatedly applied by the MRI apparatus 101. The pulse sequence may include a time parameter of the RF pulse, for example, a repetition time (TR), an echo time (Time to Echo, TE), and the like.

In this embodiment, the pulse sequence includes all the information necessary for controlling the gradient magnetic field amplifier 232, the RF transmitter 236, the RF data acquisition unit 238, and the transmit / receive switch 234, for example, the gradient coil. Information on the intensity of the pulse signal applied to the 224, the application time, the application timing (timing), and the like may be included.

The operating unit 260 may command pulse sequence information to the system control unit 250 and control the operation of the entire MRI apparatus 101.

The operating unit 260 may include an image processor 262, an output unit 264, and a user interface 266 that process an MR signal received from the RF data acquirer 238.

The image processor 262 may generate MR image data of the object 210 by processing the MR signal received from the RF data acquirer 238.

The image processor 262 applies various signal processing such as amplification, frequency conversion, phase detection, low frequency amplification, filtering, etc. to the MR signal received by the RF data acquisition unit 238.

The image processor 262 may, for example, arrange digital data in k-space of the memory, and reconstruct the data into image data by performing two-dimensional or three-dimensional Fourier transform.

In addition, the image processing unit 262 may also perform composition processing, difference calculation processing, and the like of the image data. The composition process may include an addition process for pixels, a maximum projection (MIP) process, and the like. In addition, the image processing unit 262 may store not only the image data to be reconstructed but also image data subjected to the synthesis process or the difference calculation process to a memory (not shown) or an external server.

In addition, various signal processings applied to the MR signal by the image processor 262 may be performed in parallel. For example, signal processing may be applied in parallel to a plurality of MR signals received by the multi-channel RF coil to reconstruct the plurality of MR signals into image data.

The output unit 264 may output the image data or the reconstructed image data generated by the image processor 262 to the user. In addition, the output unit 264 may output information necessary for the user to operate the MRI system, such as a user interface (UI), user information, or object information.

The output unit 264 may include a speaker, a printer, a display, and the like. The implementation manner of the display is not limited, for example, liquid crystal, plasma, light-emitting diode, organic light-emitting diode, surface-conduction electron- It can be implemented by various display methods such as emitters, carbon nano-tubes, and nano-crystals. In addition, the display may be implemented to display an image in a 3D form, and in some cases, may be implemented as a transparent display.

In this embodiment, the output unit 264 may include various output devices within a range apparent to those skilled in the art.

The user may input object information, parameter information, scan conditions, pulse sequences, information on image composition or difference calculation, etc. using the user input unit 266. The user input unit 266 may include a keyboard, a mouse, a trackball, a voice recognizer, a gesture recognizer, a touch pad, and the like, and may include various input devices within a range apparent to those skilled in the art.

Although FIG. 2 illustrates the signal transceiver 230, the monitor 240, the system controller 250, and the operating unit 260 as separate objects, the signal transceiver 230, the monitor 240, and the system are shown. It will be understood by those skilled in the art that the functions performed by each of the controller 250 and the operating unit 260 may be performed in other objects. For example, the image processing unit 262 described above converts the MR signal received by the RF data acquisition unit 238 into a digital signal, but the conversion to the digital signal is performed by the RF data acquisition unit 238 or the RF coil ( 226 may be performed directly.

The gantry 220, the RF coil 226, the signal transmitting and receiving unit 230, the monitoring unit 240, the system control unit 250, and the operating unit 260 may be connected to each other wirelessly or by wire. A device (not shown) for synchronizing clocks with each other may be further included. Communication between the gantry 220, the RF coil 226, the signal transmitting and receiving unit 230, the monitoring unit 240, the system control unit 250, and the operating unit 260 is performed at a high speed such as low voltage differential signaling (LVDS). Digital interface, asynchronous serial communication such as universal asynchronous receiver transmitter (UART), low delay type network protocol such as error synchronization serial communication or controller area network (CAN), optical communication, etc. can be used, and it will be apparent to those skilled in the art. Various communication methods may be used.

3 is a view showing a CT device 102 according to an embodiment of the present invention, Figure 4 is a schematic view showing the configuration of the CT device 102 of FIG.

As shown in FIG. 3, the CT device 102 may include a gantry 302, a table 305, an X-ray generator 306, and an X-ray detector 308.

A tomography device, such as the CT device 102, may provide a cross-sectional image of an object, so that the internal structure of the object (for example, an organ such as a kidney or a lung, etc.) does not overlap with a general X-ray imaging device. There is an advantage.

The tomography apparatus may include all tomography apparatuses such as a computed tomography (CT) device, an optical coherenc tomography (OCT) device, or a positron emission tomography (PET) -CT device.

In the present embodiment, a tomography image is an image obtained by tomography imaging an object in a tomography apparatus. The tomography image may refer to an image that is imaged by using projected data after irradiating a light ray such as an X-ray to the object. In detail, the CT image may refer to a composite image of a plurality of X-ray images obtained by photographing an object while rotating about at least one axis of the object.

Hereinafter, the CT apparatus 102 illustrated in FIGS. 2 and 3 will be described as an example of the tomography apparatus 300.

For example, the CT device 102 may provide a relatively accurate cross-sectional image of an object by acquiring and processing image data having a thickness of 2 mm or less tens or hundreds per second. Conventionally, there has been a problem that only the horizontal cross section of the object is expressed, but it is overcome by the appearance of various image reconstruction techniques as follows. Three-dimensional reconstruction imaging techniques are as follows.

SSD (Shade surface display): A technique for displaying only voxels having a certain HU value as an initial three-dimensional imaging technique.

Maximum intensity projection (MIP) / minimum intensity projection (MinIP): A 3D technique showing only those having the highest or lowest HU value among the voxels constituting the image.

VR (volume rendering): A technique that can adjust the color and transmittance of the voxels constituting the image for each region of interest.

Virtual endoscopy: A technique that allows endoscopic observation in three-dimensional images reconstructed by the VR or SSD technique.

MPR (multi planar reformation): An image technique for reconstructing different cross-sectional images. It is possible to reconstruct freedom in the direction desired by the user.

Editing: Various techniques for arranging surrounding voxels to make it easier to observe the point of interest in VR.

VOI (voxel of interest): A technique for representing only a selected area in VR.

Computed tomography (CT) device 102 according to an embodiment of the present invention can be described with reference to FIGS. 3 and 4. CT device 102 according to an embodiment of the present invention may include various types of devices as shown in FIG.

The gantry 302 may include an X-ray generator 306 and an X-ray detector 308.

The object 30 may be located on the table 305.

The table 305 may move in a predetermined direction (eg, at least one of up, down, left, and right) during the CT imaging process. In addition, the table 305 may be tilted or rotated by a predetermined angle in a predetermined direction.

In addition, the gantry 302 may be tilted by a predetermined angle in a predetermined direction.

As shown in FIG. 4, the CT device 102 according to an embodiment of the present invention may include a gantry 302, a table 305, a controller 318, a storage 324, an image processor 326, and a user. The input unit 328 may include a display unit 330 and a communication unit 332.

As described above, the object 310 may be located on the table 305. Table 305 according to an embodiment of the present invention can be moved in a predetermined direction (eg, at least one of up, down, left, right), the movement can be controlled by the controller 318.

The gantry 302 according to an embodiment of the present invention includes a rotating frame 304, an X-ray generator 306, an X-ray detector 308, a rotation driver 310, a data acquisition circuit 316, and a data transmitter 320. It may include.

The gantry 302 according to an embodiment of the present invention may include a rotatable frame 304 that is rotatable based on a predetermined rotation axis (RA). The rotating frame 304 may also be in the form of a disc.

The rotation frame 304 may include an X-ray generator 306 and an X-ray detector 308 disposed to face each other to have a predetermined field of view (FOV). The rotating frame 304 may also include an anti-scatter grid 314. The scattering prevention grid 314 may be located between the X-ray generator 306 and the X-ray detector 308.

In medical image displays, the X-ray radiation that reaches the detector (or photosensitive film) includes scattered radiation that degrades the quality of the image as well as attenuated primary radiation that forms a useful image. Etc. are included. An anti-scattering grid can be placed between the patient and the detector (or photosensitive film) in order to transmit most of the main radiation and attenuate the scattered radiation.

For example, anti-scatter grids include strips of lead foil, solid polymer materials or solid polymers and fiber composite materials. It may be configured in the form of alternately stacked space filling material (interspace material) of. However, the shape of the anti-scattering grid is not necessarily limited thereto.

The rotation frame 304 may rotate the X-ray generator 306 and the X-ray detector 308 at a predetermined rotation speed based on the driving signal received from the rotation driver 310. The rotation frame 304 may receive a driving signal and power from the rotation driver 310 in a contact manner through a slip ring (not shown). In addition, the rotation frame 304 may receive a drive signal and power from the rotation driver 310 through wireless communication.

The X-ray generator 306 generates an X-ray by receiving a voltage and a current through a high voltage generator (not shown) through a slip ring (not shown) in a power distribution unit (PDU) (not shown). Can be released. When the high voltage generator applies a predetermined voltage (hereinafter referred to as a tube voltage), the X-ray generator 306 may generate X-rays having a plurality of energy spectra corresponding to the predetermined tube voltage. have.

The X-rays generated by the X-ray generator 306 may be emitted in a predetermined form by the collimator 112.

The X-ray detector 308 may be positioned to face the X-ray generator 306. The X-ray detector 308 may include a plurality of X-ray detection elements. The single X-ray detection element may form a single channel, but is not necessarily limited thereto.

The X-ray detector 308 may detect the X-rays generated by the X-ray generator 306 and transmitted through the object 30 and generate an electric signal corresponding to the intensity of the detected X-rays.

The X-ray detector 308 may include an indirect method of converting radiation into light and a direct method detector for converting and detecting radiation into direct charge. The indirect X-ray detector may use a scintillator. In addition, the direct type X-ray detector may use a photon counting detector. The data acquisitino system (DAS) 316 may be connected to the X-ray detector 308. The electrical signal generated by the X-ray detector 308 may be collected by the DAS 316. The electrical signal generated by the X-ray detector 308 may be collected by the DAS 316 by wire or wirelessly. In addition, the electrical signal generated by the X-ray detector 308 may be provided to an analog / digital converter (not shown) through an amplifier (not shown).

Only some data collected from the X-ray detector 308 may be provided to the image processor 326 according to the slice thickness or the number of slices, or only some data may be selected by the image processor 326.

The digital signal may be provided to the image processor 326 through the data transmitter 320. The digital signal may be transmitted to the image processor 326 by wire or wirelessly through the data transmitter 320.

The control unit 318 of the CT device 102 according to an embodiment of the present invention may control the operation of each module in the CT device 102. For example, the controller 318 may include a table 305, a rotation driver 310, a collimator 312, a DAS 316, a storage 324, an image processor 326, a user input unit 328, and a display unit. 330 and the communication unit 332 may be controlled.

The image processor 326 may receive data (for example, pure data before processing) from the DAS 316 through the data transmitter 320 to perform a pre-processing process.

The preprocessing may include, for example, a process of correcting the sensitivity nonuniformity between the channels, a sharp reduction in signal strength, or a process of correcting the loss of a signal due to an X-ray absorber such as metal.

The output data of the image processor 326 may be referred to as raw data or projection data. Such projection data may be stored in the storage unit 324 together with photographing conditions (eg, tube voltage, photographing angle, etc.) at the time of data acquisition.

The projection data may be a set of data values corresponding to the intensity of X-rays passing through the object. For convenience of description, a set of projection data acquired simultaneously at the same photographing angle for all channels is referred to as a projection data set.

The storage unit 324 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (SD, XD memory, etc.), RAM ; Random Access Memory (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk, optical disk It may include at least one type of storage medium.

In addition, the image processor 326 may reconstruct a cross-sectional image of the object by using the obtained projection data set. The cross-sectional image may be a 3D image. In other words, the image processor 326 may generate a 3D image of the object by using a cone beam reconstruction method or the like based on the obtained projection data set.

External input for X-ray tomography conditions, image processing conditions, etc. may be received through the user input unit 328. For example, X-ray tomography conditions may include a plurality of tube voltages, energy values of a plurality of X-rays, imaging protocol selection, image reconstruction method selection, FOV region setting, number of slices, slice thickness, post-image Processing parameter settings, and the like. Also, the image processing condition may include a resolution of an image, attenuation coefficient setting for the image, a combination ratio setting of the image, and the like.

The user input unit 328 may include a device for receiving a predetermined input from the outside. For example, the user input unit 328 may include a microphone, a keyboard, a mouse, a joystick, a touch pad, a touch pen, a voice, a gesture recognition device, and the like.

The display 330 may display the X-ray photographed image reconstructed by the image processor 326.

The transmission and reception of data, power, and the like between the above-described elements may be performed using at least one of wired, wireless, and optical communication.

The communication unit 332 may communicate with an external device, an external medical device, or the like through the server 334.

FIG. 5 is a diagram schematically illustrating a configuration of a communication unit 532 that communicates with the outside in a network system.

The communication unit 532 illustrated in FIG. 5 is also connected to at least one of the gantry 220, the signal transceiver 230, the monitoring unit 240, the system controller 250, and the operating unit 260 illustrated in FIG. 2. It is possible. That is, the communication unit 532 may exchange data with a hospital server or another medical device in a hospital connected through a PACS (Picture Archiving and Communication System), and may use digital digital imaging and communication (DICOM, Digital Imaging and Communication System). Communications in Medicine) can communicate data.

As shown in FIG. 5, the communication unit 532 is connected to the network 501 by wire or wirelessly to connect with an external server 534, an external medical device 536, or an external device 538 such as a portable device. Communication can be performed.

In detail, the communication unit 532 may transmit and receive data related to diagnosis of the object through the network 501, and may also transmit and receive medical images photographed by another medical device 536 such as CT, ultrasound, and X-ray.

In one embodiment of the present invention, the communication unit 532 shown in FIG. 5 may be included in the CT device 102 of FIG. 4. In this case, the communication unit 532 shown in FIG. 4 is the same as the communication unit 332 shown in FIG. The other medical device 536 may be, for example, the MRI device 101 or the ultrasound device 103 of FIG. 1.

In addition, the communication unit 532 illustrated in FIG. 5 may be included in the MRI apparatus 101 of FIG. 2. In this case, the MRI apparatus 101 shown in FIG. 2 may be implemented in a form further including the communication unit 532 of FIG. 5. The other medical device 536 may be, for example, the CT device 102 or the ultrasound device 103 of FIG. 1.

Specific operations of the communication unit 532 are as follows.

The communication unit 532 may be connected to the network 501 by wire or wirelessly to perform communication with the server 534, the external medical device 536, or the external device 538. The communication unit 532 may exchange data with a hospital server or another medical device in the hospital connected through a PACS (Picture Archiving and Communication System).

In addition, the communication unit 532 may perform data communication with an external device 538 or the like according to a digital imaging and communications in medicine (DICOM) standard.

The communication unit 532 may transmit / receive an image of the object and / or data related to the diagnosis of the object through the network 501. The communication unit 532 may receive a medical image acquired from another medical device 536 such as an MRI apparatus 101 and an X-ray imaging apparatus.

In addition, the communication unit 532 may receive a diagnosis history or treatment schedule of the patient from the server 534 and use it for clinical diagnosis of the patient. In addition, the communication unit 532 may perform data communication with not only a server 534 or a medical device 536 in a hospital, but also a portable device (terminal device) 538 of a user or a patient.

In addition, it is possible to send the equipment abnormality and quality control status information to the system administrator or service personnel through the network and receive feedback about it.

As described above, the medical images acquired by the various medical image display apparatuses express the object in various ways according to the type and the photographing method of the medical image display apparatus. In addition, characteristics of the acquired medical image may vary according to a photographing method and a type of the medical image display apparatus. For example, in one medical image, cancer tissue may be easily identified, and in another medical image, blood vessels may be easily identified.

Accordingly, there is a need to provide an apparatus for providing a medical image that is suitable for a user's intention in consideration of a reading part of an image.

Hereinafter, with reference to the accompanying drawings, a medical image display device according to one or another embodiment of the present invention that can provide a medical image for facilitating a diagnosis of a user with respect to a predetermined region in a medical image.

The medical image display apparatus according to an embodiment of the present invention may be any image processing apparatus capable of displaying, storing, and / or processing a medical image.

In detail, the medical image display apparatus 100 according to an embodiment of the present invention may be provided to be included in a tomography apparatus such as the MRI apparatus 101 or the CT apparatus 102 described with reference to FIGS. 2 to 4. have. In this case, the medical image display apparatus 100 may include the communication unit 532 described with reference to FIG. 5.

In addition, the medical image display apparatus 100 according to an embodiment of the present invention may include at least one of a tomography apparatus such as the MRI apparatus 101 and the CT apparatus 102 described above with reference to FIGS. It may be included in the server 534, the medical device 536, or an external device that is connected through the 501, that is, the portable terminal 538. The server 534, the medical device 536, or the portable terminal 538 may be an image processing device capable of displaying, storing, or processing at least one of an MRI image and a tomography image. For example, the medical image display apparatus according to an embodiment of the present invention may have a form of a server 534, a medical device 536, or a portable terminal 538, and at least one of an MRI image and a tomography image. It may be a PACS (Picture Archiving and Communication System) that can display, store, or process the data.

In addition, the medical image display apparatus 100 according to an embodiment of the present invention may be configured to process / restore an image using data acquired by scanning an object, in addition to the MRI apparatus 101 or the CT apparatus 102. It may be included in the medical imaging device / system, or may be provided in connection with all medical imaging devices / systems.

According to an embodiment of the present invention, the medical image display apparatus 100 obtains the first medical image and the second medical image from two or more different medical devices, for example, the first medical device and the second medical device. It may be implemented as a medical image registration device for displaying an image (third medical image) matching the first medical image and the second medical image.

FIG. 6 is a diagram illustrating a system including a first medical device 610, a second medical device 620, and a medical image registration device 630 according to an exemplary embodiment.

The first medical device 610 and the second medical device 620 generate the first medical image and the second medical image, respectively, and provide them to the medical image matching device 630. The first medical image and the second medical image may be images generated by the same principle.

In addition, the first medical image and the second medical image may have different image modalities. That is, the first medical image and the second medical image may have different generation methods and principles.

The medical image matching device 630 acquires the first medical image and the second medical image, respectively, and matches the first medical image and the second medical image. The image matched by the medical image matching device 630 is displayed on the display unit 632.

In the embodiment of the present invention illustrated in FIG. 6, the first medical device 610, the second medical device 620, and the medical image registration device 630 each constitute independent devices. The medical device 610 and the medical image registration device 630 may be implemented as a single device, or the second medical device 620 and the medical image registration device 630 may be implemented as a single device. In addition, although the medical image matching device 630 includes the main body 631 and the display unit 632, a separate display device for receiving and displaying image data from the medical image matching device 630 is included in the system. It may be implemented.

That is, the medical image registration device 630 of the present embodiment is a computer system that is capable of communicating with at least one medical device and is included in another medical device having a display, or is capable of communicating with two or more medical devices. It may be implemented in a computer system that includes.

In an embodiment, the first medical device 610 may provide the first medical image in real time with respect to the volume of interest of the object. For example, when deformation and displacement of an organ due to physical activity of the subject occur, a change appears in the first medical image in real time.

That is, according to the exemplary embodiment of the present invention illustrated in FIG. 6, the first medical device 620 is an ultrasonography machine (103 of FIG. 1) that generates an image in real time during an interventional medical procedure for a patient. It can be configured as. For example, when deformation and displacement of an organ due to physical activity of an object occur, a change is indicated in a medical image displayed on a display in real time. However, the first medical device 620 may be another medical device such as an OCT that provides an image in real time.

The first medical device 610 configured as an ultrasound device generates an ultrasound image by radiating an ultrasound signal to a region of interest of an object using a probe 611 and detecting a reflected ultrasound signal, that is, an ultrasound echo signal. .

The probe 611 is a part in contact with the object and may include a plurality of transducer elements (hereinafter, referred to as transducers) (not shown) and a light source (not shown). When ultrasound in the range of several hundreds to hundreds of MHz from the probe 611 is delivered to a specific area within the patient's body, the ultrasound is partially reflected from the layers between the different tissues. Ultrasound is reflected in anatomical entities with density changes inside the body, such as blood cells in blood plasma, small structures in organs, and the like.

The transducer may be, for example, a magnetostrictive ultrasonic transducer using a magnetostrictive effect of a magnetic body, a piezoelectric ultrasonic transducer 118 using a piezoelectric effect of a piezoelectric material, hundreds of microfabricated or Various kinds of ultrasonic transducers, such as capacitive micromachined ultrasonic transducers (cMUTs), which transmit and receive ultrasonic waves using thousands of thin film vibrations, may be used.

The plurality of conversion elements may be arranged in a straight line (Linear array), or may be arranged in a curve (Convex array). A cover for covering the plurality of conversion elements may be provided on the change element.

The light source is for irradiating light into the object. For example, at least one light source for generating light having a specific wavelength may be used as the light source. As another example, a plurality of light sources for generating light having different wavelengths may be used as the light source. The wavelength of light generated by the light source may be selected in consideration of a target in the object. Such a light source may be implemented by a semiconductor laser (LD), a light emitting diode (LED), a solid state laser, a gas laser, an optical fiber, or a combination thereof.

The transducer provided in the probe 611 generates an ultrasonic signal according to the control signal, and irradiates the generated ultrasonic signal into the object. The ultrasound echo signal reflected from a specific tissue (eg, a lesion) in the object is received, that is, detected.

The reflected ultrasonic waves vibrate the transducer of the probe 611, and the transducer outputs electrical pulses according to the vibrations. Such electrical pulses are converted into an image. When the anatomical objects have different ultrasonic reflection characteristics from each other, for example, in an ultrasound image of a B mode (brightness mode), each anatomical object appears with different brightness values.

Types of ultrasound images include a B mode (brightness mode) image representing the magnitude of an ultrasound echo signal reflected from an object and a Doppler modem (spectral form) representing an image of a moving object using a Doppler effect. Or a D mode (also called a P-Doppler mode) image, an M mode image showing the movement of the object over time at a certain position, and a difference in response between applying and not applying pressure to the object. The image may be classified into an elastic mode image represented by an image, a C mode image expressing a speed of a moving object in color using a Doppler effect, and the like. But also include Doppler images for continuous images, such as video, and Doppler images for planar space (2D Doppler). The Doppler image may include both a blood flow Doppler image (or a color Doppler image) and a tissue Doppler image representing tissue movement. In the case of a 3D image, the 3D ultrasound image may be generated by forming volume data from a signal received from the probe head 611 and performing volume rendering on the volume data.

In an exemplary embodiment, the first medical apparatus 610 includes a probe 611 and an image processing apparatus 612 for processing to generate an image based on the ultrasonic echo signal detected by the probe 611. The image processing apparatus 612 may be provided with an image processor that supports a plurality of modes and generates an ultrasound image corresponding to each mode. FIG. 6 illustrates an example in which the image processing apparatus 612 is implemented as a computer body and is connected to the probe 611 which is a fixed terminal by wire. The image processing apparatus 612 may further include a display unit displaying an ultrasound image.

According to another embodiment, the probe 611 may be implemented in the form of a mobile terminal (portable terminal) provided to move a place in a state in which the user grips, as well as a fixed terminal. When the probe 611 is implemented as a mobile terminal, the probe 611 may perform wireless communication with the image processing apparatus 612. Here, the wireless communication is a short-range communication of a predetermined frequency, Wi-Fi (Wifi), Wi-Fi Direct (Wifi Direct), UWB (Ultra Wideband), Bluetooth (Bluetooth), RF (Radio Frequency), Zigbee (Zigbee), Wireless LAN (Wireless LAN) And at least one of various wireless communication modules such as Near Field Communication (NFC). An example of an image processing apparatus 612 for processing to generate an ultrasound image based on an ultrasound echo signal received from the probe 611 may include a smart phone, a smart pad such as a tablet, and a smart. Smart TVs, desktop computers, laptop computers, personal digital assistants (PDAs), and the like.

In another embodiment, an image processor for generating an ultrasound image corresponding to a plurality of modes is provided inside the probe 611, and the image processing apparatus 612 may wire the image generated by the probe 611 by wire or wirelessly. It may be implemented to receive and display through the display unit.

The second medical apparatus 620 may generate a second medical image of a volume of interest (VOI) of the object in real time. The second medical apparatus 620 may have a non real-time characteristic compared with the first medical apparatus 610, and may provide the medical image matching apparatus 630 with the second medical image generated before the medical procedure. .

In the present embodiment, the second medical device 620 may be the CT device 102 or the MRI device 101 described with reference to FIGS. 2 to 4. The second medical apparatus 620 may also be implemented as an X-ray imaging apparatus, a single photon emission computed tomography (SPECT) device, a position emission tomography (PET) device, or the like.

In the following embodiments, it is assumed that the second medical image is an MR or CT image for convenience of description, but the scope of the present invention is not limited thereto.

The medical images photographed by the first medical device 610 or the second medical device 620 may be three-dimensional images generated by scaling two-dimensional cross sections. For example, the second medical apparatus 620 photographs a plurality of cross-sectional images while changing a location and orientation of the cross-sectional image. When such cross-sectional images are accumulated, image data of a three-dimensional volume representing a specific part of the patient's body in three dimensions may be generated. As such, a method of generating image data of a 3D volume by accumulating cross-sectional images is referred to as a multiplanar reconstruction (MPR) method. Similarly, the first medical device 610 may hand sweep the probe 611 or generate 3D volume image data through the Wabbler type or the 3D Array type probe 621.

6 illustrates a case where the first medical image and the second medical image are generated by different types of medical devices, the first medical image and the second medical image are the same type of medical device, for example, the CT device 102. In the case where the images are captured at different time points by the other, they are included in the scope of the present invention.

In the following medical image display device according to an embodiment of the present invention, the first medical image is a non-contrast medical image taken in the state not administered the contrast agent, the second medical image is a contrast enhancement image taken in the state administered the contrast agent The case is described as an example.

Contrast agents administered to patients have the problem of causing various side effects. For example, at least the patient may feel numb or burning, and may cause urticaria, itching, vomiting, nausea, rash, etc., and even seriously, the patient may die.

In particular, patients with poor kidney function cannot use contrast agents except inevitable cases, and the cost of using contrast agents is difficult to be overlooked in patients requiring long-term treatment.

In order to minimize the above-mentioned contrast agent side effects, non-contrast imaging is mainly used for the follow-up examination of lung cancer and simple diagnosis of lung lesions (such as bronchial disease and emphysema). Specifically, 80% or more of the diagnosis is based on non-contrast imaging based on the As Low As Reasonably Achievable (ALARA) principle (an international regulation that recommends minimizing the use of doses and contrast agents) and the National Comprehensive Cancer Network (NCCN) guidelines. This is being done.

FIG. 7 is a diagram conceptually illustrating lymph nodes and blood vessel distribution of a chest region, FIG. 8 is a diagram showing contrast-enhanced CT images taken of a chest region, and FIG. 9 is a non-contrast CT shot of a chest region. It is a figure which shows an image.

Lymph node (lymph node, lymph node) 701 shown in Figure 7 is involved in causing an immune response by recognizing pathogens (eg, inflammation, cancer cells, etc.) in the human body. Therefore, the degree of change in the size of lymph nodes, the change in the number and distribution of changed lymph nodes are important clinical judgment factors for diagnosis and treatment monitoring.

For example, when the cancer cells develop or metastasize, the lymph nodes increase in size. Therefore, for detecting and diagnosing lymph nodes, it is useful to use contrast-enhanced images that are relatively easy to distinguish from other structures, particularly the blood vessels 702. May be advantageous.

As shown in FIG. 8, the lymph node 703 and the pulmonary blood vessel 704 are distinguishably displayed in a contrast-enhanced CT image photographed by administering a contrast agent to a patient. In contrast, in the non-contrast CT image of FIG. 9, it is confirmed that the lymph node and the blood vessel are not easily distinguished in the region 705 where the lymph node is located.

However, the use of contrast agents is gradually limited due to the various side effects described above. In particular, in the case of kidney disease patients, contrast agents cannot be administered, and thus, an inevitable diagnosis based on non-contrast medical images occurs.

Thus, although lymph node region information is an important landmark for lung cancer diagnosis (metastasis, state changes, etc.) and lung lesion diagnosis, it is difficult to distinguish lymph node / vessel regions in non-contrast imaging, Missing early diagnosis of the disease, or missed treatment time occurs.

FIG. 10 is a block diagram illustrating a configuration of the medical image display apparatus 1000 according to an exemplary embodiment. FIG. 11 is a block diagram illustrating the configuration of the image processor 1030 of FIG. 10.

As shown in FIG. 10, the medical image display apparatus 1000 according to an exemplary embodiment may include a control unit 1010, a display unit 1020, an image processing unit 1030, a user input unit 1040, and a storage unit ( 1050 and the communication unit 1060. However, the illustrated components are not all essential components, and other general components may be further included in addition to the illustrated components.

When the medical image display apparatus 1000 is included in the MRI apparatus 101 illustrated in FIG. 2, at least a part of the medical image display apparatus 1000 may correspond to the operating unit 260. In detail, the image processor 1030 and the display 1020 may correspond to the image processor 262 and the output unit 264 of FIG. 2, respectively. The controller 1010 may correspond to at least a portion of the operating unit 260 and / or the display control unit 248. Therefore, in the medical image display apparatus 1000, a description overlapping with that of FIG. 2 will be omitted.

In addition, when the medical image display apparatus 1000 is included in the CT apparatus 102 illustrated in FIGS. 3 and 4, the controller 1010, the display unit 1020, the image processor 1030, and the user input unit 1040 may be used. The storage unit 1050 may correspond to the control unit 318, the display unit 330, the image processor 326, the user input unit 328, and the storage unit 324 of FIG. 4, respectively. Therefore, in the medical image display apparatus 1000, a description overlapping with that of FIG. 3 or 4 will be omitted.

In addition, the medical image display apparatus 1000 may be included in any one of the server 534, the medical apparatus 536, the portable terminal 538, and the ultrasound apparatus 610 described with reference to FIG. 6.

The display unit 1020 displays an application related to the operation of the medical image display apparatus. For example, the display unit 1020 may display menus or guidance items necessary for diagnosis using a medical device. In addition, the display 1020 may display the images acquired during the diagnosis process and a user interface (UI) for helping the user manipulate the medical image display device.

10 illustrates an example in which one display unit 1020 is provided in the medical image display apparatus 1000, but the present invention is not limited thereto, and includes a plurality of display units, for example, a main display and a sub display. Can be implemented.

In the present embodiment, the display 1020 may include a first image (first medical image) and / or a third image in which a matching process, which will be described below, is performed on the first image of an object including at least one anatomical object. (Third Medical Image) is displayed. In addition, the display unit 1020 may further display a fourth image (fourth medical image) displaying up to an extended area of the lesion, which will be described later. In addition, the display 1020 may further display a second image (second medical image) that is a reference image of the first image.

Here, the first image may be a medical image photographing an object, and may be all medical images photographed for diagnosing a disease, such as a tomography image, an X-ray image, and an ultrasound image.

The image processor 1030 processes the image to be displayed on the display 1020. In detail, the image processor 1030 may process a signal obtained by capturing an object and image it as image data that can be displayed on the display unit 1020.

First of all, a method of imaging a medical image includes a method of photographing an object by irradiating a ray, such as an X-ray, with the object, like the imaging method of an X-ray image. This method is a method of imaging an object without discriminating a photographing technique or a scan mode. In addition, the method can image the object directly, without a separate reconstruction or calculation operation for the image to be acquired.

Secondly, there is a method of imaging an object by applying various imaging techniques or scanning modes in photographing the object, such as an MRI or CT image. In the above-described second method, an image having different characteristics may be acquired even if the same part of the body is photographed using various variables that may be considered when scanning the object. That is, by changing the scan mode in accordance with the purpose or purpose, it is possible to obtain an image corresponding to the purpose. In addition, the method may obtain a target image by performing a separate reconstruction or calculation operation for the image to be acquired.

Herein, a technique applied in scanning a subject and taking a medical image is referred to as a 'scan protocol' or a 'protocol', hereinafter referred to as a 'protocol'. In addition, the image processor 1030 may generate a medical image by applying a predetermined protocol to the acquired image data.

The medical image display apparatus 700 according to an exemplary embodiment may generate calculated or post-processed image data (third image) by using image data (first image) obtained by applying a protocol. In this embodiment, the calculation or post-processing process includes a matching process, so that the generated image becomes a third image and / or a fourth image.

The MRI apparatus 101 scans an object by applying various protocols, and generates an image of the object by using the acquired MR signal. Hereinafter, data acquired by scanning an object, for example, MR signals or K-space data is called scan data, and an image of the object generated using the scan data is called image data. The image data corresponds to the first image described above.

In the case of the CT device 102, different protocols may be applied to scan an object depending on whether contrast medium is administered. In addition, in the case of the CT device 102, the acquired image data may be a sinogram or projection data, and the image data, that is, the first image may be generated using the acquired scan data. have.

The user input unit 1040 is provided to receive a command from the user. The medical image display apparatus 1040 according to the present exemplary embodiment receives an input for operating the medical image display apparatus 1040 from the user through the user input unit 1040, and in response thereto, obtains the medical image display apparatus 1040 obtained by the medical image display apparatus 1040. The first medical image, the second medical image, and / or the matched third medical image (or fourth medical image) may be output through the display unit 1020.

The user input unit 1040 may include a button, a keypad, a switch, a dial, or a user interface displayed on the display unit 1020 for direct manipulation of the medical image display apparatus 1040 by the user. In one embodiment of the present invention, the user input unit 1040 may include a touch screen provided on the display unit 1020.

In an embodiment, the medical image display apparatus 1000 may receive at least one point selected from the medical image (first image) displayed on the display unit 1020 through the user input unit 1040. Here, the selected point may correspond to the lymph node / vessel area in the non-contrast CT image (first image) of FIG. 9, and is performed by the image processor 1030 in response to the user's selection of the display unit 1020. According to the matching process, the processed image (third image) may be displayed to distinguish the lymphnote and the blood vessel at the selected point. The display unit 1020 may enlarge and display the selected point.

The storage unit 1050 stores unlimited data under the control of the controller 1010. The storage unit 1050 is implemented as a nonvolatile storage medium such as a flash memory and a hard disk drive. The storage unit 1050 is accessed by the control unit 1010, and read / record / modify / delete / update data, etc., by the control unit 1010.

The data stored in the storage unit 1050 includes, for example, an operating system for driving the medical image display apparatus 1000, and various applications, image data, additional data, etc. executable on the operating system.

The storage unit 1050 of the present embodiment may store various data related to a medical image. In detail, the storage unit 1050 stores at least one image data generated by applying at least one protocol in the medical image display apparatus 1000 and / or at least one medical image data received from the outside. In addition, the storage unit 1050 may further store at least one image data generated by performing a matching process on the image data. Image data stored in the storage unit 1050 is displayed by the display unit 1050.

The communication unit 1060 includes a wired / wireless network communication module for communicating with various external devices. The communication unit 1060 transmits a command / data / information / signal received from an external device to the control unit 1010. In addition, the communication unit 1060 may transmit a command / data / information / signal received from the control unit 1010 to an external device.

According to the present embodiment, the communication unit 150 may be embedded in the medical image display apparatus 1000, but in one embodiment, the communication unit 150 may be implemented in a dongle or module form to connect the connector of the medical image display apparatus 1000 (not shown). It may be detached from the device.

In another embodiment, the communication unit 1060 may include an I / O port for connecting human interface devices (HIDs). The medical image display apparatus 1000 may transmit and receive image data with an external device connected by wire through an I / O port.

The communication unit 1060 of the present embodiment may receive medical image data generated by another medical device. The other medical device may be the same kind of medical device as the medical image display device 1000 or may be another medical device. For example, when the medical image display apparatus 1000 is a CT device, the other medical device may be another CT device, and in some cases, the other medical device may be an MRI device or an ultrasound device.

In an embodiment, the medical image display apparatus 1000 may be directly connected to another medical apparatus through the communication unit 1060. In another embodiment, the communication unit 160 may include a connection for connecting to an external storage medium storing a medical image.

The controller 1010 performs a control operation on various components of the medical image display apparatus 1000. For example, the controller 1010 may perform an image processing / image registration process processed by the image processor 1030 and perform a control operation corresponding to a command from the user input unit 1040, thereby causing the medical image display apparatus 1000 to perform the control. To control the overall operation.

The controller 1010 includes at least one processor. At least one processor loads and executes a program corresponding to a volatile memory (RAM) from a nonvolatile memory (ROM) in which the program is stored.

The control unit 1010 according to the present embodiment includes at least one general purpose processor such as a central processing unit (CPU), an application processor (AP), a microcomputer (MICOM), for example, a predetermined algorithm stored in a ROM. In accordance with the present invention, the corresponding program may be loaded into the RAM and executed to execute various operations of the medical image display apparatus 1000.

When the controller 1010 of the medical image display apparatus 1000 is implemented as a single processor, for example, a CPU, the CPU may display various functions that may be performed by the medical image display apparatus 1000, for example, the display unit 1020. Various image processing processes for imaging medical images, for example, selection of an applied protocol and control of imaging accordingly, response to commands received through the user input unit 1040, and a wired / wireless network with an external device. It may be provided to be able to control the communication and the like.

The processor may include single core, dual core, triple core, quad core, and multiple cores thereof. The processor may include a plurality of processors, for example, a main processor and a sub processor. The subprocessor is provided to operate in a standby mode (hereinafter, also referred to as a sleep mode) in which only standby power is supplied and does not operate as the medical image display apparatus 1000.

The processor, ROM, and RAM included in the controller 1010 may be connected to each other through an internal bus.

In one embodiment of the present invention, when the medical image display apparatus 1000 is implemented as a laptop or desktop computer, the controller 1010 may be provided in a main body and further include a GPU (Graphic Processing Unit, not shown) for graphic processing. Can be. In another embodiment, when the medical image display apparatus 1000 is implemented as a portable terminal such as a smart phone or a smart pad, the processor may include a GPU. For example, the processor may include a core and a GPU. SoC (System On Chip) can be implemented.

On the other hand, the controller 1010 is dedicated to execute a program for performing a specific function supported by the medical image display apparatus 1000, for example, a function for detecting an error occurrence in a predetermined configuration including a main processor. A chip provided as a processor may include, for example, an integrated circuit (IC) chip.

In an embodiment, the controller 1010 may receive a user command to execute a predetermined application as a platform capable of analyzing a medical image through the user input unit 1040. The executed application may be a user selectable GUI and may include an input area (2220 of FIG. 22) on which various buttons are displayed and a display area (2210 of FIG. 22) on which a medical image is displayed.

A user may load, i.e., load, a medical image stored internally or externally using a GUI of an input area of an application, and the loaded medical image is displayed on the display unit 1020 through the display area of the application. . In addition, the user may input a user command to register the first medical image and the second medical image in the executed application.

In one embodiment of the present invention, the image processing unit 1030 may be implemented as a medical image analysis application which is a software configuration driven by the controller 1010 including at least one processor having a hardware configuration.

That is, the operations of the image processor 1030 described below are performed according to the execution of the software driven by the controller 1010. Therefore, the various operations performed by the image processor 1030 may be regarded as being performed by the controller 1010, that is, at least one processor.

The controller 1010 of the medical image display apparatus 1000 according to an exemplary embodiment of the present invention controls the image processor 1030 to perform an image matching process on the non-contrast medical image, that is, the first medical image. Here, the image processor 1030 may perform image registration on the first medical image by using the first medical image and the second medical image.

The second medical image is a contrast-enhanced medical image obtained at another time point and serves as a reference image of the first medical image. For example, the contrast-enhanced medical image is an image captured by an object at a predetermined time point in the past, and is stored in another medical device, a server, or the like, and is loaded into the medical image display apparatus 1000 through the communication unit 1060, or internal or externally. The storage unit 1050 may be stored in advance.

In one embodiment, the contrast-enhanced medical image may be a medical image taken in the past with respect to the same object as the first medical image, that is, the same patient. The user may select the contrast-enhanced medical image that can be used as the second medical image by using history information about the patient. Here, the user may select at least one contrast enhancement medical image as the second medical image. In addition, the second medical image may be an image generated by using a plurality of contrast-enhanced medical images previously photographed on the same object.

In another embodiment, the contrast enhanced medical image may be a standardized medical image. For example, by using information stored in a medical image database in which brain CT images of a plurality of objects are accumulated, subjects having conditions similar to those of the first medical subject, that is, age, gender, and disease progression, etc. It may be a standardized medical image generated using the contrast-enhanced medical images taken for.

That is, in an embodiment described below, an image registration using one contrast-enhanced medical image is described as an example, but a case where a plurality of contrast-enhanced medical images are used is not excluded from the scope of the present invention.

The image processor 1030 extracts at least one anatomical object by dividing or segmenting the second medical image. In detail, the image processor 1030 may extract reference region information corresponding to at least one anatomical object from the second medical image that is a reference image of the first medical image.

Here, the anatomical object may be plural, and accordingly, the image processing unit 1030 may include a region corresponding to the first object (hereinafter, also referred to as a first anatomical object) and a second object different from the first object (hereinafter, referred to as “first”). 2 may be further extracted from the second medical image.

In one embodiment, the first subject may be a blood vessel and the second subject may be a lymph node. In another embodiment, the first subject may be a blood vessel and the second subject may be a bronchus.

The image processor 1030 registers the first medical image and the second medical image by using reference region information extracted from the second medical image. Here, the matched image is displayed on the display unit 1020 as a third medical image, and is displayed separately from other regions of the detected anatomical object, that is, the region other than the detected anatomical object.

Here, the image processing unit 1030 may use the geometric relationship between the anatomical object of the first medical image and the anatomical object of the second medical image in performing image registration, and the geometric relationship refers to the relative positional relationship of the anatomical objects. May contain a vector to represent.

Registration of the medical images includes a process of mapping coordinates of the first medical image and the second medical image to each other. In the present embodiment, the first medical image and the second medical image may be medical images generated using a coordinate system according to digital imaging and communication in medicine (DICOM), respectively.

The image processor 1030 calculates a coordinate transformation function for converting or inversely transforming the coordinates of the second medical image into the coordinates of the first medical image through a matching process of the first medical image and the second medical image. Here, the coordinate transformation function may include a first transformation equation that maintains unique characteristics of the anatomical object of the previous point of time calculated in the homogeneous registration process described later, and a second transformation equation in which two image information calculated in the heterogeneous registration process are completely matched. Can be.

The image processor 1030 may synchronize the coordinates and the views of the first medical image and the second medical image by using a coordinate transformation function.

In an embodiment, the matched image may be an image obtained by converting the first medical image. In another embodiment, the matched image may be a fusion image of the first medical image and the second medical image. The display unit 1020 may display the first medical image and display the third medical image and / or the fourth medical image generated by matching the first medical image with the second medical image.

12 is a diagram illustrating a first medical image 1210 according to an embodiment of the present invention.

In the present embodiment, the first medical image 1210 is a relatively recently image of the object. The first medical image 1210 may be a non-contrast image taken without a contrast agent being administered to the subject. For example, the first medical image 1210 may be a brain CT image as shown in FIG. 12. In another embodiment, the first medical image 1210 may be a captured image capable of real-time display, for example, an ultrasound image.

As shown in FIG. 12, since the first medical image 1210 is a non-contrast CT image, it is not easy to distinguish the first object and the second object, that is, the blood vessel and the lymph node, that is, the identification in the image 1210. .

The user may select an area 1211 in which the blood vessel and the lymph node are expected to be located in the first medical image 1210 using the user input unit 1040. As illustrated in FIG. 12, the controller 1010 may control the display 1020 to enlarge and display the selected area 1211. In the enlarged area 1211, blood vessels and lymph nodes are not identified.

FIG. 13 is a diagram illustrating a second medical image 1310 according to an embodiment of the present invention, and FIG. 14 is a diagram illustrating a second medical image 1410 from which an object is extracted.

The second medical image 1310 may be a contrast enhancement image taken in a state where a contrast agent is administered to the subject, and may be, for example, a brain CT image as shown in FIGS. 13 and 14.

Referring to FIG. 11, the image processor 1030 includes a first object extractor 1031, a second object extractor 1032, and a matching unit. The matching unit includes a coordinate converting unit 1033, a homogeneous matching unit 1034, and a heterogeneous matching unit 1035.

In one embodiment, the image processor 1030 is illustrated as including the first object extractor 1031 and the second object extractor 1032 to extract two anatomical objects, but is not limited thereto. That is, for example, three or more anatomical objects may be extracted and displayed in a third medical image so as to be distinguishable.

Also, in another embodiment, the image processor 1030 is provided with one object extractor to extract an area of the first object from the second medical image, and display the area of the first object separately from other areas except for the first object. can do. For example, the first individual region is a blood vessel region, and a vessel region and a non-vascular region are divided and displayed. Here, the non-vascular region includes a lymph node region. In other embodiments, the non-vascular region may comprise a bronchial region.

The first object extractor 1031 and the second object extractor 1032 extract area information of the first anatomical object and area information of the second anatomical object from the second medical image, respectively. The regions of the first and second objects extracted in this way are reference regions, and the extracted region information is used as reference region information by the matching unit.

The first object extractor 1031 extracts a region corresponding to the first object in the second medical image by using anatomical features of the first object, and the second object extractor 1032 anatomically extracts the second object. The region corresponding to the second object is extracted from the second medical image by using the feature.

The first object extractor 1031 may use a brightness value for each pixel included in the second medical image to determine an area of the first object.

In detail, the first object extractor 1031 detects points having a brightness value within a preset first range in the contrast-enhanced second medical image, and corresponds to the first object including the detected points. You can decide which area to do. In another embodiment, when a specific point in the second medical image is selected by the user input unit 1040, the first object extractor 1031 may detect the points having anatomical characteristics similar to those of the selected point. The difference between the brightness values of, i.e., the points whose contrast is equal to or less than the first threshold value may be detected to determine a first object region including the detected points.

The second object extractor 1032 detects points having a brightness value within a preset second range in the contrast-enhanced second medical image, and detects an area corresponding to the second object including the detected points. You can decide. In another embodiment, when a specific point in the second medical image is selected by the user input unit 1040, the second object extractor 1032 may detect a point having an anatomical characteristic similar to the selected point. By detecting the difference of the brightness value of, i.e., the contrast is equal to or less than the second threshold value, the second object region including the detected points may be determined.

The first range and the second range for the brightness value may be preset in correspondence to the anatomical features of each of the first and second objects. Similarly, the first threshold value and the second threshold value may be preset in correspondence with the anatomical characteristics of each of the first object and the second object, or in some cases, the first threshold value and the second threshold value may be set to the same value. have.

As shown in FIG. 14, the controller 1010 displays the display unit 1020 to display the first object region 1411 and the second object region 1412, which are reference regions extracted from the second medical image, to be identified. Can be controlled. The user may identify the blood vessel region 1411 corresponding to the first object and the lymph node region 1412 corresponding to the second object by using the displayed image 1410 of FIG. 14, and use the same for diagnosis.

The information of the first object region and the information of the second object region extracted by the first object extractor 1031 and the second object extractor 1032 are transferred to the matching unit.

The matching unit registers the first medical image and the second medical image based on a predetermined algorithm. The matching unit uses the first medical image by using the reference region information, that is, the information of the first object region received from the first object extractor 1031 and the information of the second object region received from the second object extractor 1032. The second medical image may be registered.

That is, the first object region 1411 and the second object region 1412 segmented from the second medical image are arranged through the image registration process of the matching unit in the image processor 1030 and the first object region and the second object image of the first medical image. Matches to the object area respectively.

15 is a diagram for describing an image registration process according to the present embodiment.

In the medical image display apparatus 1000 according to an exemplary embodiment of the present invention, image registration may include different sets of different image data in a captured same scene as illustrated in FIG. 15. image data), that is, a process of transforming I _f and I _m into a coordinate system, and maximizes the similarity between the images I _f 'and I _{m that} are to be matched. Is implemented by optimization algorithms to minimize.

For example, in image matching, a result of a similarity measure is maximized as shown in Equation 1 below using a predetermined conversion model parameter, or a result of a cost function as shown in Equation 2 is obtained. This involves finding the final parameter (P _final ) to be the minimum. Here, the process of finding the final parameter may include homogeneous matching and hetero matching, which will be described later.

Here, I _f is a fixed image, for example, a first medical image which is a non-contrast image, and I _m is a moving image, for example, a second medical image, which is a contrast enhancement image. In addition, S is a similarity measure (similarity measure), C is a cost function and P is a parameter set of transformation model.

The transformation model parameters that can be used in the embodiments of the present invention as described above include rigid transformation, affine transformation, thin-plate-spline free form deformation (TPS FFD), and B. Spline (B-spline) FFD, elastic model (elastic model) and the like.

Further, the result of the cost function may be determined by weights assigned to each of the similarity (or dis-similarity) measure and the regularization metric.

Similarity or dissimilarity measurement functions include Mutual information (MI), Normalized mutual information (NMI), Gradient-magnitude, Gradient-orientation, Sum of Squared Difference (SSD), Normalized Gradient-vector Flow (NGF), Gradient NMI (GNMI) And the like. In addition, normalization metrics include Volume regularization, Diffusion regularization, Curvature regularization, Local rigidity constraint, and the like.

The coordinate transformation unit 1033 maps the coordinate systems of the first medical image and the second medical image to each other. Here, the coordinate system mapping is to match the coordinate system of the first medical image and the coordinate system of the second medical image. For example, the coordinate converting unit 1033 may follow a direction in which the first anatomical object of the first medical image is disposed. The coordinate system of the second medical image may be aligned such that the first anatomical object (reference area) of the second medical image may be disposed. Here, the coordinate transformation unit 1033 may rotate or move the second medical image in a range where the alignment state is not shifted between the first anatomical objects of the first medical image and the second medical image.

In an embodiment of the present invention, the image processing unit 1030 sequentially performs homogeneous matching and heterogeneous matching on the first medical image and the second medical image in which the coordinate system is adjusted through the coordinate transformation unit 1033.

16 is a diagram conceptually illustrating a homogeneous matching process, and FIG. 17 is a diagram conceptually illustrating a heterogeneous matching process.

Homogeneous registration, as shown in FIG. 16, is to match a fixed image while maintaining an image characteristic (shape) of a moving image during image registration.

In-homogeneous registration, as shown in FIG. 17, is to modify an image characteristic (shape) of a moving image so as to completely match a fixed image when the image is matched. .

In an embodiment, the homogeneous matching unit 1034 and the heterogeneous matching unit 1035 calculate a cost function through a conversion process between the images I _f ′ and I _m , which are coordinate matching objects, and calculate the cost function. By repeating the process of updating the parameter P based on the cost function, the final parameter P _final is found to minimize the result of the cost function.

Here, homogeneous matching is performed in such a way as to gradually change the weights assigned to each of the similarity (or dis-similarity) measure and the regularization metric. The matching may be performed, and the change of the weight may be performed in a direction of gradually increasing the degree of freedom of the second medical image used as the moving image.

That is, in FIG. 11, for convenience, the image processing unit 1030 includes a homogeneous matching unit 1033 and a heterogeneous matching unit 1034, but it is not a process in which homozygous matching and hetero matching are completely separated from each other. Some of the processes in the first half of the process of updating P correspond to homogeneous matching, and some of the subsequent processes correspond to heterogeneous matching.

In addition, in FIG. 11, the processes are repeatedly performed until the heterogeneous matching is completed even after the homogeneous matching is completed. However, the present invention may be implemented to perform only homogeneous matching and not heterogeneous matching.

In an embodiment, the image processor 1030 continuously updates P in the algorithm of FIG. 18 to design a normalization metric constituting a transformation model and a cost function. In this way, different results can be derived from homozygous and heterozygous. In this process, known models such as Rigid global model, Non-rigid global model, Rigid local model, and Non-rigid local model are used.

Referring to FIG. 18, the image processor 1030 first initializes the transformation model parameter P (S1801).

In operation S1803, the second medical image I _m is transformed such that the coordinate system of the first medical image I _f is aligned. In one embodiment, the mapping of the coordinate system may use a coordinate system according to an affine space. In this case, the process of S1803 may also be referred to as affine registration.

Next, the second medical image (I _m ') converted in the process of S1803 and the first medical image (I _f) to compute a cost function using the pixel in the overlap region (overlapped regions) (C) ( calculate the (S1805). Here, the result of the cost function (C) is determined using a normalization metric based on a similarity (or dis-similarity) measure and prior information. For example, it may be determined by a sum of weights assigned to each of the similarity measure function and the normalization metric. The overlapped areas may be, for example, areas corresponding to at least one anatomical entity.

The image processor 1030 determines whether the result value of the cost function C calculated in the process of S1805 is minimum (S1807).

According to the determination result of S1807, the conversion model parameter P is updated (S1809).

The image processor 1030 repeatedly performs the processes of S1803 to S1807 until the result value of the cost function is minimum, based on the determination result of the process of S1807. This process is the process of homogeneous and heterogeneous matching, and finds the optimization algorithms for each.

Through the above processes, the homogeneous matching unit 1034 obtains the first transform information as an optimized algorithm in which the unique characteristics of the lymph node and the blood vessel information of the previous time point are maintained.

In addition, the heterogeneous matching unit 1035 obtains the second transform information as an optimized algorithm in which the two image information are completely matched. In one embodiment, the heterogeneous registration may be a quantification process for tracking changes in the second anatomical entity, for example, lymph nodes, and the degree of change in the lymph nodes may be quantified to be displayed on the medical image according to the quantification.

Here, the similarity (or dissimilarity) measurement function can be evaluated whether the image is matched between I _f 'and I _m , and the weights given to each of the similarity (or dissimilarity) measurement function and the normalization metric are It can be a factor that distinguishes between homogeneous and heterogeneous matching.

In one embodiment, the image processor 1030 generates a third medical image from the first medical image according to the homogeneous matching process as described above. The fourth medical image may be further generated from the third medical image according to the heterogeneous matching process.

The controller 1010 controls the display unit 1020 to display the third medical image and / or the fourth medical image generated by the image processor 1030.

19 is a view showing a third medical image 1910 according to an embodiment of the present invention, FIG. 20 is a view showing a fourth medical image 1610, and FIG. 21 is an enlarged view of some object regions in FIG. 20. The figure is shown.

As illustrated in FIG. 19, the controller 1010 may display the first object region 1911 and the second object region 1912 in a third medical image generated by homogeneous matching so as to be identified. Can be controlled. Accordingly, the user may identify the blood vessel region 1911 corresponding to the first entity and the lymph node region 1912 corresponding to the second entity, which are not identified in FIG. 12, and use the same for diagnosis.

Here, the controller 1010 may display the area of the anatomical object detected by at least one of color, pattern, pointer, highlight, and animation effects on the display 1020 separately from an area that is not an anatomical object. have. When there are a plurality of areas of the detected anatomical object, different colors, patterns, pointers, highlights, and animation effects may be applied to each of the areas. In addition, a combination of colors, patterns, pointers, highlights, and animation effects may be applied to a plurality of areas. For example, the first object region 1911 may be displayed by color and the second object region 1912 by a pattern. The first object region 1911 may be provided with a predetermined pattern and a pointer to the first object region 1911. It may be implemented by various modifications such as to be distinguished from other areas.

That is, although FIG. 19 illustrates that the detected first object region 1911 and the second object region 1912 are divided and displayed by a pattern, various embodiments in which the user is visually discernible are applicable. It is possible.

Here, the pattern includes a plurality of horizontal lines, vertical lines, diagonal lines in a predetermined direction, various types of dot patterns, wave patterns, and the like including a circle. The pointer includes a solid line displayed along the circumference of the detected area and a dotted line of various forms, and the brightness of the pointer may be displayed brighter than the surrounding area. Highlighting includes displaying the brightness of the detected area differently, for example, brighter than other areas. The animation effect is to apply various visual effects, such as flickering at predetermined time intervals, gradually brightening / darkening, to the detected area.

As shown in FIG. 19, the division marks of the

regions

1911 and 1912 of the anatomical entity can be activated or deactivated by user selection. That is, the user may activate a function of distinguishing the first area 1911 and the second area 1912 by color or the like by manipulating the user input unit 1040, and the user may input a user input for activating the corresponding function. can do.

To this end, the user interface selectable whether to activate the object classification, that is, the GUI is displayed on the display unit 1020, or the user input unit 1040 includes a toggle switch assigned to correspond to the object classification function, such as in various ways It may be provided to enable user selection.

In addition, the level (ie, degree, intensity, etc.) of the division display of the anatomical object detected through the user input unit 1040 may be adjusted. That is, the medical image display apparatus 1000 according to the present invention may be provided to distinguish and display anatomical objects in various ways according to the user's preference and taste.

Meanwhile, as shown in FIG. 20, in the fourth medical image 2010 generated by performing heterogeneous registration, not only the first object region 2011 and the second object region 2012 are displayed to be identified, but also the previous time point. The change in the second object area 2012 with respect to the display may be displayed. Here, the previous time point may be a time point at which the second medical image is taken.

Accordingly, by displaying the lesion extension region 2014 in the lymph node region 2012, the diagnosis of the user is easier.

The user may be instructed to enlarge and display a predetermined region by using the user input unit 1040. In response thereto, the blood vessel region 2111 corresponding to the first object may be displayed on the fourth medical image 2110 as shown in FIG. In this case, the lymph node region 2112 corresponding to the second individual is distinguishably displayed, and the existing lesion region 2113 and the lesion expansion region 2114 are distinguishable within the lymph node region 2112. By determining the extent of expansion can be used for diagnosis.

The controller 1010 distinguishes and displays the existing

lesion areas

2013 and 2113 and the

lesion extension areas

2014 and 2114 in FIGS. 20 and 21 by at least one of color, pattern, pointer, highlight, and animation effects. The display unit 1020 may be controlled. Herein, the controller 1010 may apply a combination of colors, patterns, pointers, highlights, and animation effects to the existing

lesion areas

2013 and 2113 or the

lesion extension areas

2014 and 2114. For example, the existing

lesion areas

2013 and 2113 may be displayed by patterns, and the

lesion extension areas

2014 and 2114 may be displayed by a pointer, and predetermined patterns and highlights may be displayed on the

lesion extension areas

2014 and 2114. The present invention may be modified in various ways, such as to be displayed separately from other areas.

As shown in FIGS. 20 and 21, the division display of the

lesion extension regions

2014 and 2114 may be activated or deactivated by user selection. That is, the user may operate the user input unit 1040 to activate a function in which the

lesion extension regions

2014 and 2114 are distinguished and displayed by color, and the user may perform a user input for activating the corresponding function.

To this end, a user interface that can select whether to enable extended area classification, that is, a GUI is displayed on the display unit 1020 or the user input unit 1040 includes a toggle switch allocated to correspond to the extended area classification function. May be provided to enable user selection. By selecting to enable / disable extension area division, the user can more easily grasp the extent of lesion extension.

In addition, the display level (ie, degree or intensity, etc.) of the existing

lesion areas

2013 and 2113 and the

lesion extension areas

2013 and 2114 detected through the user input unit 1040 may be adjusted. That is, the medical image display apparatus 1000 according to the present invention may be provided so as to be able to distinguish and display the anatomical object in various ways according to the user's preference and taste.

FIG. 22 is a diagram illustrating a screen displayed according to the driving of an application having a medical diagnosis function in a medical image display apparatus according to an exemplary embodiment of the present invention.

The medical image 2210 illustrated in FIG. 22 is an image displaying a result of performing an image registration process. The medical image 2210 may include a first anatomical object 2211, a second anatomical object 2112, and a second anatomical object 2112. It can be seen that a user selectable user interface, that is, an input area 2220 including various GUIs, is positioned on the left side of the display area in which the existing lesion area 2113 and the lesion extension area 2114 are distinguishable.

In a state where the first medical image is displayed on the display area 2110 in the executed application, the user selects a predetermined button of the user interface of the input area 2220 to call up the reference image used as the second medical image and then display the first image. It can be used for image registration of medical images.

That is, various medical images may be displayed on the display area 2210 of FIG. 22 including the images illustrated in FIGS. 12 to 14 and 19 to 21. In addition, by segmenting the display area 2210, two or more images including the images of FIGS. 12 to 14 and 19 to 21 may be displayed in a horizontal and / or vertical direction so as to be comparable.

In addition, when the display unit 1020 is provided to include a plurality of main displays and sub-displays, for example, two or more images may be displayed to be compared in various combinations.

23 to 26 illustrate various examples of using image registration for diagnosis in the medical image display apparatus 1000 according to an exemplary embodiment of the present invention.

In an embodiment of the present invention illustrated in FIG. 23, the control unit 1010 of the medical image display apparatus 100 may include the first medical image (non-contrast medical image) 2301 and the second medical image (other view) as described above. Acquisition contrast-enhanced medical images) 2311 are acquired, respectively, to generate a fused display that matches them.

The process of generating a fusion display includes image matching 2302 between a non-contrast medical image and another view-enhanced contrast-enhancing medical image, converting and propagating an image generated according to the matching 2303, and correcting an area 2304.

Here, the anatomical objects, that is, the lymph nodes and the blood vessel region, are divided (2312) with respect to the other view-enhanced contrast-enhanced medical images, and the transformation and propagation (2303) and region correction (corresponding to the coordinates of the two medical images) are performed. 2304). When region correction 2304 is complete, the resulting fused image is displayed as a registration image (2305).

As image registration, transformation, propagation, and correction are sequentially performed, quantification is performed to compare changes of lymph nodes in the non-contrast medical images taken with respect to other viewpoint-acquired contrast enhanced medical images (2313). The result of quantification is displayed.

In another embodiment illustrated in FIG. 24, the control unit 1010 of the medical image display apparatus 100 may include a first medical image (non-contrast medical image) 2401 and a second medical image (other view acquisition contrast enhancement medical image). (2411), respectively, to obtain a matched fusion display, and in this process, data is loaded from the medical image data base (2421), and machine learning is performed (2422), which is further added to the area correction (2404) process. It can be utilized.

Various information is stored in the medical image database, and the controller 1010 classifies data (including images) of conditions similar to the object (such as the age, gender, and progression of the lesion) among the stored information, and classifies the classified data. Through the training process using the machine learning to predict the data can proceed.

The controller 1010 may control the image processor 1030 to utilize data predicted according to machine learning for segmentation and rectification in the image registration process of the other embodiment. In this case, the accuracy of image registration may be further improved as compared with the embodiment using only reference information extracted from the second image (enhanced medical image at another point in time).

The process of generating a fusion display includes image matching 2401 between a non-contrast medical image and another point-enhanced contrast-enhancing medical image, converting and propagating an image generated according to the matching, and a region correction 2403.

Here, the anatomical objects, that is, the lymph node and the blood vessel region, are divided (2412) with respect to other viewpoint-acquired contrast-enhanced medical images, and transformed and propagated (2403) and region correction (corresponding to coordinates of the two medical images). 2404). When region correction 2404 is complete, the resulting fused image is displayed as a registration image (2405).

As image registration, transformation, propagation, and correction are performed sequentially, quantification is performed to compare changes in lymph nodes in the non-contrast medical images taken with respect to other time-acquired contrast enhanced medical images (2413). In the process, data from machine learning is used more. The quantification result is then displayed 2414.

In another embodiment illustrated in FIG. 25, the control unit 1010 of the medical image display apparatus 100 may include a first medical image (non-contrast medical image) 2501 and a second medical image (other view acquisition contrast enhancement medical image). ) Obtain each of the 2525 and create a fused display that matches them, and further utilize a standard image / model in this process. For example, the controller 1010 loads a plurality of images corresponding to conditions similar to the object (age, gender, lesion progression, etc.) of the object from the data stored in the standard image / model (2521), and the loaded image The image registration 2522 and the transformation and propagation 2523 may be performed.

The process of generating a fusion display includes image matching 2502 between a non-contrast medical image and another point-enhanced contrast-enhancing medical image, converting and propagating an image generated according to the registration, and correcting an area 2504.

Here, a predetermined anatomical object, that is, a lymph node and a blood vessel region, is segmented (2512) for another viewpoint-acquired contrast-enhanced medical image, which is converted and propagated (2503) and region corrected (2504) to correspond to coordinates of the medical images. Available). Here, data obtained by image matching 2522 and transformation and propagation 2523 from the standard image / model is further utilized. When the acquired area correction 2504 is complete, the resulting fused image is displayed as a registration image (2505).

As image registration, transformation, propagation, and correction are performed sequentially, quantification is performed to compare changes in lymph nodes in the non-contrast medical images taken with respect to other viewpoint-acquired contrast enhanced medical images (2513). As data of the standard image / model is further utilized in the process, the accuracy of image registration may be further improved. The quantification result is then displayed 2514.

In another embodiment illustrated in FIG. 26, when there is no contrast enhancement image captured at another time point with respect to an object, two or more non-contrast medical images t1 and t2 are matched, and a standard image is used to improve accuracy. The / model 2621 and / or the medical image database 2651 may be utilized.

That is, in the embodiment of FIG. 26, two or more non-contrast images photographed at different time points t1 and t2 are matched to determine the extent of lesion progression in the anatomical object according to the photographing order so that the lesions are identified and displayed.

In detail, the control unit 1010 of the medical image display apparatus 100 obtains the non-contrast medical image 2601 taken at the time point t2 and the non-contrast medical image 2611 taken at the past time point t1, respectively. And create a matched fusion display.

The process of generating a fusion display includes image matching 2602 of non-contrast medical images taken at the time point t2 and non-contrast medical images taken at a past time point t1, and converting and propagating images generated according to the matching 2603. , Area correction 2604.

Here, segmentation and correction (2612) of certain anatomical entities, i.e., lymph nodes and blood vessel regions, for non-contrast medical images of a past time point t1, where standard image / model 2621 and / or medical image database ( The stored information of 2631 is utilized.

Various information is stored in the medical image database 2661, and the controller 1010 classifies and classifies data (including images) of conditions similar to the object (eg, age, gender, and progression of the lesion) among the stored information. A training process using the collected data may proceed to machine learning to predict the data (2632).

The controller 1010 loads a plurality of images corresponding to a condition similar to the object (age, gender, lesion progression, etc.) of the object from data stored in the standard image / model (2621), and the image of the loaded images. Matching 2622 and transformation and propagation 2623 may be performed. Here, the predicted data machine-learned in the image registration 2622 process may be further utilized.

The controller 1010 corrects the extracted lymph node / vascular region for the non-contrast medical image of the past time point t1 by using the machine learning 2632 and / or the data converted and propagated from the standard image / model ( 2612).

In addition, it may be used for transformation and propagation 2602 and region correction 2603 to correspond to the coordinates of two medical images. When region correction 2603 is complete, the resulting fused image is displayed as a registered image (2605).

As images are matched, transformed, propagated, and corrected sequentially, quantification is performed to compare changes in lymph nodes in non-contrast medical images at time t2 with respect to non-contrast medical images at another time t1. (2613), data from machine learning is further utilized in the process. The quantification result is then displayed 2614.

Meanwhile, the third medical image and / or the fourth medical image generated in the embodiments of the present invention as described above are stored in a medical image database or a standard image / model, and the stored images are matched / converted by machine learning or two or more images. / Radio waves may be used for image registration for identifying and displaying anatomical objects in other non-contrast images.

Hereinafter, a medical image processing method according to embodiments of the present invention will be described with reference to the drawings.

As illustrated in FIG. 27, a first medical image of an object including at least one anatomical object may be displayed on the display unit 1020 of the medical image display apparatus 1000 in operation S2701. Here, the first medical image may be a non-contrast medical image.

The image processor 1030 extracts reference region information corresponding to at least one anatomical object from the second medical image that is the reference image of the first medical image displayed in step S2701 under the control of the controller 1010 (S2703). Here, the second medical image may be a contrast-enhanced medical image obtained by capturing an object obtained with the first medical image at another time point. In another embodiment, the second medical image may be a standard image generated based on images having a condition similar to that of the object. In addition, the anatomical entity from which the information is extracted may be plural and include blood vessels, lymph nodes, bronchus, and the like. The reference area information of step S2703 may be extracted corresponding to a predetermined anatomical object using brightness values of pixels constituting the second medical image.

The controller 1010 controls the image processor 1030 to detect at least an area corresponding to the anatomical object in the first medical image displayed in step S2701 based on the reference area information in step S2703 (S2705).

In addition, the controller 1010 displays a third medical image in which the area detected in operation S2705 is distinguished from an area that is not a corresponding anatomical entity (S2707). Here, the third medical image is generated by matching the first medical image with the second medical image, and may include display area information on the anatomical object detected in operation S2705. The controller 1010 controls the display unit 1020 such that the region of the anatomical object is displayed separately from other regions in the third medical image based on the display region information.

The controller 1010 may display a fourth medical image in which the lesion extension area is divided and displayed in the anatomical object displayed in step S2705 (S2709).

Steps S2707 and S2709 may be performed during the image registration process of the first medical image and the second medical image. In addition, the third medical image displayed in step S2707 corresponds to the result of homozygous matching, and the fourth medical image displayed in step S2709 corresponds to the result of heterogeneous matching.

The medical image registration of steps S2707 and S2709 is performed using a predetermined conversion model parameter, and the result of the similarity measurement function between the first medical image and the second medical image is maximized, or the first medical image and the second medical image are maximized. It can be performed repeatedly until the result of the cost function of is minimized. In addition, homogeneous matching is performed to map the coordinate systems of the first medical image and the second medical image, and obtains conversion information in which the intrinsic characteristics of the anatomical object are maintained. Heterogeneous matching to obtain information may be performed sequentially.

According to the embodiment of the present invention as described above, a segmentation display function of an anatomical entity, for example, a lymph node and a blood vessel region, is provided based on a non-contrast image. In addition, non-contrast imaging based lymph node follow-up and quantification functions (Volume, Density, Shape, Distribution changes, etc.) are provided.

Each of the features of the various embodiments of the present invention may be combined or combined with each other in part or in whole, various technically interlocking and driving as can be understood by those skilled in the art, each of the embodiments may be implemented independently of each other It may be possible to carry out together in an association.

As described above, according to the embodiment of the present invention, lymph node follow-up examination is possible even in patients with weak renal function who are burdened to actively use the contrast agent.

On the other hand, various embodiments of the present invention as described above may be implemented in a computer-readable recording medium. Computer-readable recording media include transmission media and storage media that store data readable by a computer system. The transmission medium may be implemented through a wired or wireless network in which computer systems are interconnected.

Various embodiments of the present invention may be implemented by hardware and a combination of hardware and software. As hardware, the controller 1010 may include a nonvolatile memory in which a computer program, which is software, is stored, a RAM in which the computer program stored in the nonvolatile memory is loaded, and a CPU that executes a computer program loaded in the RAM. Nonvolatile memories include, but are not limited to, hard disk drives, flash memory, ROMs, CD-ROMs, magnetic tapes, floppy disks, optical storage, data transfer devices using the Internet, and the like. . The nonvolatile memory is an example of a computer-readable recording medium in which a computer-readable program of the present invention is recorded.

The computer program is code that the CPU can read and execute, and includes code for performing operations of the control unit 1010 such as steps S1801 to S1809 shown in FIG. 18 and steps S2301 to S2309 shown in FIG.

The computer program may be implemented by being included in software including an operating system or an application included in the medical image display apparatus 1000 and / or software for interfacing with an external device.

As mentioned above, the present invention has been described in detail through preferred embodiments, but the present invention is not limited thereto and may be variously implemented within the scope of the claims.

Claims

In the medical image display device,

A display unit configured to display a first medical image of an object including at least one anatomical object;

Extracting reference region information corresponding to the anatomical entity from at least one second medical image which is a reference image of the first medical image, and based on the extracted reference region information, the anatomical entity in the first medical image And at least one processor for detecting a region corresponding to the control unit and controlling the display unit to display the detected anatomical region separately from the non-anatomical region.
The method of claim 1,

The processor,

Generating a third medical image including display area information on the detected anatomical object in the first medical image by matching the first medical image with the second medical image;

And a display unit configured to control the display unit to display the detected anatomical object in a region different from the non-anatomical object in the generated third medical image based on the display area information.
The method of claim 1,

The anatomical entity is a plurality;

The display unit, characterized in that for displaying the areas of the plurality of anatomical objects are displayed separately.
The method of claim 1,

The first medical image is a non-contrast medical image,

The second medical image is a contrast-enhanced medical image, and the medical image display device, characterized in that the medical image obtained by capturing the object obtained the first medical image at another point in time.
The method of claim 1,

In the display unit, an area of the detected anatomical object is displayed separately from the non-anatomical area by at least one of color, pattern, pointer, highlight, and animation effect.

The divisional display of the region of the anatomical object may be activated or deactivated by user selection.
The method according to any one of claims 1 to 5,

The processor may further detect a lesion extension region in the region of the anatomical entity, and control the display unit to display the detected lesion extension region in a distinguishable manner within the region of the anatomical entity. Display.
The method according to any one of claims 2 to 5,

And the processor is configured to perform image registration using a predetermined conversion model parameter so that a result value of the similarity measurement function between the first medical image and the second medical image is maximized.
The method according to any one of claims 2 to 5,

And the processor performs image registration using a predetermined conversion model parameter so that a result value of the cost function of the first medical image and the second medical image is minimized.
The method according to any one of claims 2 to 5,

The processor,

Mapping a coordinate system of the first medical image and the second medical image,

And performing homogeneous matching on the first medical image and the second medical image to which the coordinate system is mapped, to match the first medical image while maintaining image characteristics of the second medical image. Video display.
The method of claim 9,

The processor,

And performing heterogeneous matching on the first medical image and the second medical image on which the homogeneous registration has been performed, by modifying image characteristics of the second medical image to completely match the first medical image. Medical image display device.
In the medical image processing method,

Displaying a first medical image of an object including at least one anatomical object;

Extracting reference region information corresponding to the anatomical object from at least one second medical image that is a reference image of the first medical image;

Detecting a region corresponding to the anatomical entity in the first medical image based on the extracted reference region information, and displaying the region of the detected anatomical entity separately from a region which is not the anatomical entity; Medical image processing method comprising a.
The method of claim 11,

And matching the first medical image with the second medical image to generate a third medical image including display area information on the detected anatomical object in the first medical image.

The distinguishing and displaying may include displaying the detected anatomical object in a region different from the non-anatomical object in the generated third medical image based on the display area information. Medical image processing method.
The method of claim 11,

The first medical image is a non-contrast medical image,

The second medical image is a contrast-enhanced medical image, medical image processing method, characterized in that the medical image obtained by imaging the object obtained the first medical image at another point in time.
The method according to any one of claims 11 to 13,

Detecting the lesion extension region in the region of the anatomically distinguished object and displaying the detected lesion extension region in the region of the anatomical entity. Way.
The method according to claim 12 or 13,

Generating the third medical image,

Mapping a coordinate system of the first medical image and the second medical image;

Performing homogeneous matching on the first medical image and the second medical image to which the coordinate system is mapped to the first medical image while maintaining image characteristics of the second medical image;

And performing heterogeneous matching on the first medical image and the second medical image on which the homogeneous registration has been performed, by modifying image characteristics of the second medical image to completely match the first medical image. Medical image processing method characterized in.