CN116157822A - Image registration method and device - Google Patents
Image registration method and device Download PDFInfo
- Publication number
- CN116157822A CN116157822A CN202080104993.0A CN202080104993A CN116157822A CN 116157822 A CN116157822 A CN 116157822A CN 202080104993 A CN202080104993 A CN 202080104993A CN 116157822 A CN116157822 A CN 116157822A
- Authority
- CN
- China
- Prior art keywords
- image
- medical image
- medical
- target
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 93
- 230000002194 synthesizing effect Effects 0.000 claims description 46
- 238000007408 cone-beam computed tomography Methods 0.000 description 11
- 238000002604 ultrasonography Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 238000007667 floating Methods 0.000 description 4
- 238000002595 magnetic resonance imaging Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000006854 communication Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000002591 computed tomography Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000007175 bidirectional communication Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 210000001519 tissue Anatomy 0.000 description 2
- 238000005481 NMR spectroscopy Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000001959 radiotherapy Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
Landscapes
- Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Engineering & Computer Science (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
An image registration method and device, the image registration method includes: acquiring a first medical image and a second medical image of a target object to be registered (201); outputting a first target viewing image to a display device based on the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device (202); image registration (203) is performed on the target object based on the first target observation image. In addition, the first medical image and the second medical image are alternately displayed, so that the operator can easily observe whether the first medical image and the second medical image are aligned or not, the repeated adjustment of transparency is not needed, the time of image registration is saved, and the efficiency of image registration is improved.
Description
The application relates to the technical field of medical treatment, in particular to an image registration method and device.
The image registration is a process of performing spatial matching on two images, and if the image A is to be registered to the image B, the image A is registered to the image B by taking the image B as a reference image and taking the image A as a floating image, so as to obtain a deformation field of the image A registered to the image B. The medical image registration technology is the basis of medical image processing and plays an important role in the fields of image information fusion, auxiliary diagnosis, operation planning, medical basic theory research and the like.
There are several ways to manually register the two images, and the operator can choose according to his own preference. In one image display mode, two images are displayed in superposition, the transparency of the images is adjusted by adjusting the slider to enhance the display of an image, for example, in registration with an electron computed tomography (Computed Tomography, CT) image and a cone beam electron computed tomography (Cone beam Computed Tomography, CBCT) image, the CT image is displayed (CBCT image is fully transparent) when the slider is adjusted to the far left, and the CBCT image is displayed (CT image is fully transparent) when the slider is adjusted to the far right.
When the image configuration is performed in this display mode, the operator needs to continuously drag the slide bar (adjust the transparency, from 0% to 100% or from 100% to 0%), observe whether the two images are aligned, manually adjust the images if not aligned, and then repeat the above procedure until the two images are completely aligned.
From the above, in the related art, the image registration in the image display mode needs to be performed separately for the operator to adjust the transparency and adjust the image position, so that the image registration time is long and the image registration efficiency is low.
The image registration method and device provided by the application save the time of image registration and improve the efficiency of image registration.
In one aspect, the present application provides an image registration method, including:
acquiring a first medical image and a second medical image of a target object to be registered;
outputting a first target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device;
and carrying out image registration on the target object according to the first target observation image.
In some embodiments of the present application, the outputting the first target observation image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes:
acquiring a preset image output time interval;
and according to the image output time interval, the first medical image and the second medical image are sequentially used as first target observation images and output to the display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the first target observation image is a dynamic image, and the outputting the first target observation image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes:
acquiring the preset image frame number of a first target observation image;
determining a first number of first medical images and a second number of second medical images required to generate the first target viewing image based on the image frame number;
synthesizing the first target observation image according to the first medical image number and the second medical image number;
outputting the first target observation image to a display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the synthesizing the first target viewing image according to the first number of first medical images and the second number of second medical images includes:
and synthesizing the first target observation images according to a preset quantity interval strategy by the first quantity of first medical images and the second quantity of second medical images.
In some embodiments of the present application, the first number and the second number are the same, and the synthesizing the first target observation image from the first number of first medical images and the second number of second medical images according to a preset number interval policy includes:
and synthesizing the first target observation images at intervals according to the first number of first medical images and the second number of second medical images in an equidistant mode.
In some embodiments of the present application, the second number is greater than the first number, and the synthesizing the first target observation image from the first number of first medical images and the second number of second medical images according to a preset number interval policy includes:
and synthesizing the first target observation images according to the first number of first medical images and the second number of second medical images in a spacing increasing mode.
In some embodiments of the present application, the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images in a pitch increasing manner includes:
Determining a plurality of second medical images corresponding to the number of each first medical image according to a mode of increasing the pitch equal ratio based on a preset first initial pitch and a preset pitch public ratio;
and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images in a pitch increasing manner includes:
determining a plurality of second medical images corresponding to the number of each first medical image in a pitch arithmetic increment mode based on a preset second initial pitch and a preset pitch tolerance;
and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and the performing image registration on the target object according to the first target observation image includes:
acquiring a frame rate adjustment instruction for adjusting the target observation image frame rate by a user;
According to the frame rate adjustment instruction, adjusting the frame rate of the target observed image to a second frame rate, and outputting a first target observed image with the adjusted frame rate;
and carrying out image registration on the target object based on the first target observation image with the adjusted frame rate.
In some embodiments of the present application, after the image registration of the target object according to the first target observation image, the method further includes:
acquiring a position adjustment instruction for the first medical image and/or the second medical image;
outputting a first target observation image after position adjustment according to the position adjustment instruction;
and carrying out image registration on the target object based on the first target observation image after the position adjustment.
In some embodiments of the present application, the method further comprises:
after each acquisition of a position adjustment instruction for the first medical image or the second medical image, acquiring time information of a current position adjustment instruction; and storing the target observation images corresponding to the time information to form a target observation image set with different times.
In some embodiments of the present application, the method further comprises:
acquiring a registration history backtracking instruction aiming at the target object, wherein the registration history backtracking instruction comprises backtracking time information;
Acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set;
and outputting the backtracking target observation image to the display device for display.
In some embodiments of the present application, the outputting the first target observation image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes:
outputting a first target observation image to a first display window of a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image in the first display window.
In some embodiments of the present application, the method further comprises:
acquiring a third medical image to be registered of a target object, wherein the third medical image is a medical image of a different type or a medical image shot at a different time of the same type as the first medical image;
outputting a second target observation image to a second display window of a display device according to the third medical image and the first medical image so as to alternately display the third medical image and the first medical image in the second display window;
Performing image registration on the target object according to the first target observation image and the second target observation image;
the first display window and the second display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application, the method further comprises:
acquiring a fourth medical image and a fifth medical image of a target object to be registered, wherein the fourth medical image is a medical image of a different type or a medical image shot at a different time of the same type as the fifth medical image, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are different;
outputting a third target observation image to a third display window of a display device according to the fourth medical image and the fifth medical image so as to alternately display the third medical image and the fourth medical image in the third display window;
performing image registration on the target object according to the first target observation image and the third target observation image;
the first display window and the third display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application, the method further comprises:
acquiring a replacement instruction for the first medical image;
acquiring a sixth medical image of the target object based on the replacement instruction, wherein the sixth medical image and the first medical image are the same type of medical image;
outputting a fourth target viewing image to a display device according to the sixth medical image and the second medical image to alternately display the second medical image and the sixth medical image on the display device;
and carrying out image registration on the target object based on the fourth target observation image.
In another aspect, the present application further provides an image registration method, including:
displaying an image registration interface for registering the target object;
and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface.
In some embodiments of the present application, the alternately displaying the first medical image and the second medical image of the target object to be registered on the image registration interface includes:
and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface at preset image output time intervals.
In some embodiments of the present application, the image registration interface includes a first display window and a second display window, and the alternately displaying, at the image registration interface, a first medical image and a second medical image to be registered of the target object includes:
alternately displaying a first medical image and a second medical image of the target object to be registered on the first display window
And alternately displaying a third medical image and the first medical image in the second display window, wherein the third medical image is a medical image of a different type or photographed at a different time from the first medical image.
In another aspect, the present application further provides an image registration apparatus, including:
the acquisition module is used for acquiring a first medical image and a second medical image of the target object to be registered;
the output module is used for outputting a first target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device;
and the registration module is used for registering the image of the target object according to the first target observation image.
In some embodiments of the present application, the output module is specifically configured to:
acquiring a preset image output time interval;
and according to the image output time interval, the first medical image and the second medical image are sequentially used as first target observation images and output to the display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the first target observation image is a moving image, and the output module is specifically configured to:
acquiring the preset image frame number of a first target observation image;
determining a first number of first medical images and a second number of second medical images required to generate the first target viewing image based on the image frame number;
synthesizing the first target observation image according to the first medical image number and the second medical image number;
outputting the first target observation image to a display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the output module is specifically configured to:
And synthesizing the first target observation images according to a preset quantity interval strategy by the first quantity of first medical images and the second quantity of second medical images.
In some embodiments of the present application, the first number and the second number are the same, and the output module is specifically configured to: and synthesizing the first target observation images at intervals according to the first number of first medical images and the second number of second medical images in an equidistant mode.
In some embodiments of the present application, the second number is greater than the first number, and the output module is specifically configured to:
and synthesizing the first target observation images according to the first number of first medical images and the second number of second medical images in a spacing increasing mode.
In some embodiments of the present application, the output module is specifically configured to:
determining a plurality of second medical images corresponding to the number of each first medical image according to a mode of increasing the pitch equal ratio based on a preset first initial pitch and a preset pitch public ratio;
and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the output module is specifically configured to:
determining a plurality of second medical images corresponding to the number of each first medical image in a pitch arithmetic increment mode based on a preset second initial pitch and a preset pitch tolerance;
and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and the registration module is specifically configured to:
acquiring a frame rate adjustment instruction for adjusting the target observation image frame rate by a user;
according to the frame rate adjustment instruction, adjusting the frame rate of the target observed image to a second frame rate, and outputting a first target observed image with the adjusted frame rate;
and carrying out image registration on the target object based on the first target observation image with the adjusted frame rate.
In some embodiments of the present application, the registration module is specifically further configured to:
after the target object is subjected to image registration according to the first target observation image, acquiring a position adjustment instruction aiming at a first medical image and/or a second medical image;
Outputting a first target observation image after position adjustment according to the position adjustment instruction;
and carrying out image registration on the target object based on the first target observation image after the position adjustment.
In some embodiments of the present application, the apparatus further includes a backtracking module, where the backtracking module is configured to:
after each acquisition of a position adjustment instruction for the first medical image or the second medical image, acquiring time information of a current position adjustment instruction; and storing the target observation images corresponding to the time information to form a target observation image set with different times.
In some embodiments of the present application, the backtracking module is further configured to:
acquiring a registration history backtracking instruction aiming at the target object, wherein the registration history backtracking instruction comprises backtracking time information;
acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set;
and outputting the backtracking target observation image to the display device for display.
In some embodiments of the present application, the output module is specifically configured to:
outputting a second target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on a first display window of the display device.
In some embodiments of the present application,
the acquisition module is further used for acquiring a third medical image to be registered of the target object, wherein the third medical image is a medical image of a different type or a medical image shot at a different time of the same type as the first medical image;
the output module is further configured to output a second target observation image to a display device according to the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in a second display window of the display device;
the registration module is further used for carrying out image registration on the target object according to the first target observation image and the second target observation image;
the first display window and the second display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application,
the acquisition module is further used for acquiring a fourth medical image and a fifth medical image to be registered of the target object, wherein the fourth medical image is a medical image of a different type or a medical image shot at a different time of the same type as the fifth medical image;
The output module is further configured to output a third target observation image to a display device according to the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in a third display window of the display device;
the registration module is further used for carrying out image registration on the target object according to the first target observation image and the third target observation image;
the first display window and the third display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application,
the acquisition module is further used for acquiring a sixth medical image of the target object, wherein the sixth medical image and the first medical image are the same type of medical image;
the output module is further configured to output a fourth target observation image to a display device according to the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device;
the registration module is further configured to perform image registration on the target object based on the fourth target observation image.
In another aspect, the present application also provides an image display apparatus, including:
the display module is used for displaying an image registration interface for registering the target object; after receiving a target observation image input by the electronic equipment, alternately displaying a first medical image and a second medical image to be registered of the target object on the image registration interface according to a preset time interval, wherein the target observation image is an image output by the electronic equipment based on the first medical image and the second medical image.
In another aspect, the present application further provides an electronic device, including:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps in the image registration method described above.
In another aspect, the present application also provides a computer readable storage medium having stored thereon a computer program to be loaded by a processor for performing the steps of the image registration method.
According to the image registration method and device, the first target observation image of the first medical image and the second medical image is alternately displayed to the display device through output, and because the operator can synchronously and manually adjust the image position in the alternate display process of the first medical image and the second medical image, the time for image adjustment is saved.
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of a scene of an image registration system provided in an embodiment of the present application;
FIG. 2 is a flow chart of one embodiment of an image registration method provided by embodiments of the present application;
FIG. 3 is a flow chart of one embodiment of step 202 in an embodiment of the present application;
FIG. 4 is a schematic flow chart of one embodiment of step 203 in the embodiments of the present application;
FIG. 5 is a schematic structural view of an embodiment of an image registration apparatus in an embodiment of the present application;
fig. 6 is a schematic structural diagram of an embodiment of an electronic device in an embodiment of the present application.
Embodiments of the present application
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
In the description of the present application, it should be understood that the terms "center," "longitudinal," "transverse," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate an orientation or positional relationship based on that shown in the drawings, merely for convenience of description and to simplify the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be configured and operated in a particular orientation, and thus should not be construed as limiting the present application. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more of the described features. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In this application, the term "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the application. In the following description, details are set forth for purposes of explanation. It will be apparent to one of ordinary skill in the art that the present application may be practiced without these specific details. In other instances, well-known structures and processes have not been shown in detail to avoid obscuring the description of the present application with unnecessary detail. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
The embodiment of the application provides an image registration method and device, and the method and device are described in detail below.
Referring to fig. 1, fig. 1 is a schematic view of a scenario of an image registration system provided in an embodiment of the present application, where the image registration system may include an image capturing device 100 and an electronic device 200, where the image capturing device 100 and the electronic device 200 are connected in a network, and an image registration apparatus, such as the electronic device in fig. 1, is integrated in the electronic device 200, and the image capturing device 100 may capture a medical image of a human body and output the medical image to the accessing electronic device 200.
The electronic device 200 in the embodiment of the present application is mainly used for acquiring a first medical image and a second medical image to be registered of a target object; outputting a target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device; and carrying out image registration on the target object according to the first target observation image.
In the embodiment of the present application, the image capturing device 100 may be a CT device, a CBCT device or other medical imaging devices, such as an ultrasound device (e.g. a B-ultrasound device or a color ultrasound device), a magnetic resonance imaging (Magnetic Resonance Imaging, MRI) device, or the like, which is not limited herein. In a specific application scenario, the first medical image is an image generated by CBCT in a radiotherapy device, and the second medical image may be an image generated by a CT device, CBCT device or other medical imaging device (e.g. ultrasound device, MRI device).
In the present embodiment, the electronic device 200 may be a device including receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing bidirectional communication over a bidirectional communication link. Such a device may include: a cellular or other communication device having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The specific electronic device 200 may be a desktop terminal or a mobile terminal, and the electronic device 200 may be one of a mobile phone, a tablet computer, a notebook computer, and the like.
It will be understood by those skilled in the art that the application environment shown in fig. 1 is merely an application scenario of the application scenario, and is not limited to the application scenario of the application scenario, other application environments may further include more or fewer electronic devices than those shown in fig. 1, or an electronic device network connection relationship, for example, only 1 electronic device and 1 image capturing device are shown in fig. 1, and it may be understood that the image registration system may further include one or more other electronic devices, or/and one or more other image capturing devices connected to the electronic device network, specifically, for example, one electronic device 200 is connected to a plurality of image capturing devices 100, that is, one electronic device 200 is connected to a plurality of electronic devices 200, that is, an image captured by one image capturing device 100 is output to a plurality of electronic devices 200 for display, which is not limited herein.
In addition, as shown in fig. 1, the image registration system may further comprise a memory 300 for storing data, such as medical image data, e.g. medical image data acquired by the image acquisition device 100.
It should be noted that, the schematic view of the image registration system shown in fig. 1 is only an example, and the image registration system and the scene described in the embodiments of the present application are for more clearly describing the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application, and those skilled in the art can know that, with the evolution of the image registration system and the appearance of a new service scenario, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.
First, an image registration method is provided in an embodiment of the present application, including: acquiring a first medical image and a second medical image of a target object to be registered; outputting a first target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device; and carrying out image registration on the target object according to the first target observation image.
As shown in fig. 2, a flowchart of an embodiment of an image registration method in an embodiment of the present application is shown, where the image registration method includes:
201. a first medical image and a second medical image of a target object to be registered are acquired.
202. And outputting a first target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device.
203. And carrying out image registration on the target object according to the first target observation image.
In the embodiment, a first medical image and a second medical image of a target object to be registered are acquired; outputting a first target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device; and carrying out image registration on the target object according to the first target observation image. According to the image registration method and device, the first target observation image of the first medical image and the second medical image is alternately displayed to the display device through output, and because the operator can synchronously and manually adjust the image position in the alternate display process of the first medical image and the second medical image, the time for image adjustment is saved.
In step 201, the target object may be a certain tissue or organ of the human body, such as a skull, a lung, a liver, or the like, and the first medical image and the second medical image are both medical images of the target object, i.e., medical images of the same tissue or organ, such as medical images of the brain of the user.
Specifically, the first medical image and the second medical image may be two-dimensional images or three-dimensional images in terms of dimensions, and may be CBCT images, CT images, ultrasound images (B-ultrasound images or color ultrasound images), magnetic resonance images, or the like in terms of image types, which are not limited herein. In addition, the first medical image and the second medical image may be the same type of medical image, for example, the first medical image and the second medical image are both CBCT images, the first medical image and the second medical image may also be different types of images, for example, the first medical image is a CBCT image, the second medical image is a CT image, etc., which is not limited herein.
The first medical image and the second medical image may be acquired by the image acquisition device in real time, or one of the first medical image and the second medical image may be acquired by the image acquisition device, and the other is a history medical image of the target object, or of course, both may be history medical images, which may be specifically used according to an actual scene, and the present invention is not limited herein.
In addition, in image registration, one image is generally used as a reference image, the other image is used as a floating image, which is also called a primary image and a secondary image, and in this embodiment of the present application, the first medical image may be a primary image or a secondary image, and the second medical image may be a primary image or a secondary image corresponding to the primary image or the secondary image, which is not limited herein specifically.
In step 202, the first target observation image may be an image that is alternately output by the first medical image and the second medical image, or may be a dynamic image that is synthesized by the first medical image and the second medical image, and in this case, various implementations are also described below for outputting the first target observation image to the display device according to the first medical image and the second medical image in step 202.
(1) The first target observation image may be an image in which the first medical image and the second medical image are alternately output.
The outputting the first target observation image to the display device according to the first medical image and the second medical image includes: acquiring a preset image output time interval; and according to the image output time interval, the first medical image and the second medical image are sequentially used as a first target observation image and are output to the display device.
The first target observation images alternately output by the first medical image and the second medical image are output to corresponding interfaces in the display device to be displayed, the first medical image and the second medical image are alternately displayed according to the image output time interval, and an operator can adjust the positions of the first medical image and/or the second medical image (adjustment and display are almost real-time) while observing the displayed alternating images until the first medical image and the second medical image are completely aligned. Compared with the existing image registration mode, in the process of switching the alternative images, an operator can synchronously and manually adjust the image positions, so that the time for adjusting the images is saved, in addition, the operator can easily observe whether the first medical image and the second medical image are aligned, the transparency is not required to be adjusted repeatedly, the time for image registration is saved, and the efficiency of image registration is improved.
The image output time interval is a time interval for switching between the first medical image and the second medical image, and may be preset as required, and the interval time may be 0.25 seconds, 0.5 seconds, 1 second, or the like, or may be a default value, for example, a default value of 0.25 seconds, or the like.
In one embodiment of setting the image output interval in this application, an "auto-switch" button may be set on the image registration interface of the display device, for example, after a slide bar for adjusting transparency of the medical image is set, when the "auto-switch" button is triggered, a drop-down list is displayed, where a plurality of options of 0.25 seconds, 0.5 seconds, or 1 second, etc. of alternative image output intervals are displayed, for example, after the operator selects the interval, the first target observation image under the image output interval starts to be displayed in the image registration interface.
In another mode, an "auto-switching" selection frame may be set on the image registration interface of the display device, and after selection, the first target observation image may be displayed in the image registration interface. The image output time interval may be a default value, or may be set by means of a "switching time" adjustment progress bar, a "switching time setting" button, etc., and it should be noted that in this embodiment, the interface display manner for setting the image output time interval may be various, and is not limited.
(2) The first target observation image is a dynamic image
The first target observation image may be a currently existing moving image format, such as a GIF image, or a moving image format that is newly appeared in the future, and only a moving image is needed here, which is not limited in particular
At this time, as shown in fig. 3, the outputting the first target observation image to the display device according to the first medical image and the second medical image in step 202 may further include:
301. and acquiring the preset image frame number of the first target observation image.
302. Based on the image frame number, a first number of first medical images and a second number of second medical images required to generate the first target viewing image are determined.
303. And synthesizing the first target observation image according to the first medical image number of the first number and the second medical image of the second number.
The generated dynamic images (first target observation images) are output to corresponding interfaces in a display device to be displayed, the first medical images and the second medical images are interactively displayed according to preset time intervals, and an operator can adjust the positions of the first medical images and/or the second medical images (adjustment and display are almost real-time) while observing the displayed dynamic images until the first medical images and the second medical images are completely aligned. Compared with the prior art, the technical scheme has the advantages that in the process of displaying the dynamic image, an operator can synchronously and manually adjust the position of the image, so that the time for adjusting the image is saved.
Similarly, in one embodiment, an "auto-switch" button may be provided on the image registration interface of the display device, for example, after a slider for adjusting transparency of the medical image is set, when the "auto-switch" button is triggered, a drop-down list is displayed, where a plurality of options of 0.25 seconds, 0.5 seconds, or 1 second for an image output interval are displayed, for example, after the operator selects the interval, the dynamic image under the image output interval starts to be displayed in the image registration interface.
In another mode, an automatic switching selection frame can be set on the image registration interface of the display device, and after selection, the dynamic image can be displayed in the image registration interface. The image output time interval may be a default value, or may be set by means of a "switching time" adjustment progress bar, a "switching time setting" button, or the like. In the embodiment of the present application, the interface display mode for setting the image output time interval may be various, and is not limited.
In some embodiments of the present application, the synthesizing the first target viewing image according to the first number of first medical images and the second number of second medical images includes: and synthesizing the first target observation images according to a preset quantity interval strategy by the first quantity of first medical images and the second quantity of second medical images.
Wherein the first number and the second number may be the same or different, and when the first number and the second number are the same, the synthesizing the first target observation image according to the first number of the first medical images and the second number of the second medical images may include: and synthesizing the first target observation images at intervals according to the first number of first medical images and the second number of second medical images in an equidistant mode.
The distance described in the embodiment of the present application may be a distance between two first medical images, or may be a distance between two second medical images, which may specifically be set according to an actual use scenario, and is not limited.
Specifically, for example, the first target observation image 121212,1 represents a first medical image, 2 represents a second medical image, the first medical image and the second medical image are combined at intervals of equal intervals of 1, and the first target observation image is a dynamic image composed of three first medical images and three second medical images. For example, the first target observation image 11221122 is a first target observation image obtained by synthesizing the first medical image and the second medical image at an equal interval of 2.
Since the first medical images are the primary images and the secondary images, and the primary images are not changed as the reference images, the number of frames of the secondary images in the dynamic images can be more, and therefore, in other embodiments of the present application, when the first medical images are the primary images, the second number is greater than the first number, and the secondary images as the floating images can be effectively observed.
In one embodiment, when the second number is greater than the first number, the synthesizing the first target observation image from the first number of first medical images and the second number of second medical images according to a preset number interval policy may include: and synthesizing the first target observation images according to the first number of first medical images and the second number of second medical images in a spacing increasing mode.
Specifically, the synthesizing the first target observation image by the first number of first medical images and the second number of second medical images according to the interval increasing mode includes: determining a plurality of second medical images corresponding to the number of each first medical image according to a mode of increasing the pitch equal ratio based on a preset first initial pitch and a preset pitch public ratio; and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
For example, the first target observation image 12122122221, wherein the initial spacing between the two first medical images is 1, i.e., one second medical image, and the spacing between the two first medical images is sequentially 1,2,4, in equal ratio increments.
In another embodiment, the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images in a pitch-increasing manner includes: determining a plurality of second medical images corresponding to the number of each first medical image in a pitch arithmetic increment mode based on a preset second initial pitch and a preset pitch tolerance; and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
For example, the first target observation image 1212212221, wherein the initial spacing between the two first medical images is 1, that is, one second medical image, and the spacing between the two first medical images is sequentially 1,2,3, in equal increments.
For dynamic images, there is also a frame rate, i.e. the number of images displayed per second, for example, the target observation image is composed of 6 images (3 first medical images and 3 second medical images), the frame rate is 2 frames/s, i.e. the target observation image can be dynamically displayed for 3s (subsequent cyclic display), one first medical image and one second medical image are displayed per second.
In this embodiment of the present application, the composite frame rate of the first target observation image may be a preset frame rate, for example, the frame rate of the first target observation image is the first frame rate, and the composite frame rate may be adjusted as required, and specifically, performing image registration on the target object according to the first target observation image may include: acquiring a frame rate adjustment instruction for adjusting the first target observation image frame rate by a user; according to the frame rate adjustment instruction, adjusting the frame rate of the first target observation image to a second frame rate, and outputting the first target observation image with the adjusted frame rate; and carrying out image registration on the target object based on the first target observation image with the adjusted frame rate.
For example, the second frame rate is 3 frames/second, and the first target observation image frame rate is adjusted from the first frame rate to the second frame rate, that is, the number of image frames of the first target observation image is the same, but the frame rate may be adjusted from 2 frames/s to 3 frames/second.
In some embodiments of the present application, in the image registration process, the image may be subjected to position adjustment registration, specifically, as shown in fig. 4, the performing image registration on the target object according to the first target observation image may include:
401. Position adjustment instructions for the first medical image and/or the second medical image are acquired.
Wherein the adjustment registration instruction may include position information of the first medical image adjustment, e.g. a first distance, e.g. 1mm, to the left. The position adjustment instruction may be a position adjustment instruction for the first medical image, or may be a position adjustment instruction for the second medical image, or the position adjustment instruction may include two pieces of position adjustment information, one piece of position adjustment information for the first medical image (for adjusting a position of the first medical image), and the other piece of position adjustment information for the second medical image, which is not limited specifically herein.
402. And outputting the first target observation image after position adjustment according to the position adjustment instruction.
403. And carrying out image registration on the target object based on the first target observation image after the position adjustment.
In this embodiment, the position of the medical image may be adjusted in real time, so as to generate a first target observation image with the adjusted position in real time, so that the subsequent registration is convenient to continue.
In some embodiments of the present application, during the image registration process, when the medical image is not satisfactory, a new medical image may also be acquired, and the previous medical image is replaced for re-registration, for example, when the first medical image needs to be replaced, specifically, the image registration method further includes: acquiring a replacement instruction for the first medical image; acquiring a sixth medical image of the target object based on the replacement instruction, wherein the sixth medical image and the first medical image are the same type of medical image; outputting a fourth target viewing image to a display device according to the sixth medical image and the second medical image to alternately display the second medical image and the sixth medical image on the display device; and carrying out image registration on the target object based on the fourth target observation image. Wherein the sixth medical image is an image that is image registered in place of the second medical image.
In some embodiments of the present application, the target observation images in each adjustment process in image registration may be stored, so that the target observation images are convenient for use in subsequent medical disputes or other scenes needing retrospective registration of images.
Specifically, in some embodiments of the present application, the image registration method may further include: after each acquisition of a position adjustment instruction for the first medical image or the second medical image, acquiring time information of a current position adjustment instruction; and storing the target observation images corresponding to the time information to form a target observation image set with different times. The method comprises the steps of firstly, storing a target observation image in the current alignment when the alignment is adjusted, and finally forming a time target observation image set after the alignment is completed, so that the subsequent retrospective checking of the registration record is facilitated.
Further, the image registration method may further include a backtracking step, and specifically, the image registration method may further include: acquiring a registration history backtracking instruction aiming at the target object, wherein the registration history backtracking instruction comprises backtracking time information; acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set; and outputting the backtracking target observation image to the display device for display. Specifically, a backtracking control may be displayed on an image registration interface of the display device, after a user clicks the backtracking control, a backtracking time input box or a selection box may be displayed, the backtracking time is determined, and after the user determines the backtracking time, a registration history backtracking instruction is generated, and based on the backtracking time information, a backtracking target observation image may be obtained in the target observation image set stored in the above embodiment.
In addition, in the embodiment of the application, one or more sets of target observation images may be output to the display device, and one or more display windows may be set on the image registration interface of the display device to display the sets of target observation images.
When the image registration interface of the display device includes a first display window, the outputting a second target viewing image to the display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes: outputting a second target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on a first display window of the display device. I.e. the first medical image and the second medical image are alternately displayed in a first display window of the display device.
The image registration interface of the display device may further include a second display window, where the first display window and the second display window are different, and the first display window and the second display window may be juxtaposed up and down or juxtaposed left and right, and the sizes of the first display window and the second display window may be the same or different, and may specifically be set according to an actual application scenario.
It should be noted that, in the embodiment of the present application, when the image registration interface of the display device includes a plurality of display windows, the images displayed by the plurality of display windows have various implementation manners, and the following is exemplified:
1. two sets of target observation images displayed by a plurality of display windows have the same medical image
Specifically, based on the first medical image and the second medical image, two target observation images output by the first medical image and the third medical image are both based on the first medical image as a reference standard.
At this time, in a specific embodiment, the image registration method further includes:
(1) A third medical image of the target object to be registered is acquired.
Wherein the third medical image is a medical image taken at a different time from the first medical image being a different type of medical image or the same type of medical image.
In this embodiment, the first medical image may be a reference medical image (or a primary image), and the second medical image and the third medical image may be floating images (or secondary images). At this time, the two sets of target observation images adopt the same reference medical images, so that mutual identification is convenient.
(2) Outputting a second target observation image to a display device according to the third medical image and the first medical image so as to alternately display the third medical image and the first medical image on a second display window of the display device.
The first display window and the second display window are two different display windows of the same display interface of the display device.
(3) And carrying out image registration on the target object according to the first target observation image and the second target observation image.
In this embodiment, the first medical image is associated with two different medical images: the second medical image and the third medical image are combined to output the first target observation image and the second target observation image to two different display windows of the display device, and the two display windows can form two dynamic registration pictures, so that a user can conveniently refer to the two dynamic registration pictures.
2. The medical images displayed by the multiple display windows and not commonly displayed by the two sets of target observation images are references with two dimensions
Specifically, based on the first medical image and the second medical image, the two target observation images output by the fourth medical image and the fifth medical image are different types of medical images or medical images shot at different times of the same type as the fifth medical image, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are all different.
At this time, the image registration method further includes:
(1) A fourth medical image and a fifth medical image of the target object to be registered are acquired.
The fourth medical image is a medical image taken at a different time from the fifth medical image being a different type of medical image or the same type of medical image.
(2) Outputting a third target observation image to a display device according to the fourth medical image and the fifth medical image so as to alternately display the third medical image and the fourth medical image on a third display window of the display device.
The first display window and the third display window are two different display windows of the same display interface of the display device.
(3) And carrying out image registration on the target object according to the first target observation image and the third target observation image.
It should be noted that, in the foregoing embodiment, the image registration interface of the display device is described only by way of example to display two display windows, and it is understood that a plurality of display windows may be displayed in practical application, for example, the first display window, the second display window, and the third display window described in the foregoing embodiment may be displayed simultaneously, which is not limited herein.
In addition, the medical images described in the embodiments of the present application, for example, the fourth medical image, the fifth medical image and the image, the sixth medical image, and the first medical image and the second medical image described in the foregoing embodiments may be referred to, and may be two-dimensional images or three-dimensional images in terms of dimensions, and may be CBCT images, CT images, ultrasound images (B-ultrasound images or color ultrasound images), nuclear magnetic resonance images, and the like in terms of image types, which are not limited herein in detail.
The embodiment of the application also provides an image display method, which is applied to a display device, and the method can comprise the following steps: displaying an image registration interface for registering the target object; and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface.
According to the embodiment of the application, the first medical image and the second medical image are alternately displayed on the display device, and because the operator can synchronously and manually adjust the image position in the alternate display process of the medical images, the time for adjusting the images is saved.
The alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface comprises the following steps: and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface at preset image output time intervals.
An "auto-switch" button may be provided on the image registration interface of the display device, for example, after a slider for adjusting transparency of the medical image is provided, and when the "auto-switch" button is triggered, a drop-down list is displayed, where a plurality of options of 0.25 seconds, 0.5 seconds, or 1 second, etc. of image output intervals for selection are displayed, for example, after the operator selects the interval time, that is, after determining the preset interval time, the first medical image and the second medical image to be registered of the target object begin to be displayed alternately in the image registration interface.
Further, the image registration interface includes a first display window and a second display window, and the alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface includes: alternately displaying a first medical image and a second medical image of the target object to be registered on the first display window; and alternately displaying a third medical image and the first medical image in the second display window, wherein the third medical image is a medical image of a different type or photographed at a different time from the first medical image.
Further, the image registration interface includes a third display window, and the displaying, alternately, the first medical image and the second medical image to be registered of the target object on the image registration interface includes: and alternately displaying a fourth medical image and a fifth medical image in the third display window, wherein the fourth medical image is a medical image of a different type or photographed at a different time from the fifth medical image, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are different.
Furthermore, the image registration interface of the display device can further comprise an image storage control for enabling a user to manually click and store the target observation image corresponding to the medical image which is displayed alternately. Furthermore, the image registration interface at the display device may further comprise a position adjustment control for adjusting two medical images to be registered, such as a first medical image and a second medical image, the method further comprising: when a user clicks the position adjustment control, collecting time information of clicking the position adjustment control; storing the target observation images corresponding to the time information to form a target observation image set with different times
Further, a backtracking control may be displayed on an image registration interface of the display device, after the user clicks the backtracking control, a backtracking time input frame or a selection frame may be displayed, the backtracking time is determined, and after the user determines the backtracking time, a registration history backtracking instruction is generated, and based on the backtracking time information, a backtracking target observation image may be obtained in the target observation image set stored in the above embodiment.
Specifically, the image display method may further include a backtracking step, and specifically, the image registration method may further include: acquiring a registration history backtracking instruction generated by clicking the backtracking control by a user, wherein the registration history backtracking instruction comprises backtracking time information; acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set; and displaying the backtracking target observation image on the image registration interface.
Further, the image registration interface includes a first display window and a second display window, and the image display method may further include: when a first target observation image and a second target observation image are acquired, displaying the first target observation image on a first display window of the image registration interface so as to alternately display the first medical image and the second medical image, and displaying the second target observation image on a second display window of the image registration interface so as to alternately display the first medical image and a third medical image, wherein the third medical image is a medical image of a different type or a medical image shot at a different time from the first medical image.
Further, the image display method may further include: when a first target observation image and a third target observation image are acquired, displaying the first target observation image on a first display window of the image registration interface so as to alternately display the first medical image and the second medical image, and displaying the third target observation image on a second display window of the image registration interface so as to alternately display the fourth medical image and the fifth medical image, wherein the fourth medical image is a medical image of a different type or a medical image shot at a same type and different from the fifth medical image, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are all different.
In order to better implement the image registration method in the embodiment of the present application, based on the image registration method, an image registration apparatus is further provided in the embodiment of the present application, as shown in fig. 5, the image registration apparatus 500 includes:
an acquisition module 501, configured to acquire a first medical image and a second medical image of a target object to be registered;
an output module 502, configured to output a first target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device;
And the registration module 503 is configured to perform image registration on the target object according to the first target observation image.
The method comprises the steps that a first medical image and a second medical image of a target object to be registered are acquired through an acquisition module 501; the output module 502 outputs a target observation image to a display device according to the first medical image and the second medical image, so as to alternately display the first medical image and the second medical image on the display device; the registration module 503 performs image registration on the target object according to the first target observation image. According to the method and the device, the target observation images of the first medical image and the second medical image are alternately displayed to the display device through output, and because in the process of alternately displaying the images in the target observation images, an operator can synchronously and manually adjust the positions of the images, so that the time for adjusting the images is saved.
In some embodiments of the present application, the output module 502 is specifically configured to:
Acquiring a preset image output time interval;
and according to the image output time interval, the first medical image and the second medical image are sequentially used as first target observation images and output to the display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the first target observation image is a moving image, and the output module 502 is specifically configured to:
acquiring the preset image frame number of a first target observation image;
determining a first number of first medical images and a second number of second medical images required to generate the first target viewing image based on the image frame number;
synthesizing the first target observation image according to the first medical image number and the second medical image number;
outputting the first target observation image to a display device so as to alternately display the first medical image and the second medical image on the display device.
In some embodiments of the present application, the output module 502 is specifically configured to:
and synthesizing the first target observation images according to a preset quantity interval strategy by the first quantity of first medical images and the second quantity of second medical images.
In some embodiments of the present application, the first number and the second number are the same, and the output module is specifically configured to: and synthesizing the first target observation images at intervals according to the first number of first medical images and the second number of second medical images in an equidistant mode.
In some embodiments of the present application, the second number is greater than the first number, and the output module is specifically configured to:
and synthesizing the first target observation images according to the first number of first medical images and the second number of second medical images in a spacing increasing mode.
In some embodiments of the present application, the output module 502 is specifically configured to:
determining a plurality of second medical images corresponding to the number of each first medical image according to a mode of increasing the pitch equal ratio based on a preset first initial pitch and a preset pitch public ratio;
and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the output module 502 is specifically configured to:
determining a plurality of second medical images corresponding to the number of each first medical image in a pitch arithmetic increment mode based on a preset second initial pitch and a preset pitch tolerance;
And sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
In some embodiments of the present application, the frame rate of the first target observation image is a first frame rate, and the registration module 503 is specifically configured to:
acquiring a frame rate adjustment instruction for adjusting the target observation image frame rate by a user;
according to the frame rate adjustment instruction, adjusting the frame rate of the target observed image to a second frame rate, and outputting a first target observed image with the adjusted frame rate;
and carrying out image registration on the target object based on the first target observation image with the adjusted frame rate.
In some embodiments of the present application, the registration module 503 is specifically further configured to:
after the target object is subjected to image registration according to the first target observation image, acquiring a position adjustment instruction aiming at a first medical image and/or a second medical image;
outputting a first target observation image after position adjustment according to the position adjustment instruction;
and carrying out image registration on the target object based on the first target observation image after the position adjustment.
In some embodiments of the present application, the apparatus further includes a backtracking module, where the backtracking module is configured to:
After each acquisition of a position adjustment instruction for the first medical image or the second medical image, acquiring time information of a current position adjustment instruction; and storing the target observation images corresponding to the time information to form a target observation image set with different times.
In some embodiments of the present application, the backtracking module is further configured to:
acquiring a registration history backtracking instruction aiming at the target object, wherein the registration history backtracking instruction comprises backtracking time information;
acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set;
and outputting the backtracking target observation image to the display device for display.
In some embodiments of the present application, the output module 502 is specifically configured to:
outputting a second target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on a first display window of the display device.
In some embodiments of the present application,
the acquiring module 501 is further configured to acquire a third medical image to be registered of the target object, where the third medical image is a medical image of a different type or a medical image captured at a different time from the first medical image;
The output module 502 is further configured to output a second target observation image to a display device according to the third medical image and the first medical image, so as to alternately display the third medical image and the first medical image in a second display window of the display device;
the registration module 503 is further configured to perform image registration on the target object according to the first target observation image and the second target observation image;
the first display window and the second display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application,
the acquiring module 501 is further configured to acquire a fourth medical image and a fifth medical image to be registered of the target object, where the fourth medical image is a medical image of a different type or a medical image captured at a different time from the fifth medical image;
the output module 502 is further configured to output a third target observation image to a display device according to the fourth medical image and the fifth medical image, so as to alternately display the third medical image and the fourth medical image in a third display window of the display device;
The registration module 503 is further configured to perform image registration on the target object according to the first target observation image and the third target observation image;
the first display window and the third display window are two different display windows of the same display interface of the display device.
In some embodiments of the present application,
the acquiring module 501 is further configured to acquire a sixth medical image of the target object, where the sixth medical image is a medical image of the same type as the first medical image;
the output module 502 is further configured to output a fourth target observation image to a display device according to the sixth medical image and the second medical image, so as to alternately display the second medical image and the sixth medical image on the display device;
the registration module 503 is further configured to perform image registration on the target object based on the fourth target observation image.
The present application also provides an image display apparatus, the apparatus including:
the display module is used for displaying an image registration interface for registering the target object; after receiving a target observation image input by the electronic equipment, alternately displaying a first medical image and a second medical image to be registered of the target object on the image registration interface according to a preset time interval, wherein the target observation image is an image output by the electronic equipment based on the first medical image and the second medical image.
According to the method and the device for displaying the first medical image and the second medical image alternately on the display device, the operator can synchronously and manually adjust the image position in the alternate display process of the images in the target observation image, so that the time for adjusting the images is saved, in addition, the alternate display of the target observation image enables the operator to easily observe whether the first medical image and the second medical image are aligned or not, repeated adjustment of transparency is not needed, the time for image registration is saved, and the efficiency of image registration is improved.
The embodiment of the application also provides an electronic device, which integrates any one of the image registration devices provided by the embodiment of the application, and the electronic device comprises:
one or more processors;
a memory;
and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to perform the steps of the image registration method described in any of the above-described image registration method embodiments.
The embodiment of the application also provides electronic equipment, which integrates any one of the image registration methods provided by the embodiment of the application. As shown in fig. 6, a schematic structural diagram of an electronic device according to an embodiment of the present application is shown, specifically:
The electronic device may include one or more processing cores 'processors 601, one or more computer-readable storage media's memory 602, power supply 603, and input unit 604, among other components. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 6 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. Wherein:
the processor 601 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 602, and calling data stored in the memory 602, thereby performing overall monitoring of the electronic device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, etc., and the modem processor primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 601.
The memory 602 may be used to store software programs and modules, and the processor 601 may execute various functional applications and data processing by executing the software programs and modules stored in the memory 602. The memory 602 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide access to the memory 602 by the processor 601.
The electronic device further comprises a power supply 603 for supplying power to the various components, preferably the power supply 603 may be logically connected to the processor 601 by a power management system, so that functions of managing charging, discharging, power consumption management and the like are achieved by the power management system. The power supply 603 may also include one or more of any components, such as a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The electronic device may further comprise an input unit 604, which input unit 604 may be used for receiving input digital or character information and for generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.
Although not shown, the electronic device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 601 in the electronic device loads executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 executes the application programs stored in the memory 602, so as to implement various functions as follows:
acquiring a first medical image and a second medical image of a target object to be registered;
outputting a target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device;
and carrying out image registration on the target object according to the first target observation image.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, embodiments of the present application provide a computer readable storage medium, which may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like. On which a computer program is stored, which is loaded by a processor to perform the steps of any of the image registration methods provided by the embodiments of the present application. For example, the loading of the computer program by the processor may perform the steps of:
acquiring a first medical image and a second medical image of a target object to be registered;
outputting a target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device;
and carrying out image registration on the target object according to the first target observation image.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of one embodiment that are not described in detail in the foregoing embodiments may be referred to in the foregoing detailed description of other embodiments, which are not described herein again.
In the implementation, each unit or structure may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit or structure may be referred to the foregoing method embodiments and will not be repeated herein.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
The foregoing has described in detail a method and apparatus for image registration provided by embodiments of the present application, and specific examples have been applied herein to illustrate principles and implementations of the present application, where the foregoing description of the embodiments is only for aiding in understanding of the method and core ideas of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.
Claims (20)
- An image registration method, characterized in that the image registration method comprises:acquiring a first medical image and a second medical image of a target object to be registered;outputting a first target viewing image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device;and carrying out image registration on the target object according to the first target observation image.
- The image registration method according to claim 1, wherein the outputting the first target observation image to the display device based on the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes:Acquiring a preset image output time interval;and according to the image output time interval, the first medical image and the second medical image are sequentially used as first target observation images and output to the display device so as to alternately display the first medical image and the second medical image on the display device.
- The image registration method according to claim 1, wherein the first target observation image is a dynamic image, and the outputting the first target observation image to a display device according to the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device includes:acquiring the preset image frame number of a first target observation image;determining a first number of first medical images and a second number of second medical images required to generate the first target viewing image based on the image frame number;synthesizing the first target observation image according to the first medical image number and the second medical image number;outputting the first target observation image to a display device so as to alternately display the first medical image and the second medical image on the display device.
- The image registration method of claim 3, wherein the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images comprises:and synthesizing the first target observation images according to a preset quantity interval strategy by the first quantity of first medical images and the second quantity of second medical images.
- The image registration method according to claim 4, wherein the first number and the second number are the same, and the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images according to a preset number interval policy includes:and synthesizing the first target observation images at intervals according to the first number of first medical images and the second number of second medical images in an equidistant mode.
- The image registration method according to claim 4, wherein the second number is greater than the first number, the synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images according to a preset number interval strategy, comprising:And synthesizing the first target observation images according to the first number of first medical images and the second number of second medical images in a spacing increasing mode.
- The image registration method of claim 6, wherein synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images in a pitch-wise manner comprises:determining a plurality of second medical images corresponding to the number of each first medical image according to a mode of increasing the pitch equal ratio based on a preset first initial pitch and a preset pitch public ratio;and sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
- The image registration method of claim 6, wherein synthesizing the first target viewing image from the first number of first medical images and the second number of second medical images in a pitch-wise manner comprises:determining a plurality of second medical images corresponding to the number of each first medical image in a pitch arithmetic increment mode based on a preset second initial pitch and a preset pitch tolerance;And sequentially synthesizing the first target observation images according to the pairing of each first medical image and the corresponding plurality of second medical images.
- The image registration method according to claim 3, wherein the frame rate of the first target observation image is a first frame rate, and the image registering the target object according to the first target observation image includes:acquiring a frame rate adjustment instruction for adjusting the target observation image frame rate by a user;according to the frame rate adjustment instruction, adjusting the frame rate of the target observed image to a second frame rate, and outputting a first target observed image with the adjusted frame rate;and carrying out image registration on the target object based on the first target observation image with the adjusted frame rate.
- The image registration method according to claim 1, wherein after the image registration of the target object from the first target observation image, the method further comprises:acquiring a position adjustment instruction for the first medical image and/or the second medical image;outputting a first target observation image after position adjustment according to the position adjustment instruction;and carrying out image registration on the target object based on the first target observation image after the position adjustment.
- The image registration method of claim 10, wherein the method further comprises:after each acquisition of a position adjustment instruction for the first medical image or the second medical image, acquiring time information of a current position adjustment instruction;and storing the target observation images corresponding to the time information to form a target observation image set with different times.
- The image registration method of claim 11, wherein the method further comprises:acquiring a registration history backtracking instruction aiming at the target object, wherein the registration history backtracking instruction comprises backtracking time information;acquiring a backtracking target observation image corresponding to the backtracking time information in the target observation image set;and outputting the backtracking target observation image to the display device for display.
- The image registration method of claim 1, wherein the outputting a first target viewing image to a display device based on the first medical image and the second medical image to alternately display the first medical image and the second medical image on the display device comprises:outputting a first target observation image to a first display window of a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image in the first display window.
- The image registration method of claim 13, wherein the method further comprises:acquiring a third medical image to be registered of a target object, wherein the third medical image is a medical image of a different type or a medical image shot at a different time of the same type as the first medical image;outputting a second target observation image to a second display window of a display device according to the third medical image and the first medical image so as to alternately display the third medical image and the first medical image in the second display window;performing image registration on the target object according to the first target observation image and the second target observation image;the first display window and the second display window are two different display windows of the same display interface of the display device.
- The image registration method of claim 13, wherein the method further comprises:acquiring a fourth medical image and a fifth medical image of a target object to be registered, wherein the fourth medical image is a medical image of a different type or a medical image shot at a different time of the same type as the fifth medical image, and the fourth medical image, the fifth medical image, the first medical image and the second medical image are different;Outputting a third target observation image to a third display window of a display device according to the fourth medical image and the fifth medical image so as to alternately display the third medical image and the fourth medical image in the third display window;performing image registration on the target object according to the first target observation image and the third target observation image;the first display window and the third display window are two different display windows of the same display interface of the display device.
- The image registration method of claim 1, wherein the method further comprises:acquiring a replacement instruction for the first medical image;acquiring a sixth medical image to be registered of the target object based on the replacement instruction, wherein the sixth medical image and the first medical image are the same type of medical image;outputting a fourth target viewing image to a display device according to the sixth medical image and the second medical image to alternately display the second medical image and the sixth medical image on the display device;and carrying out image registration on the target object based on the fourth target observation image.
- An image display method, the method comprising:displaying an image registration interface for registering the target object;and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface.
- The image display method according to claim 17, wherein the alternately displaying the first medical image and the second medical image to be registered of the target object at the image registration interface includes:and alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface at preset image output time intervals.
- The image display method according to claim 17, wherein the image registration interface includes a first display window and a second display window, and the alternately displaying the first medical image and the second medical image to be registered of the target object on the image registration interface includes:alternately displaying a first medical image and a second medical image to be registered of the target object on the first display window;and alternately displaying a third medical image and the first medical image in the second display window, wherein the third medical image is a medical image of a different type or photographed at a different time from the first medical image.
- An image registration apparatus, characterized in that the image registration apparatus comprises:the acquisition module is used for acquiring a first medical image and a second medical image of the target object to be registered;the output module is used for outputting a first target observation image to a display device according to the first medical image and the second medical image so as to alternately display the first medical image and the second medical image on the display device;and the registration module is used for registering the image of the target object according to the first target observation image.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2020/114462 WO2022051977A1 (en) | 2020-09-10 | 2020-09-10 | Image registration method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116157822A true CN116157822A (en) | 2023-05-23 |
Family
ID=80630245
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202080104993.0A Pending CN116157822A (en) | 2020-09-10 | 2020-09-10 | Image registration method and device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN116157822A (en) |
WO (1) | WO2022051977A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115474992A (en) * | 2022-09-21 | 2022-12-16 | 数坤(上海)医疗科技有限公司 | Needle insertion position determination method and device, electronic equipment and readable storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7885440B2 (en) * | 2004-11-04 | 2011-02-08 | Dr Systems, Inc. | Systems and methods for interleaving series of medical images |
JP2011077821A (en) * | 2009-09-30 | 2011-04-14 | Casio Computer Co Ltd | Image synthesis device and method, and program |
US20130093781A1 (en) * | 2010-03-31 | 2013-04-18 | Hitachi Medical Corporation | Examination information display device and method |
CN106934807A (en) * | 2015-12-31 | 2017-07-07 | 深圳迈瑞生物医疗电子股份有限公司 | A kind of medical image analysis method, system and Medical Devices |
US20190206036A1 (en) * | 2017-12-20 | 2019-07-04 | Al Analysis, Inc. | Method and system that use super flicker to facilitate image comparison |
CN111405199A (en) * | 2020-03-27 | 2020-07-10 | 维沃移动通信(杭州)有限公司 | Image shooting method and electronic equipment |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104574270A (en) * | 2015-01-12 | 2015-04-29 | 青岛易科锐自动化技术有限公司 | Screen alternate display method in proofreading |
CN106157282A (en) * | 2015-03-31 | 2016-11-23 | 深圳迈瑞生物医疗电子股份有限公司 | Image processing system and method |
CN112967236B (en) * | 2018-12-29 | 2024-02-27 | 上海联影智能医疗科技有限公司 | Image registration method, device, computer equipment and storage medium |
-
2020
- 2020-09-10 WO PCT/CN2020/114462 patent/WO2022051977A1/en active Application Filing
- 2020-09-10 CN CN202080104993.0A patent/CN116157822A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7885440B2 (en) * | 2004-11-04 | 2011-02-08 | Dr Systems, Inc. | Systems and methods for interleaving series of medical images |
JP2011077821A (en) * | 2009-09-30 | 2011-04-14 | Casio Computer Co Ltd | Image synthesis device and method, and program |
US20130093781A1 (en) * | 2010-03-31 | 2013-04-18 | Hitachi Medical Corporation | Examination information display device and method |
CN106934807A (en) * | 2015-12-31 | 2017-07-07 | 深圳迈瑞生物医疗电子股份有限公司 | A kind of medical image analysis method, system and Medical Devices |
US20190206036A1 (en) * | 2017-12-20 | 2019-07-04 | Al Analysis, Inc. | Method and system that use super flicker to facilitate image comparison |
CN111405199A (en) * | 2020-03-27 | 2020-07-10 | 维沃移动通信(杭州)有限公司 | Image shooting method and electronic equipment |
Non-Patent Citations (1)
Title |
---|
李加元: "鲁棒性遥感影像特征匹配关键问题研究", 《中国博士学位论文全文数据库 (工程科技Ⅱ辑)》, no. 6, 15 June 2020 (2020-06-15) * |
Also Published As
Publication number | Publication date |
---|---|
WO2022051977A1 (en) | 2022-03-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101470411B1 (en) | Medical image display method using virtual patient model and apparatus thereof | |
CN111754553B (en) | Multi-mode scanning image registration method, device, computer equipment and storage medium | |
JP5355638B2 (en) | Image processing apparatus and method, and program | |
CN102125432B (en) | Medical image diagnostic apparatus and medical image display apparatus | |
CN106388851A (en) | Arranging position control method and device | |
US10203386B2 (en) | Method and apparatus for setting a scanning protocol for conducting a medical examination | |
KR101728044B1 (en) | Method and apparatus for displaying medical image | |
JP2012010275A (en) | Information processing device, information processing method and program thereof | |
US20090220135A1 (en) | System, server, method and program for image transfer | |
CN116157822A (en) | Image registration method and device | |
US9269395B2 (en) | Display control apparatus, display apparatus, and method for controlling the same | |
CN111815514A (en) | Image acquisition method and device, readable storage medium and image acquisition equipment | |
CN103620643B (en) | The scaling of medical image | |
CN107049346B (en) | Medical imaging control method, medical imaging control device and medical imaging equipment | |
WO2020173055A1 (en) | Vrds 4d medical image multi-device ai interconnected display method and product | |
EP3785227B1 (en) | Automated subject monitoring for medical imaging | |
CN108461128A (en) | Medical image processing method and system and image processing terminal | |
JP2005012248A (en) | Method and apparatus of assisting image reading | |
CN106296707A (en) | Medical image processing method and device | |
CN112348801A (en) | Infrared thermal imaging analysis method, equipment and system | |
CN110693513A (en) | Control method, system and storage medium for multi-modal medical system | |
US20230064516A1 (en) | Method, device, and system for processing medical image | |
CN113633306B (en) | Image processing method and related device, electronic equipment and storage medium | |
CN111768843B (en) | Medical imaging device control method and device, medical imaging device and method | |
JP6930638B2 (en) | Dynamic analysis device, dynamic analysis program, dynamic analysis method and control device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |