CN108833883A - A kind of system and method for real-time generation and display 2D/3D image and image - Google Patents
A kind of system and method for real-time generation and display 2D/3D image and image Download PDFInfo
- Publication number
- CN108833883A CN108833883A CN201810977794.5A CN201810977794A CN108833883A CN 108833883 A CN108833883 A CN 108833883A CN 201810977794 A CN201810977794 A CN 201810977794A CN 108833883 A CN108833883 A CN 108833883A
- Authority
- CN
- China
- Prior art keywords
- image
- signal
- equipment
- infrared
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to a kind of system and method generated in real time with display 2D/3D image and image, system includes：Light source feedway, camera apparatus, image procossing and display equipment；Light source feedway exposes to target pathological tissues for emitting multiple laser signal；Target pathological tissues are scattered multiple laser signal, reflect generation visible light signal, two area's signal of one area's signal of near-infrared and near-infrared；Each camera apparatus is in the top of target pathological tissues, for capturing two area's signal of visible light signal, one area's signal of near-infrared and near-infrared, forms 2D/3D image and video signal, and be sent to image procossing and display equipment；Image procossing is connected with display equipment with each camera apparatus, and for receiving 2D/3D image and video signal, by being superimposed, synthesis handles to obtain 2D/3D image and image, and show 2D/3D image and image.2D/3D image and image can be generated and shown in real time using above system or method, facilitate Clinics and Practices.
Description
Technical field
This application involves medical domains, and in particular to a kind of system generated in real time with display 2D/3D image and image and
Method.
Background technique
In the field of medicine, the method for being the most direct and most basic diagnosis of medical staff and treating sufferer is visually observed.
What the naked eyes of human body were able to observe that is only limitted to the information of visible light wave range, and complicated and diversified pathological tissue naked eyes can not be seen
It observes, so medical staff then needs to check pathological tissue by medical imaging equipment, Clinics and Practices.Therefore, it cures
Treating image documentation equipment becomes particularly important.
Existing medical imaging equipment is that body tissue is imaged using light, electricity or acoustic effect etc. mostly.For example,
The principle of near infrared imaging is the fluorescent material injected in body tissue, inspires near-infrared under the irradiation of specific wavelength laser
Then fluorescence is captured by corresponding imaging device, is imaged, and shown on Medical Devices to facilitate doctor to check,
Diagnosis.Common medical image Medical Devices have：X-ray imaging equipment, CT machine, near-infrared image forming apparatus etc..In the prior art
In, when medical staff by medical imaging device when being treated, since the imaging of different light sources is in different imaging devices
It is upper separation display, and be imaged separated with operation interface, this will lead in the prior art can not real-time display doctor diagnose,
Treat the image and image in operating process.
Summary of the invention
To be overcome the problems, such as present in the relevant technologies at least to a certain extent, the application provide it is a kind of can generate in real time with
Show 2D/3D image and image system and method, in order to solve can not real-time display diagnosis, treatment operating process
In image and image the problem of.
The application provides a kind of system that can be generated in real time with display 2D/3D image and image, including：Light source supply dress
It sets, camera apparatus, image procossing and display equipment；
The light source feedway exposes to target pathological tissues for emitting multiple laser signal；
The multiple laser signal is generated visible light signal by scattering, reflection by the target pathological tissues, will be described
Multiple laser signal generates one area's signal of near-infrared and two area's signal of near-infrared by excitation；
Each camera apparatus is in the top of the target pathological tissues, for capturing the visible light signal, institute
It states one area's signal of near-infrared and two area's signal of near-infrared and forms 2D/3D image and video signal, and the 2D/3D is schemed
Picture and image signal transmitting to described image processing and show equipment；
Described image processing is connected with equipment is shown with each camera apparatus, for receive the 2D/3D image and
Video signal handles to obtain 2D/3D image and image, and shows the 2D/3D image and image by being superimposed synthesis.
Optionally, real-time generate further includes with the system of display 2D/3D image and image：Augmented reality drives mould
Block, augmented reality hardware device；
The augmented reality driving equipment is connected with described image processing with display equipment, for receiving at described image
The 2D/3D image and image that reason is sent with display equipment, and drive the augmented reality hardware device；
The augmented reality hardware device is connected with the augmented reality drive module, for showing, being superimposed the 2D/
3D rendering and image and real outdoor scene obtain augmented reality 2D/3D image and image and show the augmented reality 2D/3D image
And image.
Optionally, the real-time system generated with display 2D/3D image and image, the augmented reality hardware device
Including：Augmented reality glasses and/or augmented reality display.
Optionally, the light source feedway includes：Light source matrix equipment, optical switching matrix equipment, light-emitting device；
The light source matrix equipment is for issuing multiple laser signal；
The optical switching matrix equipment is connected with the light source matrix equipment, for receiving the multiple laser signal,
And the multiple laser signal is sent to the light-emitting device；
The light-emitting device includes at least two light emitting heads；
The light-emitting device is connected with the optical switching matrix equipment, for receiving the multiple laser signal and shining
It is incident upon target pathological tissues.
Optionally, the camera apparatus includes：Visible Light Camera submodule, one area's camera submodule of near-infrared and near-infrared
Two area's camera submodules.
The Visible Light Camera submodule is for receiving visible light signal and generating visible light signal；
One area's camera submodule of near-infrared is for receiving one area's signal of near-infrared and generating one area's signal of near-infrared；
Two area's camera submodule of near-infrared is for receiving two area's signal of near-infrared and generating two area's signal of near-infrared.
Optionally, described image processing and display equipment include that external source image interface is received by the external source image interface
The external 2D/3D image and image that external image equipment is sent.
The application also provides a kind of method generated in real time with display 2D/3D image and image, including：
Obtain 2D/3D image and video signal；The visible light that the 2D/3D image and video signal are obtained by camera apparatus
Signal, one area's signal of near-infrared and two area's signal of near-infrared form；
It is superimposed, synthesizes the 2D/3D image and video signal, generate 2D/3D image and image；
Show the 2D/3D image and image.
Optionally, real-time generate further includes with the method for display 2D/3D image and image：The 2D/3D is schemed
Picture and image are sent to augmented reality drive module, for driving augmented reality equipment.
Optionally, real-time generate further includes with the method for display 2D/3D image and image：External image is received to set
The external 2D/3D image and video signal that preparation is sent.
Optionally, real-time generate further includes with the method for display 2D/3D image and image：
2D/3D image and image integrated and that be superimposed the external 2D/3D image and video signal and the camera apparatus
Signal obtains 2D/3D image and image that the camera apparatus is blended with the external image equipment.
One kind of the application generates the method with display 2D/3D image and image in real time, by light source matrix equipment to light
After switching matrix issues multiple laser signal, multiple laser signal is received by optical switching matrix equipment and is sent out multiple laser signal
Give light emitting head, then light emitting head is irradiated target pathological tissues, target pathological tissues to multiple laser signal into
Visible light signal required for row scattering, reflection generate, one area's signal of near-infrared and two area's signal of near-infrared are simultaneously sent into camera and are set
After standby, camera apparatus obtains real-time 2D/3D image and video signal and 2D/3D image and video signal is sent into image procossing
With display equipment, image procossing is overlapped with display equipment and synthesis is handled to obtain 2D/3D image and image and be shown, is realized
Real-time generation simultaneously shows 2D/3D image and image, facilitates the effect of Clinics and Practices.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The application can be limited.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the real-time generation and display 2D/3D image and image system structure chart that one embodiment of the application provides；
Fig. 2 is the real-time generation and display 2D/3D image and image method flow chart that one embodiment of the application provides；
Fig. 3 is the real-time system construction drawing generated with display 2D/3D image and image that another embodiment of the application provides.
In Fig. 3：1, light source matrix equipment；2, optical switching matrix equipment；3, light-emitting device；4, camera apparatus；5, it performs the operation
Cantilever；6, image procossing and display equipment；7, external source image interface；8, augmented reality driving equipment；9, augmented reality glasses.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, technical solution of the present invention will be carried out below
Detailed description.Obviously, described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Base
Embodiment in the present invention, those of ordinary skill in the art are obtained all without making creative work
Other embodiment belongs to the range that the present invention is protected.
Fig. 1 is the real-time structural schematic diagram generated with the system embodiment of display 2D/3D image and image of the application.Such as
Shown in Fig. 1, real-time generate of the present embodiment includes with the system of display 2D/3D image and image：Light source feedway 110, phase
Machine equipment 114；Image procossing and display equipment 115；External image equipment 116；Augmented reality driving equipment 117；Augmented reality
Hardware device 118.Wherein, light source feedway 110 includes：Light source matrix equipment 111；Optical switching matrix equipment 112；Light emitting
Equipment 113；
Light source feedway 110 exposes to target pathological tissues for emitting multi beam optical signal, wherein light source matrix equipment
111 for issuing multiple laser signal, and optical switching matrix equipment 112 receives the multiple laser signal and is sent to the light hair
Jet device 113,111 output end of light source matrix equipment are connect with 112 input terminal of optical switching matrix equipment by optical fiber；Light emitting is set
Standby 113 reception multiple laser signal simultaneously exposes to target pathological tissues；113 input terminal of light-emitting device and optical switching matrix equipment
112 output ends are connected by optical fiber；Multiple laser signal is generated visible light signal by scattering, reflection by target pathological tissues,
Multiple laser signal is generated into one area's signal of near-infrared and two area's signal of near-infrared by excitation；Camera apparatus 114 is in described
The top of target pathological tissues, for capturing visible light signal, one area's signal of near-infrared and two area's signal of near-infrared and forming 2D/
3D rendering and video signal, and 2D/3D image and image signal transmitting to image procossing and are shown into equipment 115；Camera apparatus
114 output ends are connect by digital circuit with display 115 input terminal of equipment with image procossing or are connected by optical fiber；External image
Equipment 116 is connect by external source image interface with image procossing with display equipment 115, for being sent out by the external source image interface
Send external 2D/3D image and image to image procossing and display equipment 115；Image procossing and display equipment 115 and augmented reality
Driving equipment 117 connects, the 2D/3D image and image sent for receiving described image processing with display equipment 115, and drives
The augmented reality hardware device 118；
117 augmented reality hardware device 118 of augmented reality driving equipment connection, for showing, being superimposed the 2D/3D image
And image and real outdoor scene, it obtains augmented reality 2D/3D image and image and shows the augmented reality 2D/3D image and shadow
Picture.
Wherein, light source matrix equipment 111 is the multiple light courcess array that multiple light sources generator is combined into as required.It is more
Array of source can according to need out or be closed.In the present embodiment, the light source matrix equipment 111 occurs comprising multiple light
Device can either provide lighting source, can also issue the excitation light source of different-waveband, can also provide the laser for treatment.
For example, the light source matrix equipment 111 is the matrix form light cluster of multiple arbitrary sources composition in the present embodiment
Device, each arbitrary source may be either that operation provides multichannel lighting source, and it is different classes of, wave band also can to provide multichannel for operation
Excitation light source can also need to provide the treatment light source of multichannel different-waveband for operation.111 output end of light source matrix equipment and light
112 input terminal of switching matrix equipment is connected by optical fiber.
In the present embodiment, multiple-channel output of the optical switching matrix equipment 112 for realization laser signal according to demand, so that
The access flexibility and changeability of laser signal.
During a specific implementation, optical switching matrix equipment 112 switches as light path control in system and optical path
Device receives the input of different laser signals, and can switch over laser signal by internal optical path processing unit, to reach
To the effect for exporting different laser signals in different light emitting heads as needed.In the present embodiment, optical switching matrix equipment 112
Input terminal is connect with 111 output end of light source matrix equipment by optical fiber, meanwhile, on the output end and operation cantilever of optical switch module
Light emitting head pass through optical fiber connect.
In the present embodiment, light-emitting device 113 is multiple light emitting heads composition.The light of light-emitting device 113 is handed over from light
Change matrix device 112.Multiple light emitting heads can issue different type, the laser and light of different-waveband, multiple light emitting heads
Direction and angle can be real-time dynamicly adjusted.
During a specific implementation, multiple light emitting heads are mounted in the different spatial on operation cantilever, with
Subject to the position that can achieve the effect that shadowless lighting when exporting visible light, meanwhile, multiple light emitting heads can export different waves
The laser signal of section is used to irradiate the target pathological tissues in the viewing area AR.In the present embodiment, multiple light emitting head energy roots
According to needing to export heterogeneity, the light of different-waveband, it can visible light of the output for illumination can also be exported for controlling
The laser for the treatment of.Multiple light emitting heads are connected with optical switching matrix output end by optical fiber.
During a specific implementation, laser is divided into visible light and black light, and black light includes infrared laser again,
It include two area's light of one area's light of near-infrared and near-infrared.It, can when light emitting head exports radiation of visible light to target pathological tissues
It is light-exposed to reflect, the phenomenon that scattering, these reflections, scattering visible light captured by the camera apparatus 114 on operation cantilever.When
Light emitting head output one area's light of near-infrared and near-infrared 2nd area illumination is when being incident upon target pathological tissues, these one area's light of near-infrared and
Two area's light of near-infrared, which will be excited, generates fluorescence, and the fluorescence for the generation that is excited also is caught by the camera apparatus 114 on operation cantilever
It obtains.
In the present embodiment, multiple camera apparatus 114 are mounted in the different spatial of operation cantilever, camera apparatus 114
On different lens is installed there are also different filter piece, for capturing different type, the optical signal of different-waveband.Camera is set
It include a variety of imaging units on standby 114,
Specifically, camera apparatus 114 includes：Visible Light Camera submodule, one area's camera submodule of near-infrared and near-infrared
Two area's camera submodules, and the camera apparatus 114 according to other need other light to be mounted that can capture different-waveband.It can
Light-exposed camera submodule includes visual light imaging unit, one area's camera submodule of near-infrared include one area's imaging unit of near-infrared with
Two area's imaging unit of near-infrared.
When being imaged, operation cantilever drives the camera apparatus 114 at different location to capture difference by rotation
Spatial point visible light signal, one area's signal of near-infrared and two area's signal of near-infrared and form 2D/3D image and video signal,
Meanwhile the available 3-D image of camera apparatus 114 of two or more same types.For example, two or more
Visible Light Camera equipment 114 can form stable three-dimensional visible images；Two or more one area's cameras of near-infrared are set
Standby 114 can form stable one area's image of three-dimensional near-infrared；Two or more two area's camera apparatus 114 of near-infrared can be with
Form stable two area's image of three-dimensional near-infrared.
During a specific implementation, the output end and image procossing and display equipment 115 of camera apparatus 114 are to simulate
Signal circuit connection, is perhaps connected with digital signal circuit or is connected with optical fiber.
In the present embodiment, image procossing is not only attached with camera apparatus 114 with display equipment 115, also passes through external source
Image interface is connected with external image equipment 116, for receive external image equipment 116 transmission external 2D/3D image and
The image and video signal of the external systems such as image, such as CT machine, x-ray machine, ultrasonic drilling machine input.Specifically, at image
Reason is receiving 2D/3D image from each camera apparatus 114 and video signal and external image equipment with display equipment 115
After the 116 external 2D/3D images and video signal sent, it is overlapped and is handled with synthesis, the 2D/3D image and shadow merged
Picture, and shown.
During a specific implementation, image procossing is being superimposed with display equipment 115, is synthesizing processing and display 2D/3D
It, can be with when image and video signal：
(1) 2D/3D image and video signal that modulation /demodulation processing camera apparatus 114 is sent, form camera apparatus
1142D/3D image and image, and show；
(2) 2D/3D image and video signal that modulation /demodulation processing external image equipment 116 is sent, form external image
Equipment 1162D/3D image and image, and show；
(3) integrate and be superimposed 2D/3D image and video signal that camera apparatus 114 is sent, the camera apparatus merged
1142D/3D image and image；
(4) the 2D/3D image and video signal that integrated and superposition camera apparatus 114 is sent are sent with external image equipment 116
The 2D/3D image and video signal come, obtains the 2D/3D image and shadow that camera apparatus 114 is merged with external image equipment 116
Picture.
During a specific implementation, image procossing and display equipment 115 simultaneously can also be by 2D/3D image and images
Other systems are sent to by external source image interface.
The system through this embodiment may be implemented to generate the effect with display 2D/3D image and image in real time.
Another embodiment is also disclosed in the application on the basis of above system：
The real-time generation and the system of display 2D/3D image and image further include：Augmented reality (Augmented
Reality, AR) driving equipment 117, AR hardware device 118；
Image procossing shows that equipment is connected with AR driving equipment 117, sends out for receiving image procossing and display equipment 115
The 2D/3D image and image sent, and drive AR hardware device 118.
AR hardware device 117 is connected with AR driving equipment, for showing, being superimposed the 2D/3D image and image and show
Outdoor scene obtains augmented reality 2D/3D image and image and shows augmented reality 2D/3D image and image.
In the present embodiment, object to be measured pathological tissue is placed in area of visual field, which is also to show in progress AR
When the viewing area AR, medical staff puts on can observe 2D/3D image and image and reality after AR glasses in AR glasses
The image and image of target pathological tissues superposition, may be implemented the effect of augmented reality.Specifically, medical staff can choose not
With mode carry out auxiliary surgical procedure, such as：It directly carries out observing or being shown by AR display by AR glasses
Show.Further, since image procossing and display equipment 115 can send other systems to by external source image interface also to issue in real time
2D/3D image and image, so, these 2D/3D images and image can also be shown by way of remote synchronization.
The system through this embodiment, can render real outdoor scene, realize 2D/3D image and image and show
The effect of the augmented reality of outdoor scene fusion.
Optionally, in order to more fully correspond to, one kind provided in an embodiment of the present invention generates in real time and display 2D/3D schemes
As the system with image, the application also proposes a kind of method generated in real time with display 2D/3D image and image.
Fig. 2 is the real-time generation and display 2D/3D image and image method flow chart that one embodiment of the application provides.Such as figure
Shown in 2, generate can specifically include following steps with the method for display 2D/3D image and image in real time：
Step 200 obtains 2D/3D image and video signal；The 2D/3D image and video signal are by camera apparatus 114
Visible light signal, one area's signal of near-infrared and the two area's signal of near-infrared of acquisition form；
Step 201 is superimposed, synthesizes the 2D/3D image and video signal, generates 2D/3D image and image；
Step 202, the display 2D/3D image and image.
It in the present embodiment, is overlapped by 2D/3D image and the video signal that will acquire, synthesizes processing and show, it can
To realize the effect generated with display 2D/3D image and image.
Another embodiment is also disclosed in the application based on the above method：
While obtaining 2D/3D image and video signal, the outside transmitted by external source image interface can also be received
The external 2D/3D image and video signal of vision facilities.
The external 2D/3D image and video signal and the camera 2D/3D image and video signal are integrated and be superimposed, is obtained
The 2D/3D image and image blended to the camera apparatus and the external image equipment.
Further, another embodiment is also provided in the application on the basis of stating method：
After showing the 2D/3D image and image or the 2D/3D image and image of fusion, by 2D/3D image and shadow
The 2D/3D image and image of picture or fusion are sent to AR driving equipment, and drive AR hardware device, such as：AR glasses, AR are shown
Device etc..AR hardware device is used to for 2D/3D image being overlapped with image or the 2D/3D image merged and image with real outdoor scene
With render and show.For example, operator in AR glasses it can be seen that visible light under physical presence patient tissue and
The tumor tissues shown under same position infrared light, such surgical procedure become very intuitive.
Fig. 3 is the real-time system construction drawing generated with display 2D/3D image and image that another embodiment of the application provides.
As shown in figure 3, generating in real time specific as follows with the structure of display 2D/3D image and image：
Light source matrix equipment 1 issues multiple laser signal to optical switching matrix equipment 2, and light source matrix equipment 1 is exchanged with light
Matrix device 2 is connected by optical fiber；Optical switching matrix equipment 2 receives the multiple laser signal and is sent to light-emitting device 3,
Optical switching matrix equipment 2 is connect with the light-emitting device 3 being mounted on operation cantilever 5 by optical fiber；Light-emitting device 3 receives more
Beam laser signal and the target pathological tissues for exposing to area of visual field；The target pathological tissues of area of visual field are by multiple laser signal
By scattering, reflecting generation visible light signal, laser signal is generated into one area's signal of near-infrared and 2nd area of near-infrared by excitation
Signal；Camera apparatus 4 captures the visible light signal, one area's signal of near-infrared and two area's signal of near-infrared and forms 2D/3D figure
Picture and video signal are sent to image procossing and display equipment 6；Camera apparatus 4 and image procossing and display equipment 6 pass through number
Circuit connection is connected by optical fiber；External image equipment is connected by external source image interface 7 and image procossing and display equipment 6
It connects；Image procossing is connected with display equipment 6 with AR driving equipment 8；AR driving equipment 8 is connected with AR glasses 9.
In the present embodiment, by the orderly connection of each equipment, it can generate in real time and display 2D/3D image and shadow
Picture facilitates surgical diagnosis and treatment.
It is understood that same or similar part can mutually refer in the various embodiments described above, in some embodiments
Unspecified content may refer to the same or similar content in other embodiments.
It should be noted that in the description of the present invention, term " first ", " second " etc. are used for description purposes only, without
It can be interpreted as indication or suggestion relative importance.In addition, in the description of the present invention, unless otherwise indicated, the meaning of " multiple "
Refer at least two.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized：With for realizing the logic gates of logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any
One or more embodiment or examples in can be combined in any suitable manner.
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (10)
1. a kind of system generated in real time with display 2D/3D image and image, which is characterized in that including：Light source feedway, phase
Machine equipment, image procossing and display equipment；
The light source feedway exposes to target pathological tissues for emitting multiple laser signal；
The multiple laser signal is generated visible light signal by scattering, reflection by the target pathological tissues, by the multi beam
Laser signal generates one area's signal of near-infrared and two area's signal of near-infrared by excitation；
Each camera apparatus is in the top of the target pathological tissues, for capturing the visible light signal, described close
Infrared area signal and two area's signal of near-infrared, form 2D/3D image and video signal, and by the 2D/3D image and
Image signal transmitting is to described image processing and shows equipment；
Described image processing is connected with display equipment with each camera apparatus, for receiving the 2D/3D image and image
Signal handles to obtain 2D/3D image and image, and shows the 2D/3D image and image by being superimposed synthesis.
2. the system of real-time generation and display 2D/3D image and image according to claim 1, which is characterized in that also wrap
It includes：Augmented reality driving equipment, augmented reality hardware device；
The processing of the augmented reality driving equipment and described image is connected with equipment is shown, for receive described image processing and
It shows 2D/3D image and image that equipment is sent, and drives the augmented reality hardware device；
The augmented reality hardware device is connected with the augmented reality driving equipment, for showing, being superimposed the 2D/3D figure
Picture and image and real outdoor scene, obtain augmented reality 2D/3D image and image and show the augmented reality 2D/3D image and shadow
Picture.
3. the system of real-time generation and display 2D/3D image and image according to claim 2, which is characterized in that described
Augmented reality hardware device includes：Augmented reality glasses and/or augmented reality display.
4. the system of real-time generation and display 2D/3D image and image according to claim 1, which is characterized in that described
Light source feedway includes：Light source matrix equipment, optical switching matrix equipment, light-emitting device；
The light source matrix equipment is for issuing multiple laser signal；
The optical switching matrix equipment is connected with the light source matrix equipment, for receiving the multiple laser signal, concurrently
Send the multiple laser signal to the light-emitting device；
The light-emitting device includes at least two light emitting heads；
The light-emitting device is connected with the optical switching matrix equipment, for receiving the multiple laser signal and exposing to
Target pathological tissues.
5. the system of real-time generation and display 2D/3D image and image according to claim 1, which is characterized in that described
Camera apparatus includes：Two area's camera submodule of Visible Light Camera submodule, one area's camera submodule of near-infrared and near-infrared.
The Visible Light Camera submodule is for receiving visible light signal and generating visible light signal；
One area's camera submodule of near-infrared is for receiving one area's signal of near-infrared and generating one area's signal of near-infrared；
Two area's camera submodule of near-infrared is for receiving two area's signal of near-infrared and generating two area's signal of near-infrared.
6. the system of real-time generation and display 2D/3D image and image according to claim 1, which is characterized in that described
Image procossing and display equipment include external source image interface, receive what external image equipment was sent by the external source image interface
External 2D/3D image and image.
7. a kind of method generated in real time with display 2D/3D image and image, which is characterized in that the method is wanted applied to right
The system for asking 1-6 described in any item real-time generations and display 2D/3D image and image, the method includes：
Obtain 2D/3D image and video signal；The 2D/3D image and video signal are believed by the visible light that camera apparatus obtains
Number, one area's signal of near-infrared and two area's signal of near-infrared form；
It is superimposed, synthesizes the 2D/3D image and video signal, generate 2D/3D image and image；
Show the 2D/3D image and image.
8. the method for real-time generation and display 2D/3D image and image according to claim 7, which is characterized in that also wrap
It includes：The 2D/3D image and image are sent to augmented reality drive module.
9. the method for real-time generation and display 2D/3D image and image according to claim 7, which is characterized in that also wrap
It includes：
Receive external 2D/3D image and video signal that external image equipment is sent.
10. the method for real-time generation and display 2D/3D image and image according to claim 9, which is characterized in that also wrap
It includes：
2D/3D image and video signal integrated and that be superimposed the external 2D/3D image and video signal and the camera apparatus,
Obtain 2D/3D image and image that the camera apparatus is blended with the external image equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810977794.5A CN108833883A (en) | 2018-08-24 | 2018-08-24 | A kind of system and method for real-time generation and display 2D/3D image and image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810977794.5A CN108833883A (en) | 2018-08-24 | 2018-08-24 | A kind of system and method for real-time generation and display 2D/3D image and image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108833883A true CN108833883A (en) | 2018-11-16 |
Family
ID=64151591
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810977794.5A Pending CN108833883A (en) | 2018-08-24 | 2018-08-24 | A kind of system and method for real-time generation and display 2D/3D image and image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108833883A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112704473A (en) * | 2020-11-30 | 2021-04-27 | 浙江大学医学院附属第一医院 | Parathyroid gland position enhancement equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104116496A (en) * | 2014-07-11 | 2014-10-29 | 深圳先进技术研究院 | Medical three-dimensional venous vessel augmented reality device and method |
| CN104582622A (en) * | 2012-04-16 | 2015-04-29 | 儿童国家医疗中心 | Dual-mode stereo imaging system for tracking and control in surgical and interventional procedures |
| CN106109015A (en) * | 2016-08-18 | 2016-11-16 | 秦春晖 | A kind of wear-type medical system and operational approach thereof |
| CN107374730A (en) * | 2017-09-06 | 2017-11-24 | 东北大学 | Optical operation navigation system |
| CN107811706A (en) * | 2017-11-27 | 2018-03-20 | 东北大学 | A kind of operation guiding system based on image transmission optical fibre |
-
2018
- 2018-08-24 CN CN201810977794.5A patent/CN108833883A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104582622A (en) * | 2012-04-16 | 2015-04-29 | 儿童国家医疗中心 | Dual-mode stereo imaging system for tracking and control in surgical and interventional procedures |
| CN104116496A (en) * | 2014-07-11 | 2014-10-29 | 深圳先进技术研究院 | Medical three-dimensional venous vessel augmented reality device and method |
| CN106109015A (en) * | 2016-08-18 | 2016-11-16 | 秦春晖 | A kind of wear-type medical system and operational approach thereof |
| CN107374730A (en) * | 2017-09-06 | 2017-11-24 | 东北大学 | Optical operation navigation system |
| CN107811706A (en) * | 2017-11-27 | 2018-03-20 | 东北大学 | A kind of operation guiding system based on image transmission optical fibre |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112704473A (en) * | 2020-11-30 | 2021-04-27 | 浙江大学医学院附属第一医院 | Parathyroid gland position enhancement equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230255446A1 (en) | Surgical visualization systems and displays | |
| CN110087574A (en) | The surgery systems shown with augmented reality | |
| EP2136697A1 (en) | Medical device including scanned beam unit for imaging and therapy | |
| JP6996518B2 (en) | Branch optical system, imaging device, and imaging system | |
| JP7181298B2 (en) | Systems and methods for detecting abnormal tissue using vascular features | |
| JP7095693B2 (en) | Medical observation system | |
| KR101772187B1 (en) | Method and device for stereoscopic depiction of image data | |
| CN110099649A (en) | Robotic surgical system with the virtual control panel for tool actuation | |
| EP3435831A1 (en) | Imaging apparatus, imaging method, and medical observation equipment | |
| CN107198568A (en) | A kind of abdominal surgery is precisely performed the operation guiding system and method | |
| CN108833883A (en) | A kind of system and method for real-time generation and display 2D/3D image and image | |
| CN107137824B (en) | With the photodynamic therapy system for visualizing and showing hot spot boundary function | |
| US12023106B2 (en) | Virtual reality 3D eye-inspection by combining images from position-tracked optical visualization modalities | |
| CN110013319B (en) | Novel robot external vision mirror system | |
| Vogt | Real-Time Augmented Reality for Image-Guided Interventions | |
| WO2020014999A1 (en) | Invisible light display device and optical guidance system for operations | |
| CN209048125U (en) | A kind of vascular flow projection chromatography 3-D imaging system | |
| JPWO2019181212A1 (en) | Medical display control device and display control method | |
| CN116763239A (en) | Broad spectrum fluorescent endoscope device | |
| WO2020045014A1 (en) | Medical system, information processing device and information processing method | |
| CN107456203A (en) | A kind of laser reflection spectrum gynecatoptron | |
| CN206434410U (en) | A kind of hand-held molecular image navigation apparatus and system | |
| CN110226974A (en) | A kind of near-infrared fluorescence imaging system based on augmented reality | |
| KR102321416B1 (en) | Beam Splitter for Realizing Augmented Reality and Optical System for Realizing Augmented Reality Including the Same | |
| KR102222076B1 (en) | Optical System for Realizing Augmented Reality and Medical Augmented Reality Apparatus Including the Same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |
|
| RJ01 | Rejection of invention patent application after publication |