WO2003042968A1 - Procede et systeme permettant de presenter des informations physiologiques en temps reel au moyen d'un visiocasque - Google Patents
Procede et systeme permettant de presenter des informations physiologiques en temps reel au moyen d'un visiocasque Download PDFInfo
- Publication number
- WO2003042968A1 WO2003042968A1 PCT/US2002/036218 US0236218W WO03042968A1 WO 2003042968 A1 WO2003042968 A1 WO 2003042968A1 US 0236218 W US0236218 W US 0236218W WO 03042968 A1 WO03042968 A1 WO 03042968A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- mounted display
- head mounted
- physiological information
- presenting
- information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000004872 arterial blood pressure Effects 0.000 claims abstract description 17
- 230000036772 blood pressure Effects 0.000 claims abstract description 16
- 210000001147 pulmonary artery Anatomy 0.000 claims abstract description 13
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 claims description 15
- 230000000763 evoking effect Effects 0.000 claims description 15
- 239000001301 oxygen Substances 0.000 claims description 15
- 229910052760 oxygen Inorganic materials 0.000 claims description 15
- 230000000007 visual effect Effects 0.000 claims description 15
- 239000008280 blood Substances 0.000 claims description 14
- 210000004369 blood Anatomy 0.000 claims description 14
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 claims description 12
- IJGRMHOSHXDMSA-UHFFFAOYSA-N Atomic nitrogen Chemical compound N#N IJGRMHOSHXDMSA-UHFFFAOYSA-N 0.000 claims description 10
- 230000002685 pulmonary effect Effects 0.000 claims description 9
- GQPLMRYTRLFLPF-UHFFFAOYSA-N Nitrous Oxide Chemical compound [O-][N+]#N GQPLMRYTRLFLPF-UHFFFAOYSA-N 0.000 claims description 8
- 230000000747 cardiac effect Effects 0.000 claims description 8
- 229910002092 carbon dioxide Inorganic materials 0.000 claims description 7
- 238000002601 radiography Methods 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 239000001569 carbon dioxide Substances 0.000 claims description 6
- 238000007917 intracranial administration Methods 0.000 claims description 6
- 230000003519 ventilatory effect Effects 0.000 claims description 6
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 claims description 5
- 210000000133 brain stem Anatomy 0.000 claims description 5
- UBAZGMLMVVQSCD-UHFFFAOYSA-N carbon dioxide;molecular oxygen Chemical compound O=O.O=C=O UBAZGMLMVVQSCD-UHFFFAOYSA-N 0.000 claims description 5
- 229910002091 carbon monoxide Inorganic materials 0.000 claims description 5
- 230000003788 cerebral perfusion Effects 0.000 claims description 5
- 239000003193 general anesthetic agent Substances 0.000 claims description 5
- 239000001307 helium Substances 0.000 claims description 5
- 229910052734 helium Inorganic materials 0.000 claims description 5
- SWQJXJOGLNCZEY-UHFFFAOYSA-N helium atom Chemical compound [He] SWQJXJOGLNCZEY-UHFFFAOYSA-N 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 229910052757 nitrogen Inorganic materials 0.000 claims description 5
- 238000004611 spectroscopical analysis Methods 0.000 claims description 5
- 239000001272 nitrous oxide Substances 0.000 claims description 4
- 238000002604 ultrasonography Methods 0.000 claims description 4
- 238000002591 computed tomography Methods 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims description 3
- 239000013307 optical fiber Substances 0.000 claims description 3
- 230000002207 retinal effect Effects 0.000 claims description 3
- 230000009885 systemic effect Effects 0.000 abstract description 4
- 230000003205 diastolic effect Effects 0.000 abstract description 2
- 208000013057 hereditary mucoepithelial dysplasia Diseases 0.000 description 15
- 230000000694 effects Effects 0.000 description 9
- 238000003780 insertion Methods 0.000 description 8
- 230000037431 insertion Effects 0.000 description 8
- 238000012544 monitoring process Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 210000003128 head Anatomy 0.000 description 3
- 230000035790 physiological processes and functions Effects 0.000 description 3
- 230000000241 respiratory effect Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 206010002091 Anaesthesia Diseases 0.000 description 2
- 230000037005 anaesthesia Effects 0.000 description 2
- 210000001367 artery Anatomy 0.000 description 2
- 230000004087 circulation Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 239000007789 gas Substances 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007830 nerve conduction Effects 0.000 description 2
- 230000035479 physiological effects, processes and functions Effects 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 101000649996 Homo sapiens Postacrosomal sheath WW domain-binding protein Proteins 0.000 description 1
- 102100028278 Postacrosomal sheath WW domain-binding protein Human genes 0.000 description 1
- 239000000956 alloy Substances 0.000 description 1
- 229910045601 alloy Inorganic materials 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000002612 cardiopulmonary effect Effects 0.000 description 1
- 210000000860 cochlear nerve Anatomy 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000003434 inspiratory effect Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 210000004165 myocardium Anatomy 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 238000004393 prognosis Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004088 pulmonary circulation Effects 0.000 description 1
- 230000000541 pulsatile effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000036387 respiratory rate Effects 0.000 description 1
- 230000004270 retinal projection Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000002627 tracheal intubation Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
- 230000036642 wellbeing Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/339—Displays specially adapted therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7445—Display arrangements, e.g. multiple display units
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/021—Measuring pressure in heart or blood vessels
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/083—Measuring rate of metabolism by using breath test, e.g. measuring rate of oxygen consumption
- A61B5/0836—Measuring rate of CO2 production
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
Definitions
- the present invention relates in general to information delivery and presentation using a head mounted display. Specifically, the present invention provides methods and systems for presenting and delivering physiological information through a head mounted display in a medical and/or clinical setting.
- Head mounted displays have been used to present visual information in various research and application areas, including telecommunication, aviation, and defense. See, e.g., Fiorino F. Aviation Week & Space Technology, August 13, 2001 , p.52; Soldiers, Dec. 2000, cover page; IEEE Spectrum, Oct. 2000, cover page; Weiss P., Science News, 1999, 156:330; Wilson A., Vision Systems Design, March, 2000, p.9. Many specific features and advantages of different kinds of head mounted displays have been described to date. See, e.g., US Patent No. HI, 790; US Patent No. 6,037,914; US Patent No. 5,949,388; US Patent No. 4,961,626; US Patent No. 6, 101 ,431. However, little work has been done to utilize head mounted displays in facilitating medical and clinical operations or activities, e.g., for real time presentation and delivery of physiological information.
- the present invention overcomes the problems and disadvantages associated with current strategies and designs and provides methods and systems for presenting and delivering physiological information using a head mounted display thereby facilitating medical operations and/or clinical activities.
- the delivery and presentation of information as such into the eyes of the users (doctors and the like) improve the logistics, ergonomics, and efficiency of the operations or activities, for example, by releasing the users of the burden of reaching out of their way to different devices and displays to acquire needed information while performing an operation or activity or preparing for performing the same.
- One embodiment of the invention is directed to methods for presenting physiological information generated from one or more devices through a head mounted display, comprising: transferring the physiological mformation to a receiver which connects to the head mounted display; and presenting through the head mounted display the physiological information.
- the receiver is wearable together with the head mounted display in a particular embodiment.
- the transferring may be on wire (with any form of tethered data cable) or wireless in various embodiments of the invention.
- Another embodiment of the invention is directed to a method for delivering physiological information generated from one or more devices to a multiplicity of loci, comprising: broadcasting the physiological information to a plurality of receivers at the multiplicity of loci, each of which connects to a head mounted display and is wearable together therewith; and presenting through the head mounted display the physiological information.
- the broadcasting is in multiple channels and each of the plurality of receivers tunes into one of the multiple channels.
- Another embodiment of the invention is directed to a system for presenting physiological mformation generated from one or more devices through a head mounted display, comprising: a head mounted display capable of presenting the physiological information; and a receiver capable of receiving the physiological information, wherein the receiver connects to the head mounted display and is wearable together therewith.
- the receiver receives the physiological information on wire; according to other embodiments, the receiver receives the physiological information by wireless means.
- Another embodiment of the invention is directed to a system for delivering physiological information generated from one or more devices to a multiplicity of loci, comprising: a first plurality of head mounted displays, each capable of presenting the physiological information; and a second plurality of receivers at the multiplicity of loci, each capable of receiving the physiological information, wherein each of the second plurality connects to one of the first plurality and is wearable together therewith and wherein the physiological information is broadcast to the second plurality and presented through the first plurality.
- the system further comprises a third plurality of channels each carrying a selection of the physiological information, wherein each of the second plurality tunes into one of the third plurality.
- physiological information is information selected from the group consisting of electrocardiogram, ST segment analysis, non-invasive blood pressure, arterial blood pressure, pulmonary artery blood pressure, pulmonary wedge pressure, central venous pressure, intracranial pressure, cerebral perfusion pressure, cardiac output, temperature, oxygen saturation of the arterial blood, oxygen saturation of the venous blood, oxygen saturation of the mixed venous blood, end tidal carbon dioxide, fraction inspired/fraction expired of inhaled anesthetic agents plus oxygen, carbon dioxide, nitrous oxide, helium, carbon monoxide, and nitrogen, ventilatory parameters, electroencephalogram, somatoscensory evoked potentials, brain stem auditory evoked potentials, visual evoked potentials, and bispectral spectroscopy. Other types of physiological information may be used in other embodiments of this invention.
- devices may be selected from the group of imaging devices consisting of MRI, X-Ray radiography, cine radiography, camera, CAT scan, doppler flow, ultrasound, and flexible and rigid scopes.
- Presenting may be performed in a numerical, textual, or graphical format, or any combination thereof.
- the presenting is multi-dimensional.
- the presenting is monochrome.
- presenting may be in full color.
- Presenting may also be performed in a substantially simultaneous manner as the physiological information is generated.
- the head-mounted display is monocular or binocular, and the head mounted display may be transparent or opaque.
- Fig. 1 is a visual image presented via a head mounted display that has patient vital signs and physiological information overlaid into a clinician's field of vision during a procedure of insertion and placement of a pulmonary artery catheter in the patient.
- EKG refers to electrocardiogram. It reflects the electrical activity generated by the heart muscle.
- the EKG information is typically represented as a two dimensional (time and magnitude) graphed line and several additional sealers or numerals.
- ST segment analysis refers to ST segment elevation or depression analysis displayed as positive or negative numeric value representing changes in the ST segment of the EKG.
- Non-Invasive Blood Pressure refers to the blood pressure of the systemic arterial circulation; it is measured with a cuff. This information is typically represented as a set of three sealers or numerals, e.g., 125/75 (95) mm Hg.
- Arterial Blood Pressure refers to blood pressure of the systemic arterial circulation; it is measured by puncturing the skin and placing a sensor in direct contact with the arterial blood.
- the arterial blood pressure information is typically represented as a two dimensional (time and magnitude) graphed line and a set of three sealers or numerals.
- Pulmonary Artery Blood Pressure refers to blood pressure in the pulmonary (lung) artery. It is measured by inserting and directing a catheter through the right side of the heart and then on into the pulmonary artery.
- the pulmonary artery blood pressure information is typically represented as a two dimensional (time and magnitude) graphed line and a set of three sealers or numerals.
- Pulmonary Wedge Blood Pressure refers to blood pressure in the pulmonary circulation when the flow has been stopped by occluding (wedging) the lumen of the artery by inflating a balloon at the tip of the catheter.
- the pulmonary wedge pressure information is typically represented as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- Central Venous Blood Pressure refers to blood pressure in the central veins.
- the central venous pressure information is typically represented as a two dimensional (time and magnitude) graphed line and/or a sealer or numeral.
- Intracranial Blood Pressure refers to pressure in the skull.
- the intracranial pressure information is tj ⁇ ically represented as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- Cerebral Perfusion Pressure is typically calculated from other measured values, and represented as a two dimensional (time and magnitude) graphed line.
- Cardiac Output refers to the amount of blood flow pumped through the heart. This cardiac output information is typically represented first as a two dimensional (time and magnitude) graphed line, and then converted into a sealer or numeral.
- Temperature may be measured with various probes in a number of locations, including, for example, at skin surface, oral, esophageal, rectal, and on every cardiac output catheter.
- the temperature information is represented as a sealer or numeral.
- SaO 2 refers to oxygen saturation of the arterial blood.
- the SaO 2 information is represented as a two dimensional (time and magnitude) graphed line and as a sealer or numeral.
- SvO 2 refers to oxygen saturation of mixed venous blood; the measurement and information representation are similar to those of SaO 2 , respectively.
- ETCO 2 refers to end tidal carbon dioxide, that is, the amount of C0 2 expired.
- the ETCO 2 mformation is typically represented as a two dimensional (time and magnitude) graphed line and as a sealer or numeral.
- FI/FE gases refer to fraction inspired/fraction expired of inhaled anesthetic agents plus oxygen, carbon dioxide, helium, carbon monoxide, and nitrogen; it is measured continuously from gas flowing into and out of patient. This information is typically represented as a two dimensional (time and magnitude) graphed line and as a sealer or numeral.
- Ventilatory parameters refer to control setting parameters for a mechanical ventilator (e.g., rate, tidal volume, airway pressures, inspiratory/expiratory duration ratios) and parameters monitored during spontaneous ventilation (e.g., rate, tidal volume, airway pressures).
- the ventilatory parameters are represented as sealers or numerals.
- EEG refers to electroencephalogram, that is, brain waves.
- the EEG information is typically represented as two dimensional (time and magnitude) graphed lines.
- the SSEP refers to somatoscensory evoked potentials.
- the SSEP information is typically represented as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- BAEP refers to brain stem auditory evoked potentials. It measures auditory nerve conduction.
- the BAEP information is typically represented as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- VEP refers to visual evoked potentials. It measures visual nerve conduction.
- the VEP information appears as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- BIS values refer to bispectral spectroscopy measurements; they reflect the level of consciousness.
- the information are represented as a two dimensional (time and magnitude) graphed line and a sealer or numeral.
- head mounted display encompasses any device which provides a visual display or direct retinal projection and which may be worn on the head.
- a head mounted display can be made from various materials such as plastic, glasses, metal, and alloy, among other things. It may be opaque or transparent; and accordingly, a user may see through the HMD for the surroundings, if it is transparent or, if it is opaque, the user may only see a display presented from a designated mformation or data source that connects to the HMD.
- a HMD may connect to a designated information or data source through wired network - hence tethered HMD - or through wireless means - hence wireless HMD.
- Any form of tethered data cable may be used according to various embodiments, including, e.g., electrically conducting wires and optical fibers.
- any form of wireless or remote transfer means may be used in this context, including, e.g., infrared (IR), radio frequency (RF).
- IR infrared
- RF radio frequency
- Any HMD as described here, whether homemade or commercially available, may be used in the methods and systems of the present invention.
- physiological information refers to any information that relates to the physiological well-being of a patient or a person of interest, which may be measured or monitored by an instrument or device in a medical or clinical setting and visually displayed for use by clinicians.
- the physiological information may be in a textual, numerical, or graphical format, or any combination thereof. Typically, therefore, the values of physiological parameters of the patient is physiological information.
- physiological information examples include, among other things, electrocardiogram, ST segment analysis, non-invasive blood pressure, arterial blood pressure, pulmonary artery blood pressure, pulmonary wedge pressure, central venous pressure, intracranial pressure, cerebral perfusion pressure, cardiac output, temperature, oxygen saturation of the arterial blood, oxygen saturation of the arterial/venous blood, end tidal carbon dioxide, fraction inspired/fraction expired of inhaled anesthetic agents plus oxygen, carbon dioxide, nitrous oxide, helium, carbon monoxide, and nitrogen, ventilatory parameters, electroencephalogram, somatoscensory evoked potentials, brain stem auditory evoked potentials, visual evoked potentials, and bispectral spectroscopy.
- the head mounted display of the present invention may include any kind of HMD that is sold commercially by various vendors (e.g., Kaiser Electro-Optics, Inc., Microvision Inc., etc.) or made in a noncommercial setting.
- the HMD may be monocular or binocular according to various embodiment of the invention.
- the HMD is transparent; the user may look through the HMD lenses or eye pieces, which have displayed thereon information of the user's choosing from designated data sources, and see normal vision of the surroundings.
- the displayed images are thus overlaid or superimposed into the normal field of vision of the user. Images may be of contrasting colors or hues to the immediate field of vision for obtaining desired resolution, or simply bright enough to be visible against illuminated surrounding areas.
- the displayed images may be segregated to a portion of the user's field of vision. For example, the user could focus on the particular area of interest in the field of vision, which may be placed at one or a pluraity of different focal points such that to focus on one point would place the other points out of focus.
- the transparent HMDs may cover the field directly in front of the eyes, as well as that just out and above the eyes to allow adequate view when looking up.
- the HMD is opaque; the user may only view the information or images of his or her choosing, which are displayed on the eye pieces from a predetermined information or data source.
- Transparent HMDs may be used as opaque HMDs if desired.
- the HMD is a direct retinal projector which have displayed thereon information of the user's choosing from designated data sources, and see normal vision of the surroundings; the images are preferably bright enough to be visible against illuminating surrounding areas.
- the information or data sources may be any device or instrument and combinations thereof used in medical and clinical settings that measure the physiological state of a patient and that is capable of transferring information visually.
- a HMD may connect to such a designated information or data source through wired network; it is therefore tethered.
- a HMD may connect to the designated information or data source through wireless means. Tethered HMDs are less likely to interfere with other wireless communications in the surroundings compared to wireless HMDs; they may be used in emergency rooms, operating rooms, or at intensive care units, post anesthesia care units, procedure rooms, and any other areas where patients are monitored. Wireless HMDs are more preferably used by roving users, those move around and need real-time visual access to relevant physiological information.
- wireless HMDs are especially applicable in a multiple loci, multiple users, and data broadcasting situation which is discussed in detail infra.
- Any form of wireless or remote transfer means may be used according to the present invention.
- signals may be transferred via radio frequency (RF), e.g., Bluetooth, or infrared (IR).
- RF radio frequency
- IR infrared
- the HMD of this invention is wearable by the user and is preferably light weighted.
- the HMD connects to a receiver for receiving data and information from the aforementioned sources.
- the receiver may be a video input, for example, which is capable of receiving video signals generated from computer video cards.
- a receiver may be part of the HMD or it may be a small peripheral of the HMD and is wearable together with the HMD.
- the HMD of this invention may receive and display video signals from any regular image generator without regard to the format of the signals - whether interlaced NTSC composite, interlaced NTSC component (e.g., S-Video, or RGB, etc.), progressive, or digital video.
- the physiological information presented and delivered by a HMD according to the present invention include textual or numerical data as well as live or static images.
- the images may be multidimensional; two-dimensional in certain embodiments and three-dimensional in other embodiments.
- real-time images from doppler flow, ultrasound, flexible and rigid scopes, and cine radiography, and a video camera and static video signals showing images from X- Ray, MRI scan, Cat scan, and a camera may be delivered and displayed.
- an HMD of the invention is monochrome; and in other embodiments, the HMD is capable of displaying images and/or data in full color. Typically, the displayed color matches the color of the clinical monitors from which the HMDs receives the data and images.
- the physiological information is displayed real time in a manner that provides an instantaneous record of information for a given preceding time period.
- this embodiment is best carried out by horizontal or vertical scrolling of plotted graphical data.
- a continuously updated data set from the previous minute, 10 minutes, 30 minutes or hour are presented.
- Other time periods can be set and presented as desired.
- an HMD user controls the presentation of scrolled physiological data by voice command.
- voice recognition software is located in a computer that controls the transfer of physiological information to the HMD.
- voice commands to that computer can halt data presentation (stop scrolling) to allow more time to see details at a specific time point, and also to go back and display older data.
- Yet another command in this context can change the time scale of data that is presented in real time format, to allow viewing of physiological changes that occur over shorter or longer time intervals. This control of real time graphical physiological data presentation is critical in a medical situation and has not been appreciated in the prior art.
- the HMDs of this invention is monochrome; and in other embodiments, the HMDs are capable of displaying images and/or data in full color. Typically, the displayed color matches the color of the clinical monitors from which the HMDs receives the data and images.
- Head mounted displays may be used according to this invention to present physiological information to a user, e.g., a clinician or supervisory clinician.
- the HMDs are especially useful for monitoring patients' vital signs and physiological information. For example, it is known that patients suffer abrupt changes in their cardio-pulmonary functions during an intubation procedure. A clinician wears a HMD that receives and presents all the vital signs and physiological information of the patient will be able to closely observe the patient's vital signs without periodically detracting from performing the procedure in order to evaluate the physiology state of the patient. Another example is insertion of a pulmonary catheter. This is a procedure whereby a doctor insert a catheter into and through the heart and on into the pulmonary artery.
- the HMDs of the present invention are particularly useful in guiding medical procedures. Similar to pulmonary catheter insertion, successful insertion of a bronchoscope also requires continuous knowledge of the location and direction of the tip of the bronchoscope. Wearing a HMD that receives and displays the image from the tip of the bronchoscope will allow the doctor to conveniently keep his or her hands as well as the tip of the bronchoscope in view at all times during the procedure.
- patient-specific monitoring data may be used as discussed above, other general or historical medical and anatomic data or images may also be used in a similar manner. For example, textbook anatomic images and physiological data and images in the patient's medical history may be transferred to the HMD and overlaid into its display field as needed, to assist the doctor as he or she navigates through the patient's body to perform a specific procedure.
- Head mounted displays of the present invention are useful not only within treatment areas such as operating rooms and emergency rooms as discussed supra, but also outside of treatment areas, particularly in a larger clinical and medical setting where a multitude of patient physiological data are relayed among many clinicians.
- every clinician may have available a HMD which he or she can wear when needs to access relevant visual information of a given patient whose physiological condition is being monitored.
- Multiple patients are monitored and operated upon at the same time in various treatment areas in the facility.
- the physiological information gathered as such may be managed by a centralized information system, which assigns a unique information channel - e.g., a radio frequency - to the physiological data from each patient.
- the system thus broadcasts in real time such data in multiple channels throughout the hospital facility.
- a clinician wearing a HMD may selectively tune into a desired channel and receive physiological information regarding a particular patient. Therefore, the use of HMDs in such a system enables practitioners to conveniently gain access to real-time visual information of patient physiological states while on the move. It improves the efficiency and timeliness of the information relay in the medical treatment facility and helps clinicians to evaluate patient conditions and prepare for participating in treatment activities at a distance. Also, users of the system may switch from channel to channel and observe the operations and activities throughout the facility. The system thus provides a means for effective overall monitoring and surveillance, useful especially for those who bear the responsibility to oversee a good number of patients or operations at the same time.
- HMDs of the present invention may provide feedback control to the user.
- Feedback control means that the user is able to act on information received through the HMD.
- the user may signal that increased respiration assistance be immediately provided.
- the interactive means may be provided through body movement, hand or finger movement, head or eye movement, or another means known in the art, that permits feedback control to the desired mechanism.
- the interactive means is voice control whereby the user speaks into a microphone causing the apparatus to change or alter the particular physiological parameter of the patient (e.g. respiratory assistance, amount of anesthesia or any drug being administered, cardiac rhythm control).
- the apparatus may also provide for confirmation that the requested change is being implemented through a visible indication back through the HMD or an audible signal.
- Such an embodiment allows the user complete and, more importantly, immediate control of the procedure and over the patient.
- Example 1 Insertion and Placement of a Pulmonary Artery Catheter
- a pulmonary artery catheter was performed on a patient.
- the clinician who performed the procedure wore a transparent head mounted display during the procedure, through which patient vital signs and physiological information were presented.
- Fig. 1 depicts what the clinician saw from looking through the transparent HMD.
- the continuous PA pressure trace (102) was used to guide the insertion.
- the clinician may simultaneously see the guiding PA pressure trace and his hands while inserting the catheter (106). There was no tactile information in the catheter itself to be felt by the fingers that can guide insertion.
- the HMD provided the clinician with the following information: the status of the alarms: ALARMS SUSPENDED (112); EKG lead II wave form and Heart Rate value: 70 bpm (114); EKG lead V wave form and changes in ST1 and ST2 (116); systemic arterial blood pressure (ABP) wave form and systolic, diastolic, and mean values: 130/75 (97) mm Hg (118); pulmonary artery pressure (PAP) wave form and current value: 7 mm Hg (102, 104, 108, 110); pulse Ox, or oxygen saturation (SpO2) wave forms and value: 97 % (120); central venous pressure (CVP) value: 3 mm Hg (122); end tidal carbon dioxide (ETCO2) wave form: 0 mm Hg, sensor not connected to patient (124); airway respiratory rate (AWRR) value: 0 bpm, determined from ETCO2 trace, thus zero (126); and NIBP vale: not measured, thus no value was displayed, thus
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Cardiology (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US33131401P | 2001-11-14 | 2001-11-14 | |
US60/331,314 | 2001-11-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2003042968A1 true WO2003042968A1 (fr) | 2003-05-22 |
Family
ID=23293437
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2002/036218 WO2003042968A1 (fr) | 2001-11-14 | 2002-11-13 | Procede et systeme permettant de presenter des informations physiologiques en temps reel au moyen d'un visiocasque |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2003042968A1 (fr) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1743592A1 (fr) * | 2005-07-15 | 2007-01-17 | DePuy Products, Inc. | Système destine a fournir des informations a un chirurgien |
US7408296B2 (en) | 2004-11-24 | 2008-08-05 | Eastman Kodak Company | Tiled OLED display |
US8265949B2 (en) | 2007-09-27 | 2012-09-11 | Depuy Products, Inc. | Customized patient surgical plan |
WO2015125447A1 (fr) * | 2014-02-21 | 2015-08-27 | Sony Corporation | Dispositif de commande d'affichage, dispositif d'affichage et système d?endoscopie chirurgicale |
JP2017189498A (ja) * | 2016-04-15 | 2017-10-19 | ミラマ サービス インク | 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法 |
CN107865702A (zh) * | 2016-09-28 | 2018-04-03 | 李健 | 一种医用智能手术显微系统 |
US10028750B2 (en) | 2007-09-30 | 2018-07-24 | DePuy Synthes Products, Inc. | Apparatus and method for fabricating a customized patient-specific orthopaedic instrument |
US11055648B2 (en) | 2006-05-25 | 2021-07-06 | DePuy Synthes Products, Inc. | Method and system for managing inventories of orthopaedic implants |
US11051829B2 (en) | 2018-06-26 | 2021-07-06 | DePuy Synthes Products, Inc. | Customized patient-specific orthopaedic surgical instrument |
US11583347B2 (en) | 2019-10-31 | 2023-02-21 | Terumo Cardiovascular Systems Corporation | Heart-lung machine with augmented reality display |
US11724098B2 (en) | 2020-01-30 | 2023-08-15 | Terumo Cardiovascular Systems Corporation | Stepper motor drive systems and tubing occluder system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4977505A (en) * | 1988-05-24 | 1990-12-11 | Arch Development Corporation | Means to correlate images from scans taken at different times including means to determine the minimum distances between a patient anatomical contour and a correlating surface |
US5815126A (en) * | 1993-10-22 | 1998-09-29 | Kopin Corporation | Monocular portable communication and display system |
US6101038A (en) * | 1999-05-03 | 2000-08-08 | Optimize, Incorporated | Infrared audio/video interface for head-mounted display |
-
2002
- 2002-11-13 WO PCT/US2002/036218 patent/WO2003042968A1/fr not_active Application Discontinuation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4977505A (en) * | 1988-05-24 | 1990-12-11 | Arch Development Corporation | Means to correlate images from scans taken at different times including means to determine the minimum distances between a patient anatomical contour and a correlating surface |
US5815126A (en) * | 1993-10-22 | 1998-09-29 | Kopin Corporation | Monocular portable communication and display system |
US6101038A (en) * | 1999-05-03 | 2000-08-08 | Optimize, Incorporated | Infrared audio/video interface for head-mounted display |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7408296B2 (en) | 2004-11-24 | 2008-08-05 | Eastman Kodak Company | Tiled OLED display |
EP1743592A1 (fr) * | 2005-07-15 | 2007-01-17 | DePuy Products, Inc. | Système destine a fournir des informations a un chirurgien |
US11055648B2 (en) | 2006-05-25 | 2021-07-06 | DePuy Synthes Products, Inc. | Method and system for managing inventories of orthopaedic implants |
US11068822B2 (en) | 2006-05-25 | 2021-07-20 | DePuy Synthes Products, Inc. | System and method for performing a computer assisted orthopaedic surgical procedure |
US11928625B2 (en) | 2006-05-25 | 2024-03-12 | DePuy Synthes Products, Inc. | System and method for performing a computer assisted orthopaedic surgical procedure |
US8265949B2 (en) | 2007-09-27 | 2012-09-11 | Depuy Products, Inc. | Customized patient surgical plan |
US12070231B2 (en) | 2007-09-27 | 2024-08-27 | DePuy Synthes Products, Inc. | Customized patient surgical plan |
US10028750B2 (en) | 2007-09-30 | 2018-07-24 | DePuy Synthes Products, Inc. | Apparatus and method for fabricating a customized patient-specific orthopaedic instrument |
US10828046B2 (en) | 2007-09-30 | 2020-11-10 | DePuy Synthes Products, Inc. | Apparatus and method for fabricating a customized patient-specific orthopaedic instrument |
US11696768B2 (en) | 2007-09-30 | 2023-07-11 | DePuy Synthes Products, Inc. | Apparatus and method for fabricating a customized patient-specific orthopaedic instrument |
US11931049B2 (en) | 2007-09-30 | 2024-03-19 | DePuy Synthes Products, Inc. | Apparatus and method for fabricating a customized patient-specific orthopaedic instrument |
US10874284B2 (en) | 2014-02-21 | 2020-12-29 | Sony Corporation | Display control device, display device, surgical endoscopic system and display control system |
WO2015125447A1 (fr) * | 2014-02-21 | 2015-08-27 | Sony Corporation | Dispositif de commande d'affichage, dispositif d'affichage et système d?endoscopie chirurgicale |
JP2017189498A (ja) * | 2016-04-15 | 2017-10-19 | ミラマ サービス インク | 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法 |
CN107865702A (zh) * | 2016-09-28 | 2018-04-03 | 李健 | 一种医用智能手术显微系统 |
US11051829B2 (en) | 2018-06-26 | 2021-07-06 | DePuy Synthes Products, Inc. | Customized patient-specific orthopaedic surgical instrument |
US11950786B2 (en) | 2018-06-26 | 2024-04-09 | DePuy Synthes Products, Inc. | Customized patient-specific orthopaedic surgical instrument |
US11903657B2 (en) | 2019-10-31 | 2024-02-20 | Terumo Cardiovascular Systems Corporation | Heart-lung machine with augmented reality display |
US11583347B2 (en) | 2019-10-31 | 2023-02-21 | Terumo Cardiovascular Systems Corporation | Heart-lung machine with augmented reality display |
US11724098B2 (en) | 2020-01-30 | 2023-08-15 | Terumo Cardiovascular Systems Corporation | Stepper motor drive systems and tubing occluder system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20240341600A1 (en) | Wireless patient monitoring system | |
US20240148464A1 (en) | Augmented Reality Device for Providing Feedback to an Acute Care Provider | |
US11925439B2 (en) | Data playback interface for a medical device | |
US20220343609A1 (en) | Systems and methods for rendering immersive environments | |
US20050177058A1 (en) | System and method for analyzing the brain wave patterns of one or more persons for determining similarities in response to a common set of stimuli, making artistic expressions and diagnosis | |
KR102111531B1 (ko) | Vr 또는 ar을 기반으로 하는 병원에서의 진료 체험 제공 시스템 | |
CN112384970A (zh) | 用于时间要求严格的生物医学应用的增强现实系统 | |
US20140032241A1 (en) | Method, apparatus and computer program product for monitoring clinical state of a subject | |
US12073928B2 (en) | Handling of age transmitted data in medical device system | |
CN116056633A (zh) | 具有配套装置的医疗处置系统 | |
Watt et al. | Alarms and anesthesia: challenges in design of intelligent systems for patient monitoring | |
WO2003042968A1 (fr) | Procede et systeme permettant de presenter des informations physiologiques en temps reel au moyen d'un visiocasque | |
JP2008086756A (ja) | 医療情報システム | |
JP2015000174A (ja) | 生体情報監視装置及びこれを備える生体情報監視システム | |
CN107810535A (zh) | 头戴式计算设备、方法和计算机程序产品 | |
Arpaia et al. | A Health 4.0 integrated system for monitoring and predicting patient’s health during surgical procedures | |
US11776697B2 (en) | System for administering a qualitative assessment using an automated verbal interface | |
US20190274626A1 (en) | Harness mounted patient monitoring system and method | |
US20200090807A1 (en) | Wireless head mounted telemetry display and communication system | |
WO2020132813A1 (fr) | Procédé de surveillance de signe physiologique pour lésion cranio-cérébrale et dispositif de surveillance médicale | |
EP4192351A1 (fr) | Procédé et système de mesure d'un niveau d'anxiété | |
US8172743B2 (en) | Interactive hypnotic bio-stabilization system | |
US20130337784A1 (en) | System for displaying a medical diagnostic result | |
JP3024162B2 (ja) | 手術用ヘッドアップディスプレイ | |
US20210315529A1 (en) | Monitoring device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: JP |