Triage Vs Intuición
Triage Vs Intuición
Triage Vs Intuición
Abstract
1. Department of Emergency Medicine, Beth Introduction: The most commonly used methods for triage in mass-casualty incidents
Israel Deaconess Medical Center, Boston, (MCIs) rely upon providers to take exact counts of vital signs or other patient parameters.
Massachusetts USA The acuity and volume of patients which can be present during an MCI makes this a time-
2. University of Massachusetts Medical consuming and potentially costly process.
School, Medical Education, Worcester, Hypothesis: This study evaluates and compares the speed of the commonly used Simple
Massachusetts USA Triage and Rapid Treatment (START) triage method with that of an “intuitive triage” method
3. Department of Emergency Medicine, which relies instead upon the abilities of an experienced first responder to determine the triage
University of Massachusetts Medical category of each victim based upon their overall first-impression assessment. The research team
School, Worcester, Massachusetts USA hypothesized that intuitive triage would be faster, without loss of accuracy in assigning triage
categories.
Correspondence: Methods: Local adult volunteers were recruited for a staged MCI simulation (active-
Alexander Hart, MD shooter scenario) utilizing local police, Emergency Medical Services (EMS), public ser-
Department of Emergency Medicine vices, and government leadership. Using these same volunteers, a cluster randomized
Beth Israel Deaconess Medical Center simulation was completed comparing START and intuitive triage. Outcomes consisted of
330 Brookline Avenue the time and accuracy between the two methods.
Boston, Massachusetts 02215 USA Results: The overall mean speed of the triage process was found to be significantly faster
E-mail: Alexhart1988@gmail.com with intuitive triage (72.18 seconds) when compared to START (106.57 seconds). This
effect was especially dramatic for Red (94.40 vs 138.83 seconds) and Yellow (55.99 vs
91.43 seconds) patients. There were 17 episodes of disagreement between intuitive triage
Conflicts of interest: Funding for the full-scale
and START, with no statistical difference in the incidence of over- and under-triage
exercise was provided by the Central
between the two groups in a head-to-head comparison.
Massachusetts Homeland Security Advisory
Conclusion: Significant time may be saved using the intuitive triage method. Comparing
Council (Worcester, Massachusetts USA).
START and intuitive triage groups, there was a very high degree of agreement between
Funding for the research aspect of the project
triage categories. More prospective research is needed to validate these results.
was provided by the University of Hart A, Nammour E, Mangolds V, Broach J. Intuitive versus algorithmic triage. Prehosp
Massachusetts Medical School (Worcester, Disaster Med. 2018;33(4):355–361.
Massachusetts USA). The authors declare no
conflicts of interest.
triage protocol in the US is the Simple Triage and Rapid Treat- and clinical gestalt to sort patients into groups based on how cri-
ment (START) triage system.3 tical their injuries are.
The process of START involves an initial sorting of patients
based on their ability to follow a command to leave the scene. Methods
Each patient is then assessed according to an algorithm that takes Disaster Lab Conceptualization
into account breathing, circulation (as measured by either the The Disaster Lab/Operation Central Shield project was conceived
presence of a radial pulse or measurement of finger capillary refill in September 2015 by a group of researchers at the University of
time), and ability to follow commands. A patient who is ambu- Massachusetts Medical School (Worcester, Massachusetts USA),
latory and follows commands is Green; a patient that is not and planning continued through September 2016 when the event
breathing is labeled Black; a patient who has an abnormality of was held and data were collected. The concept included a research
any of the above metrics is Red; and patients who have intact component designed to allow testing of multiple, innovative
respirations, circulation, and mentation but have other injuries are disaster-management techniques as well as a full-scale exercise
Yellow. This process is expected to take between 30 and 60 sec- (FSE) designed to assess the host region’s preparedness for a large-
onds per patient.3 scale MCI. Planning incorporated multiple stakeholders, such
The use of these criteria should identify patients that will as the area’s Central Medical Emergency Direction (CMED;
benefit most from the resources available, with the goal of Holden, Massachusetts USA), regionalized Emergency Medical
decreasing critical mortality (ie, the percentage of patients with Services (EMS), local fire departments, the Department of Public
survivable injuries who die).1,7 In addition, any algorithm should Health (DPH; Boston, Massachusetts USA), the local police
seek to minimize over-triage (the assignment of a well patient to department, and all hospitals in the city of Worcester, Massa-
an urgent category) and under-triage (the erroneous assignment of chusetts. The simulated MCI was designed as an “active-shooter”
an ill patient to a less urgent category). Over-triage puts patients at incident at a concert in a large, inner-city convention center.
risk by wasting resources that are needed for critical patients. Funding for the FSE was provided by the Central Massachusetts
Under-triage causes missed opportunities to use resources on Homeland Security Advisory Council (Worcester, Massachusetts
patients who need them urgently. Both types of error introduce USA) and conducted according to Homeland Security Exercise
inefficiency into the system and may result in increased critical and Evaluation Program (HSEEP; Washington, DC USA)
mortality.8 standards. Funding for the research aspect of the project was
Regardless of the triage methodology selected by an agency or provided by the University of Massachusetts Medical School.
government, it is important to ensure that the algorithm meets Study approval was obtained from the University of Massa-
some standard of utility and ease of use. Every modality necessi- chusetts Medical School academic Independent Review Board
tates initial and refresher training for providers and may have [IRB ID H00011322]. Table-top exercises and small-scale MCI
inherent limitations in its real-world use. As noted above, there is drills continued through August 2016, including input from local
also a time cost associated with using a formal triage modality with hospitals. Coordination with city planners regarding impact to the
published ranges between 30 and 60 seconds per patient.3,9 local community, traffic, schools, and the need for public messa-
Finally, many providers note that they do not always adhere to ging was undertaken. Additionally, coordination between the City
formal algorithms when applying the triage modalities in real- of Worcester, Massachusetts communications office, the area’s
world practice.10,11 office of the Mayor and City Manager, the DCU Convention
Despite most providers’ familiarity with the concept of triage, Center, the UMass Medical System, and the UMass Medical
there is a paucity of literature which demonstrates the effectiveness School was completed. The research exercise took place on the
of these methods in real-world or simulated situations.7 There has morning of September 20, 2016, followed by the afternoon
been research showing that focused teaching regarding a triage “Operation Central Shield” FSE.
system improves the rate of correctly triaging on written exams.12 “Victim” actors were recruited primarily to be participants in an
Computer algorithms have also been used to compare triage FSE being conducted to test the first response capability of the city
methods by retrospectively assigning patients according to chart and surrounding region. Those same volunteers agreed to parti-
review.4,6 In a retrospective review of the response to a 2003 train cipate in research studies being done in the morning before the
crash MCI, Kahn and colleagues found poor agreement between actual city-wide response drill. Actors, both men and women 18
START categories and outcome measures based upon hospital years old or older, were recruited from the community, area gov-
admission and modified Baxt criteria.13 They noted that while the ernment officials, local colleges, and the University of Massachu-
level of under-triage of Red patients was low, there was a sig- setts Medical School staff and their families by word of mouth and
nificant amount of over-triage. Another study compared the sen- paper fliers. One-hundred and forty-three people volunteered to
sitivity and specificity of a variety of triage methodologies and participate. Signed consent was obtained before any activity began.
found that many major modalities achieved sensitivities of First responders were recruited from local first responder agencies
between 82% and 85% with better specificities ranging from 86%- in the area through electronic email notifications. Purposefully,
96%.14 Both over-triage and under-triage have been observed in START was selected for evaluation as it is the MCI triage mod-
other studies, highlighting the imperfect and difficult nature of ality used by all EMS agencies in Massachusetts.16 Study partici-
MCI triage.11,15 pants were provided with lunch, lunch time entertainment from a
The researchers in this study are not aware of any studies that local band, and study tee shirts. In addition, each study participant
compare the use of one or more formal methodologies to a con- was given a stopwatch and instructed in its use prior to the study.
dition where responders triage patients without the use of an
established algorithm. The goal in this investigation was to com- Data Collection
pare the speed and accuracy of START and an “intuitive” triage Identical scenarios were run multiple times, each time using a
approach, in which a health care provider uses immediate, visual, different set of paramedic responders. Responders were
Scenario A 20 13 13 1 47
Scenario B 22 16 12 1 51
Hart © 2018 Prehospital and Disaster Medicine
Table 1. Victim Counts by Category
Scenario A 39 32 82
Scenario B 45 35 78
Total 84 67 80
Hart © 2018 Prehospital and Disaster Medicine
Table 2. Number of Instances of Triage Category Disagreement between START and Intuitive Triage Groups
Abbreviation: START, Simple Triage and Rapid Treatment.
Green 0 2 2 0
Yellow 2 0 3 0
Red 0 6 0 2
Black 0 0 0 0
Hart © 2018 Prehospital and Disaster Medicine
Table 3. Instances of Disagreement between Triage Categories
Abbreviation: START, Simple Triage and Rapid Treatment.
This might skew the results for accuracy unfairly in favor of the that START assigned a “higher” or more urgent category than
START trials. intuitive triage, and vice-versa.
For these reasons, it was decided to compare the triage category
assignments for each patient between the two conditions (intuitive Results
triage and START) rather than comparing the decisions made by Comparison Analysis
the responders to a “correct” category. It was felt that this limited, There was a very high degree of agreement between triage cate-
to the greatest extent possible, any inaccuracy due to the artificiality gories in trials when comparing START and intuitive triage
of the simulation itself. In order to accomplish this, continuous groups. In Scenario A, there were 39 pair-wise comparisons pos-
video recordings were taken of the trials to review the triage category sible and 32 instances of agreement between START and intuitive
assigned to each patient in each trial. Each trial was filmed from two triage groups. In Scenario B, there were 45 pair-wise comparisons
perspectives, thus able to record patient triage categories as assigned possible and 35 instances of agreement between START and
by responders and indicated by the colored triage tags used. Most, intuitive triage (Table 2).
but not all, of the triage decisions were visible using the above Although there was a very high degree of agreement between
method. In cases where video evidence did not definitively show the two groups, it was also of interest to know whether one method
the triage colors, no assumptions were made and these data points (intuitive triage versus START triage) over- or under-estimated a
were not used in the comparison analysis. The researchers compared patient’s need for urgent transport. Both errors are known to occur
the triage decisions made by each group in each scenario (A and B) commonly in real-world situations and it is unrealistic to expect that
and performed a X2 analysis of the level of agreement between any triage modality that is sufficiently quick to allow assessment of a
START and intuitive triage groups in each scenario. large number of patients will not have some degree of inaccuracy.
Although speed data were collected for a total of five trials Therefore, to measure the rate of over- and under-triage in the study
(three START and two intuitive triage), comparison data for groups, a head-to-head comparison was performed to determine if
accuracy analysis were only available for four trials (two START one modality consistently over- or under-estimated patient severity in
and two intuitive triage) due to degraded video quality that made comparison to the other. Out of a total of 17 instances of disagree-
the analysis of the final START run impossible. This study also ment between the groups, the intuitive triage groups assigned a
measured percentage agreement between the triage categories higher category nine times (52%) - almost exactly one-half of the time
assigned in each trial, as well as calculated the percentage of time (Table 3).
START (Mean Seconds to Triage) [CI] Intuitive (Mean Seconds to Triage) [CI] P Value
This result demonstrated that when disagreements occurred, the disagreement, the expected over-triage by one system was 8.5 epi-
groups were not significantly different in the number of times they sodes. Based upon this expected value, a Chi-squared analysis was
over- or under-triaged compared with each other. A Chi-squared performed and no significant difference between the two methodol-
analysis comparing the expected versus actual number of episodes of ogies was found (P = .971). This comports with the idea that over-
over-triage between the two groups was performed. For two equiva- and under-triage were observed essentially equally in the two triage
lently accurate triage systems, the number of over- and under-triage methodologies. This analysis was performed using Excel 2013 Data
would be equal when disagreements occurred. Given 17 episodes of Analysis (Microsoft Corp.; Redmond, Washington USA) package.
The key results of this investigation were the average times the current standard of care triage methods, such as START. As
taken to perform triage. The analysis measured the total time that the injuries sustained by victims of MCIs are often time-sensitive,
each victim measured on his or her stopwatch before a triage the morbidity and mortality benefit of this could be significant.
category was assigned. This study compared START trials with The understandable reservation associated with such a triage
intuitive triage trials based on the mean time to triage for all method is concern over the accuracy of triage with such a rapid
patients and for patients within specific triage categories. This evaluation. However, given the agreement in triage categories
study also measured the average time to triage for the sickest found between intuitive triage and START in this study, it is
patients, and so compared average time to triage for the group of likely that this potential loss of accuracy would be minimal, and it
combined Red, Yellow, and Black categories. would be offset by the benefit due to the increased speed with
The times were compared using two-tailed, two sample T-tests which patients could be triaged and treatments begun.
assuming unequal variances and an expected difference in means
of zero. These analyses were performed using Excel 2013 Data
Limitations
Analysis package.
Although the results of this study suggest that intuitive triage
The concept of using intuitive triage was, as far as the
modalities may be effective and more time-efficient, significant
researchers could determine, new in the literature. Therefore, the
limitations of this study make further investigation necessary.
expected effect size of using this protocol compared to START
First, this study used a high-fidelity simulation, but the results of
triage was unknown. As an a priori power calculation requires an
studies in this type of environment always suffer from a reasonable
assumption of effect size, none was performed prior to this study.
doubt that real-world experience will track with that of responders
The results are reported in number of seconds to the assign-
during exercises. Although this is a difficult limitation to overcome
ment of a triage category. Intuitive triage was significantly faster
given the unpredictable nature of MCIs and the inherently dynamic
for all categories, except for Black and Green. It should be noted
environment of disasters, it is important to note. However, it should
that there were very few observations in the Black triage group, and
be considered that some elements of a real-life incident such as
that in both the START and intuitive groups, responders chose to
active bleeding and true respiratory distress might actually make
initially give a command for all patients who could walk to move
intuitive triage more rather than less applicable.
off of the field. This was done in the intuitive triage groups as well
Secondly, the simulated scenario was a particular type of fast
as the START groups, despite the intuitive triage groups not
moving MCI (ie, an active shooter) where wounds are more likely
being specifically instructed to do so. This may account for the
to be easily apparent and where time is extremely limited. It may
similarity of triage times between the two methodologies in the
well be that in other types of MCIs, a more traditional triage
Green category and may suggest that this type of mass sorting is an
methodology out-performs intuitive methodologies. This will only
ingrained part of responders’ intuitive approach to MCI triage.
be better understood through further study.
The results of this analysis are presented in Table 4 and
Third, this study compared triage decisions between the
Figure 2.
modalities as opposed to some measure of “gold standard” cor-
rectness. This was done intentionally to help ensure that the
Discussion
methods were compared fairly, but it is important in future work to
This study presents a comparison of the time required to triage
compare any new triage method to some objective standard of
patients on the scene of a simulated MCI using either an algo-
correctness in order to determine its test characteristics. This is just
rithmic triage modality such as START or what the authors have
one of many potentially useful avenues for further investigation.
referred to as “intuitive triage:” decision making based upon their
Finally, all of the responders who participated in this study
instinctive perception of how critical a patient is. The results were
were paramedics and so represented a higher level of training than
obtained during a high-fidelity simulation and demonstrated that
is present in many EMS systems around the country. It is possible
intuitive triage is much faster with seemingly little effect on triage
that their higher level of training allowed them to make more
accuracy. In fact, across all levels of patient criticality except dead
correct or insightful decisions than would be expected from pre-
(Black) and minimal (Green), there was a significant reduction in
hospital providers with less training.
time required to triage victims.
The recent trend in increased numbers of active-shooter inci-
dents and bombings make clear the need for response plans that Conclusions
take into account the time-critical nature of victims of these inci- This initial study of an intuitive triage method suggests that in
dents.14 Recent military and civilian experience has shown that certain types of MCIs, and with certain types of responders per-
interventions such as stopping bleeding and early transport to forming triage, much faster triage decisions can be made while
definitive surgical care are among the most effective ways to reduce maintaining accuracy in those decisions. Meanwhile, START and
critical mortality. Although the accepted time required to triage other triage algorithms have proven useful in a number of real-
each patient using traditional modalities is relatively short world applications, and any definitive conclusions about their
(30-60 seconds), this compounded over an MCI which includes utility should come only after further study is conducted into the
hundreds of victims could put many victims at risk of dying from potential of more intuitive and less algorithmic approaches. Still,
preventable causes while the triage process is on-going. this study does suggest that significant time could be saved using
The results of this study demonstrate the significant time such a method and clearly warrants further investigation to test the
benefit attainable by employing an intuitive triage method over results presented here.
References
1. Baker MS. Creating order from chaos: Part I: triage, initial care, and tactical 2. Iserson KV, Moskop JC. Triage in medicine, Part I: concept, history, and types. Ann
considerations in mass casualty and disaster response. Mil Med. 2007;172(3):232-236. Emerg Med. 2007;49(3):275-281.
3. Cone DC, MacMillan DS. Mass-casualty triage systems: a hint of science. Acad Emerg 10. Armstrong JH, Hammond J, Hirshberg A, Frykberg ER. Is over-triage associated with
Med. 2005;12(8):739-741. increased mortality? The evidence says “yes.” Disaster Med Public Health Prep. 2008;2
4. Culley JM, Svendsen E. A review of the literature on the validity of mass-casualty triage (1):4-5; author reply 5-6.
systems with a focus on chemical exposures. Am J Disaster Med. 2014;9(2):137-150. 11. Frykberg ER, Tepas JJ 3rd. Terrorist bombings. Lessons learned from Belfast
5. Lerner EB, Cone DC, Weinstein ES, et al. Mass-casualty triage: an evaluation of the to Beirut. Ann Surg. 1988;208(5):569-576.
science and refinement of a national guideline. Disaster Med Public Health Prep. 2011;5 12. Risavi BL, Salen PN, Heller MB, Arcona S. A two-hour intervention using START
(2):129-137. improves prehospital triage of mass casualty incidents. Prehosp Emerg Care. 2001;5
6. American Academy of Pediatrics, American College of Emergency Physicians, (2):197-199.
American College of Surgeons - Committee on Trauma, et al. Model uniform core 13. Kahn CA, Schultz CH, Miller KT, Anderson CL. Does START triage work? An
criteria for mass casualty triage. Disaster Med Public Health Prep. 2011;5(2):125-128. outcomes assessment after a disaster. Ann Emerg Med. 2009;54(3):424-430, 430
7. Jenkins JL, McCarthy ML, Sauer LM, et al. Mass-casualty triage: time for an e421.
evidence-based approach. Prehosp Disaster Med. 2008;23(1):3-8. 14. Garner A, Lee A, Harrison K, Schultz CH. Comparative analysis of multiple-casualty
8. Hupert N, Hollingsworth E, Xiong W. Is over-triage associated with increased incident triage algorithms. Ann Emerg Med. 2001;38(5):541-548.
mortality? Insights from a simulation model of mass casualty trauma care. Disaster Med 15. Frykberg ER. Medical management of disasters and mass casualties from terrorist
Public Health Prep. 2007;1(1 Suppl):S14-24. bombings: how can we cope? J Trauma. 2002;53(2):201-212.
9. Jones N, White ML, Tofil N, et al. Randomized trial comparing two mass-casualty 16. Emergency Medical Services Pre-Hospital Statewide Treatment Protocols. https://
triage systems (JumpSTART versus SALT) in a pediatric simulated mass- www.mass.gov/files/documents/2018/04/04/treatment-protocols-2018.pdf. Boston,
casualty event. Prehosp Emerg Care. 2014;18(3):417-423. Massachusetts USA: Massachusetts Department of Public Health; 2018.