Skip Navigation
Skip to contents

J Trauma Inj : Journal of Trauma and Injury

OPEN ACCESS
SEARCH
Search

Articles

Page Path
HOME > J Trauma Inj > Volume 36(3); 2023 > Article
Original Article
Impact of nonphysician, technology-guided alert level selection on rates of appropriate trauma triage in the United States: a before and after study
Megan E. Harrigan, BS1orcid, Pamela A. Boremski, MS2orcid, Bryan R. Collier, DO1,2orcid, Allison N. Tegge, PhD3,4orcid, Jacob R. Gillen, MD1,2orcid
Journal of Trauma and Injury 2023;36(3):231-241.
DOI: https://doi.org/10.20408/jti.2023.0020
Published online: September 13, 2023
  • 2,061 Views
  • 49 Download

1Virginia Tech Carilion School of Medicine, Roanoke, VA, USA

2Department of Surgery, Carilion Roanoke Memorial Hospital, Roanoke, VA, USA

3Fralin Biomedical Research Institute at VTC, Roanoke, VA, USA

4Department of Statistics, Virginia Tech, Blacksburg, VA, USA

Correspondence to Megan E. Harrigan, BS Virginia Tech Carilion School of Medicine, Riverside Circle, Roanoke, VA 24016, USA Tel: +1-540-526-2500 Email: meganh03@vt.edu
• Received: April 6, 2023   • Revised: June 13, 2023   • Accepted: June 22, 2023

© 2023 The Korean Society of Traumatology

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

prev next
  • Purpose
    Overtriage and undertriage rates are critical metrics in trauma, influenced by both trauma team activation (TTA) criteria and compliance with these criteria. Analysis of undertriaged patients at a level I trauma center revealed suboptimal compliance with existing criteria. This study assessed triage patterns after implementing compliance-focused process interventions.
  • Methods
    A physician-driven, free-text alert system was modified to a nonphysician, hospital dispatcher-guided system. The latter employed dropdown menus to maximize compliance with criteria. The preintervention period included patients who presented between May 12, 2020, and December 31, 2020. The postintervention period incorporated patients who presented from May 12, 2021, through December 31, 2021. We evaluated appropriate triage, overtriage, and undertriage using the Standardized Trauma Assessment Tool. Statistical analyses were conducted with an α level of 0.05.
  • Results
    The new system was associated with improved compliance with existing TTA criteria (from 70.3% to 79.3%, P=0.023) and decreased undertriage (from 6.0% to 3.2%, P=0.002) at the expense of increasing overtriage (from 46.6% to 57.4%, P<0.001), ultimately decreasing the appropriate triage rate (from 78.4% to 74.6%, P=0.007).
  • Conclusions
    This study assessed a workflow change designed to improve compliance with TTA criteria. Improved compliance decreased undertriage to below the target threshold of 5%, albeit at the expense of increased overtriage. The decrease in appropriate triage despite compliance improvements suggests that the current criteria at this institution are not adequately tailored to optimally balance the minimization of undertriage and overtriage. This finding underscores the importance of improved compliance in evaluating the efficacy of TTA criteria.
Background
In the United States, trauma injuries exert an extensive toll on the population and the healthcare system [1]. The efficient and effective care of trauma patients relies heavily on consistent and accurate triage prior to their arrival at the trauma center. Unfortunately, for a variety of reasons, some patients are mistriaged, meaning that they did not receive the appropriate trauma team activation (TTA) based on the severity of their injuries. Patients who are undertriaged face an increased risk of mortality and adverse outcomes [2,3], whereas overtriage leads to inefficient use of time and resources and can also contribute to provider dissatisfaction [4,5].
Of the two forms of mistriage, undertriage is considered more detrimental. In fact, the American College of Surgeons Committee on Trauma (ACS-COT) defines optimal rates of undertriage as less than 5% and overtriage as less than 35% [6]. However, hospitals worldwide find it challenging to meet these standards, with some reporting undertriage rates nearing 30% and others noting overtriage rates as high as 71% [2,79]. Regular assessments of appropriate triage and mistriage rates are conducted by trauma centers. The Standardized Triage Assessment Tool (STAT) is a commonly used method for evaluating triage patterns [1012]. With the STAT, each patient is assigned a triage designation based on a combination of Injury Severity Scores (ISSs) and the requirement for specific trauma interventions (Fig. 1).
Designing the ideal trauma triage system remains an elusive goal. Much of the previous research has concentrated on identifying patient populations that are often misclassified, with the aim of adjusting the TTA criteria to better serve these patients [1315]. More recently, research has shifted towards evaluating and improving compliance with triage criteria [3,16,17]. However, no consensus yet exists on the best way to minimize rates of mistriage. Given this lack of clarity and the fact that trauma impacts a large proportion of the population, it is crucial to explore potential solutions.
Compliance with a specific institution’s clinical guidelines for TTA is shaped by a complex interplay of numerous factors. These include the quantity and complexity of the guidelines [18,19], the ease of referencing criteria within the workspace [20], the number of staff members involved in implementing the criteria [21], staff education about the criteria [22], and feedback loops for staff regarding clinical performance [20,23]. The influence of human factors, educational infrastructure, and the institutional team culture cannot be overstated. Furthermore, the behavioral tendency of physicians to disregard protocols to avoid so-called cookbook medicine can also affect compliance [24]. Thus, efforts to improve compliance with TTA criteria must include assessment of each of these elements and more.
Objectives
This study explores the execution of a compliance-focused intervention at a level I trauma center. A physician-oriented free-text alert system was transformed into a nonphysician, hospital dispatcher–driven dropdown menu alert system through a series of workflow interventions (Fig. 2). The first objective of the study was to evaluate the compliance rates with TTA criteria before and after the intervention. The second objective was to examine changes in triage patterns preintervention and postintervention. The primary outcome measured was the rate of appropriate triage determined using the STAT. Secondary outcomes included overtriage and undertriage rates, as well as clinical outcomes. We hypothesized that appropriate triage rates would rise in correlation with improved compliance with the existing TTA criteria. Furthermore, we anticipated a decrease in undertriage and overtriage rates in relation to increased compliance with these criteria.
Ethics statement
This study was approved by the Institutional Review Board of Carilion Clinic (No. 21-1320). The requirement for informed consent was waived due to the retrospective nature of the study.
Study design and population
This before-and-after study involved a retrospective review of trauma patients who presented at a level I trauma center between May 2020 and December 2021. The data selected for extraction were guided by the current TTA guidelines at the trauma center (Fig. 3), as well as previous analyses identifying mistriaged populations and those examining non-compliance with triage guidelines [3,14,15,17]. Direct admissions, patients without TTA, and patients lacking a recorded date of arrival were excluded from the analysis (Fig. 4). We assessed patient demographics, injury patterns, prehospital vital signs, and outcomes to demonstrate equivalence between groups. All data referenced in this study were sourced from the hospital trauma registry and electronic medical records.
Process intervention
Two workflow changes were implemented to transform a physician-driven, free-text alert system into a nonphysician, hospital dispatcher–driven alert system. The latter system utilizes dropdown menus to ensure maximum compliance (Fig. 2). The first change involved altering who was responsible for assigning the TTA level. In the original system, first responders arriving on the scene would relay a patient report to the attending physician in the emergency department. This physician would then assign the TTA level for the incoming patient. In the revised system, first responders provide their report to trained hospital dispatchers, who may be registered nurses, paramedics, or emergency medical technicians. These dispatchers are then responsible for assigning the TTA level. The attending physician is only contacted if the dispatcher has a question or concern. The second major workflow intervention was the introduction of a dropdown menu within the computer-based interface used for TTA alerts. Previously, the reason for TTA was entered into a free-text box. In the updated system, hospital dispatchers select the TTA indication from a dropdown menu. This provides just-in-time reminders of the TTA criteria and encourages adherence to these criteria. These changes were implemented sequentially, with the first change taking effect on March 10, 2021, and the second on May 12, 2021. We defined the preintervention period as May 12, 2020, through December 31, 2020, and the postintervention period as May 12, 2021, through December 31, 2021. We chose these time periods so that the months would align between cohorts, considering the seasonal variations in trauma patient presentations.
Compliance
We measured compliance with trauma triage guidelines by examining trauma patients who met at least one objective predetermined prehospital criterion for full TTA, as recorded by emergency medical services (EMS). For our trauma center, these criteria included a heart rate of ≤60 or ≥120 beats/min, a systolic blood pressure of <100 mmHg, a respiratory rate of <10 or >29 breaths/min, and a Glasgow Coma Scale score of 8 or lower. We classified each patient as either compliant or noncompliant, based on whether the correct TTA was initiated before the patient arrived. If a patient’s TTA level was upgraded or downgraded during transport, we grouped them with their final classification.
Defining appropriate triage and mistriage
All trauma patients were evaluated using the STAT [1012]. This tool is a combination of the widely used Cribari Matrix Method (CMM) and the Need for Trauma Intervention (NFTI) method (Fig. 1). With the CMM, patients are evaluated based on their ISSs, a measure that reflects both the number and severity of injuries across different body regions. According to the CMM, any patient with an ISS greater than 15 should be given the highest level of TTA, hereafter referred to as a full alert. In the NFTI method, in contrast, patients are classified based on their need for specific emergency hospital interventions. Patients who require these interventions (NFTI+ patients) should also be assigned a full alert. NFTI criteria include receiving a blood transfusion within 4 hours of arrival, being discharged to the operating room within 90 minutes of arrival, being discharged to interventional radiology, being discharged to the intensive care unit, having an intensive care unit stay of at least 3 days, requiring mechanical ventilation during the first 3 days (excluding anesthesia), or dying within 60 hours of arrival [10]. Consequently, at the institution in the present study, undertriaged patients were defined as those with an ISS greater than 15 and a positive NFTI designation who were not assigned a full alert. Conversely, overtriaged patients were defined as those assigned a full alert despite having an ISS less than 15 and a negative NFTI designation.
Statistical analysis
The Fisher exact test was used for all categorical variables, while the Welch t-test was employed for continuous variables, with an α value of 0.05. All statistical analysis was conducted using R ver. 4.1.3 (R Foundation for Statistical Computing).
Patient characteristics
A total of 4,953 patients presented to our trauma center during the study period. After application of the exclusion criteria, the number was reduced to 3,693. These patients were divided into two groups, with 1,647 patients in the preintervention group and 2,046 in the postintervention group. We characterized patient demographics, injury patterns, and physiological parameters both before and after the process interventions (Table 1). Generally, the characteristics of patients in both groups were similar, with the exception of age and average ISS.
Compliance
The overall compliance rates with the objective vital sign criteria for a full alert significantly improved, rising from 70.3% in the preintervention group to 79.3% in the postintervention group (P=0.023). When examining compliance with individual objective vital sign criteria, we noted a significant increase in compliance for bradycardia, from 44.8% to 79.2% (P=0.005). Trends also indicated improved compliance in all categories except for tachypnea (Fig. 5). Furthermore, we observed a trend suggesting a decrease in trauma consultations that met the isolated objective vital sign criteria for a full alert, falling from 4.5% to 3.3% (P=0.274) (Table 2).
Triage patterns
Rates of appropriate triage decreased in association with the process intervention (Fig. 6). Following the implementation of this intervention, undertriage rates dropped by almost 50% (from 6.0% to 3.2%, P=0.002), crossing an important threshold to reach the optimal undertriage rate as outlined by the ACS-COT guidelines (<5%) [6]. However, rates of overtriage increased from 46.6% to 57.4% (P<0.001). This substantial increase in overtriage ultimately led to a decrease in the rate of appropriate triage, from 78.4% to 74.6% (P=0.007). Alongside the increased rates of overtriage, we noted a decrease in the number of consults (the lowest level of TTA), which was accompanied by an increase in partial and full alerts (Table 3).
Clinical outcomes
Virtually no significant differences in clinical outcomes were observed between the cohorts (Table 4). The exception was an increase in the average length of stay in the emergency department in the postintervention group.
This study examined the relationship between a new compliance-focused process intervention and the rates of appropriate triage at a level I trauma center. We observed significant improvements in compliance with TTA criteria and undertriage rate. The decrease in the undertriage rate was especially noteworthy, as it brought this metric to an optimal level according to ACS-COT guidelines [6]. However, the rate of appropriate triage ultimately fell due to a substantial increase in the overtriage rate. Despite these unanticipated results, this study offers valuable insights into an easy-to-implement workflow modification that can improve compliance with TTA criteria. Furthermore, the dramatic shifts in triage rates underscore the importance of improving compliance as a crucial step in accurately evaluating an institution’s TTA criteria and guiding future adjustments.
The workflow modifications in this study were designed to increase compliance by simplifying the identification of criteria for a TTA, as well as by reducing the number of designated staff members responsible for assigning the TTA level (from 56 attending physicians preintervention to 10 hospital dispatchers postintervention). Before the intervention, TTA criteria were displayed on the badges of attending physicians and on the desks of hospital dispatchers. However, presenting the criteria in a dropdown menu format offers consistent visual repetition, which enhances memory and retention of the criteria. Previous research has shown that compliance with guidelines in various clinical settings can be improved by making the guidelines more accessible, simplifying them, and optimizing team efficiency and education [1822]. Therefore, it is likely that both the dropdown menu modification and the dispatcher–driven system contributed to the overall improvement in compliance.
The present study also provides the valuable insight that doctors may not need to shoulder the responsibility of assigning each TTA level. The 2022 Physician Burnout and Depression Report highlights that emergency department physicians reported the highest burnout rates among specialties, at 60%, a rise from 43% in the previous year [25]. Given this escalating burnout rate, the importance of eliminating an unnecessary task for emergency department physicians is paramount, especially as hospitals nationwide continue to deal with the burden of the COVID-19 pandemic.
Interestingly, only compliance with bradycardia showed significant improvement in isolation despite a significant improvement in overall compliance. Additionally, compliance with some criteria (bradypnea, tachypnea) remained low, even in the postintervention period. Bradypnea and tachypnea had the smallest postintervention sample sizes across all isolated, objective criteria, with only four and 20 patients, respectively. Additionally, the dropdown menu was limited to 10 options, including “other,” which were selected based on the frequency of patients presenting to this institution with the alert criteria. Respiratory rates were not included as a criterion on the dropdown menu due to their low frequency, although dispatchers were trained to identify these criteria and could trigger a corresponding alert via the “other” category. Consequently, it is plausible that dispatchers were less likely to identify these criteria as being met, given their lower frequency and absence from the dropdown menus.
Another important observation is that despite a significant increase in overall compliance, the rate of compliance with isolated, objective criteria reached only 79.3%. One possible explanation is that patients who present with a traumatic injury mechanism but meet no other criteria aside from an abnormal vital sign, may seem less severely injured and more susceptible to a downgraded alert. Furthermore, the actual overall compliance rate at this institution for all patients could potentially be higher, as many patients fulfill multiple criteria and are therefore more likely to trigger TTA.
Previous research has pinpointed TTA criteria and compliance as potential areas for improvement in order to increase appropriate triage rates and decrease mistriage rates. However, changes in compliance with TTA criteria are seldom reported alongside mistriage rates. Tignanelli and colleagues [3] investigated these factors together and discovered that improved adherence to the ACS-COT minimum criteria led to a decrease in undertriage and an increase in overtriage. This study, however, analyzed only the six mandatory criteria. Many institutions heavily augment these criteria to better cater to their specific patient populations. Alternatively, many studies have individually tackled the question of which criteria, if any, should be added to the ACS-COT minimum criteria. The overarching goal of these studies is often to reduce undertriage. For instance, both Benjamin et al. [13] and Bardes et al. [26] advocated for the inclusion of age as a TTA criterion, while Schellenberg et al. [27] proposed a higher cutoff for the Glasgow Coma Scale TTA criteria in patients with a head injury. However, these studies had a limitation: each trauma center caters to a unique patient population, which may not all benefit equally from such changes in criteria.
Other studies have focused on enhancing compliance in order to improve the accuracy of triage rates. Stonko et al. [16] suggested a question-based system to boost adherence to existing alert criteria. In their single-center study involving 520 patients, the trauma activation protocol was modified from a PDF-based flow chart to an automated web tool. This tool guided dispatchers through a series of questions based on prehospital EMS data and automatically assigned a TTA level, resulting in a reduction of mistriage rates by over 50%. Notably, in that study, mistriage was defined as incorrect TTA leveling based on EMS data, a definition resembling that of non-compliance in the present study. While the intervention of Stonko et al. [16] shares mechanistic similarities with the workflow interventions discussed in our study, our research examines both compliance and triage patterns within a larger sample size and over a longer period.
In addition to triage patterns and compliance rates, clinical outcomes are a common metric among studies seeking to optimize trauma triage. Tignanelli et al. [3] described an association between increased compliance with the ACS-COT minimum criteria and decreased mortality. However, in the present study, no significant decrease in mortality was observed in the postintervention group. Moreover, we found an increase in the average length of stay in the emergency department for the postintervention group. This finding could potentially be attributed to the burden placed on this hospital by COVID-19. Throughout much of the latter half of 2021, the trauma center, the emergency department, and the hospital as a whole were functioning at an unusually high capacity.
At our institution, we have identified patterns of patients who are frequently overtriaged, and we have adjusted the TTA criteria to reflect these patterns. We are currently analyzing the impact of these changes. While undertriage is generally viewed as less desirable than overtriage, it is well-known that overtriage is linked to higher costs [28]. As a result of the observed changes in triage patterns, we anticipated and observed an increase in the percentage of full alerts (Table 3). In 2021, the cost of a full alert at this institution was $8,605. Therefore, the 10.8% increase in overtriage rates in the postintervention group would have led to an estimated additional healthcare cost of approximately $1,901,430 over 7.5 months. By nature, triage involves a balancing act between overtriage and undertriage. Each institution must evaluate and establish its own ideal balance to effectively cater to its unique patient population. In the end, we expect that a dual approach of improved compliance and adjusted alert criteria will help achieve optimal levels of appropriate triage and mistriage.
Limitations
This study had several limitations. First, we lacked a reliable method to determine which patients had their TTA level assigned through physician discretion within the trauma database or electronic health record. Physician discretion is a mandatory component of the minimum criteria for a full TTA, as per the ACS-COT minimum criteria [6]. In the newly implemented TTA system, hospital dispatchers contact a physician in cases of uncertainty about an incoming trauma patient. The physician can then manually assign the alert level. Likewise, a physician can upgrade or downgrade an alert after activation based on their clinical judgment. Future research may focus on developing a reliable method to examine the frequency of TTA due to physician discretion and evaluate its impact on triage patterns. Second, this study did not analyze nonobjective criteria, so we did not assess compliance with other criteria such as penetrating trauma proximal to the knee or mangled extremity. Given the complexity and subjective nature of many of these criteria, it was not feasible to assess compliance retrospectively within the trauma registry. Third, the data presented here were recorded during the COVID-19 pandemic, with potential implications on the study population or the functioning of hospital processes. Fourth, the decision to activate a trauma team was based on information from the prehospital EMS environment, as is standard practice at trauma centers. Currently, no measure is available of how accurately this data corresponds to a patient’s clinical presentation upon arrival. However, barring EMS equipment failure, the objective alert criteria used in this study should have provided an accurate representation of the patient’s clinical condition at the time of the alert. Finally, all of the data were collected retrospectively, making the analysis potentially subject to errors in data entry or confounding variables.
Conclusions
The implementation of a technology-based alert system, driven by hospital dispatchers, was linked to a significant increase in compliance with existing TTA criteria. However, it also led to an unexpected decrease in appropriate triage due to a substantial rise in overtriage. Interestingly, the increased compliance with TTA criteria was associated with a decrease in undertriage rates, shifting our system from exceeding to falling below the target for optimal undertriage rates. The decline in appropriate triage, despite improvements in compliance, suggests that the current TTA criteria at this institution may not be sufficiently tailored to our patient population to achieve an optimal balance between minimizing both undertriage and overtriage. This observation underscores the importance of improved compliance as a crucial step in assessing the effectiveness of existing TTA criteria and will inform revisions to the current TTA criteria at this institution. Furthermore, future research may explore the relationship between compliance with TTA criteria and the provision of regular feedback to hospital dispatchers about their performance in assigning TTA levels using objective criteria.

Author contributions

Conceptualization: all authors; Data curation: PAB; Formal analysis: MEH, ANT; Investigation: all authors; Methodology: all authors; Project administration: all authors; Supervision: JRG; Validation: PAB; Visualization: MEH; Writing–original draft: MEH, JRG; Writing–review & editing: all authors. All authors read and approved the final manuscript.

Conflicts of interest

The authors have no conflicts of interest to declare.

Funding

The authors did not receive any financial support for this study.

Data availability

Data of this study are available from the corresponding author upon reasonable request.

Additional information

The preliminary data from this project was presented at the 2022 American College of Surgeons Annual Meeting, Virginia Chapter on April 29-30, 2022, at the Kingsmill Resort in Williamsburg, Virginia.

The authors thank Cara Spivey, MS (Virginia Tech Carilion School of Medicine; Carilion Clinic Research and Development, Roanoke, VA, USA), for her support on this project.
Fig. 1.
Workflow of the Standardized Triage Assessment Tool (STAT), used to determine triage rates. The STAT is a combination of the Cribari Matrix Method (CMM) and the Need for Trauma Intervention (NFTI) tool. AT, appropriate triage; OT, overtriage; UT, undertriage; ISS, Injury Severity Score.
jti-2023-0020f1.jpg
Fig. 2.
Preintervention and postintervention processes for designating trauma alert levels. Hospital dispatchers are first responders or emergency nurses. (A) Preintervention physician-driven, free-text entry alert system. (B) Postintervention hospital dispatcher–driven, dropdown menu alert system. The hexagon represents the process intervention. EMS, emergency medical services; CPR, cardiopulmonary resuscitation; GCS, Glasgow Coma Scale; SBP, systolic blood pressure; HR, heart rate.
jti-2023-0020f2.jpg
Fig. 3.
Trauma team activation criteria for this institution. CPR, cardiopulmonary resuscitation; GCS, Glasgow Coma Scale; LOC, loss of consciousness; TBSA, total body surface area; TBI, traumatic brain injury.
jti-2023-0020f3.jpg
Fig. 4.
Inclusion and exclusion criteria for this study.
jti-2023-0020f4.jpg
Fig. 5.
Compliance rates among trauma patients with objective, isolated trauma team activation (TTA) criteria in the preintervention (May 12, 2020–December 31, 2020) and postintervention (May 12, 2021–December 31, 2021) groups. The Fisher exact test was used. Includes all three TTA tiers (full, partial, and consult). EMS, emergency medical services; SBP, systolic blood pressure; HR, heart rate; RR, respiratory rate; GCS, Glasgow Coma Scale.
jti-2023-0020f5.jpg
Fig. 6.
Appropriate triage, overtriage, and undertriage in the preintervention (May 12, 2020–December 31, 2020) and postintervention (May 12, 2021–December 31, 2021) groups. The American College of Surgeons Committee on Trauma recommends upper limits for overtriage and undertriage of 35% and 5%, respectively. The Fisher exact test was used.
jti-2023-0020f6.jpg
Table 1.
Patient characteristics in the preintervention and postintervention groups (n=3,693)
Variable Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
Sex 0.060
 Male 1,075 (65.3) 1,273 (62.2)
 Female 572 (34.7) 773 (37.8)
Age (yr) 54.2±21.8 55.8±21.9 0.027
Race 0.439
 White 1,308 (79.4) 1,671 (81.7)
 Black or African American 250 (15.2) 271 (13.3)
 Asian 10 (0.6) 15 (0.7)
 American Indian 4 (0.2) 4 (0.2)
 Native Hawaiian 2 (0.1) 1 (0.05)
 Unknown 13 (0.8) 22 (1.1)
 Other 60 (3.6) 62 (3.0)
Injury category 0.462
 Blunt 1,445 (87.7) 1,816 (88.8)
 Penetrating 178 (10.8) 197 (9.6)
 Burn 16 (1.0) 24 (1.2)
 Other or NA 11 (0.7) 9 (0.4)
Injury mechanism 0.099
 Fall 700 (42.5) 925 (45.2)
 Motor vehicle crash 429 (26.1) 518 (25.3)
 Assault 96 (5.8) 90 (4.4)
 Gunshot wound 92 (5.6) 87 (4.3)
 Stab wound 23 (1.4) 26 (1.3)
 Other 307 (18.6) 400 (19.6)
Injury Severity Score 10.4±9.4 8.7±8.6 <0.001a)
EMS vital sign
 Systolic blood pressure (mmHg) 136.7±31.9 135.5±31.5 0.253
 Heart rate (beats/min) 94.6±24.9 94.3±26.4 0.723
 Respiratory rate (breaths/min) 18.6±5.7 18.4±5.5 0.282
 GCS score 13.3±3.4 13.5±3.1 0.065

Values are presented as number (%) or mean±standard deviation. The Fisher exact test was used for categorical variables, while the Welch t-test was employed for continuous variables.

NA, not available; EMS, emergency medical services; GCS, Glasgow Coma Scale.

a) Cohen d=0.2.

Table 2.
Assessment of trauma consults in the preintervention and postintervention groups
Variable Preinterventiona) Postinterventionb) P-value (α=0.05)
Trauma consults meeting isolated EMS vital sign criteria 31 (4.5) 24 (3.3) 0.274
UT trauma consults meeting any EMS vital sign criteria 6 (13.0) 3 (10.7) >0.999

Values are presented as number (%). Vital sign criteria include EMS measurements of systolic blood pressure <100 mmHg, heart rate ≤60 or ≥120 beats/min, respiratory rate <10 or >29 breaths/min, and Glasgow Coma Scale score ≤8. The Fisher exact test was used.

EMS, emergency medical services; UT, undertriaged.

a) 691 Trauma consults and 46 UT trauma consults.

b) 721 Trauma consults and 28 UT trauma consults.

Table 3.
Alert types in the preintervention and postintervention groups (n=3,693)
Alert type Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
Full 631 (38.3) 838 (41.0) <0.001
Partial 325 (19.7) 487 (23.8)
Consult 691 (42.0) 721 (35.2)

The Fisher exact test was used.

Table 4.
Clinical outcomes in the preintervention and postintervention groups (n=3,693)
Outcome Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
Mortality 121 (7.4) 138 (6.7) 0.518
Discharged to home 1,154 (70.1) 1,426 (69.7) 0.836
Hospital LOS (day) 5.7±8.8 5.3±8.2 0.157
ED LOS (hr) 10.4±12.0 13.5±14.0 <0.001

Values are presented as number (%) or mean±standard deviation. The Fisher exact test was used for categorical variables, while the Welch t-test was employed for continuous variables.

LOS, length of stay; ED, emergency department.

  • 1. National Center for Injury Prevention and Control. Data and statistics (WISQARS) [Internet]. Centers for Disease Control and Prevention. [cited 2022 Apr 20]. Available from: www.cdc.gov/injury/wisqars.
  • 2. Rainer TH, Cheung NK, Yeung JH, Graham CA. Do trauma teams make a difference?: a single centre registry study. Resuscitation 2007;73:374–81. ArticlePubMed
  • 3. Tignanelli CJ, Vander Kolk WE, Mikhail JN, Delano MJ, Hemmila MR. Noncompliance with American College of Surgeons Committee on Trauma recommended criteria for full trauma team activation is associated with undertriage deaths. J Trauma Acute Care Surg 2018;84:287–94. ArticlePubMed
  • 4. Lehmann R, Brounts L, Lesperance K, et al. A simplified set of trauma triage criteria to safely reduce overtriage: a prospective study. Arch Surg 2009;144:853–8. ArticlePubMed
  • 5. Shawhan RR, McVay DP, Casey L, Spears T, Steele SR, Martin MJ. A simplified trauma triage system safely reduces overtriage and improves provider satisfaction: a prospective study. Am J Surg 2015;209:856–63. ArticlePubMed
  • 6. American College of Surgeons Committee on Trauma. Resources for optimal care of the injured patient. American College of Surgeons; 2014.
  • 7. Staudenmayer K, Lin F, Mackersie R, Spain D, Hsia R. Variability in California triage from 2005 to 2009: a population-based longitudinal study of severely injured patients. J Trauma Acute Care Surg 2014;76:1041–7. PubMedPMC
  • 8. Xiang H, Wheeler KK, Groner JI, Shi J, Haley KJ. Undertriage of major trauma patients in the US emergency departments. Am J Emerg Med 2014;32:997–1004. ArticlePubMed
  • 9. Dehli T, Fredriksen K, Osbakk SA, Bartnes K. Evaluation of a university hospital trauma team activation protocol. Scand J Trauma Resusc Emerg Med 2011;19:18. ArticlePubMedPMC
  • 10. Roden-Foreman JW, Rapier NR, Yelverton L, Foreman ML. Asking a better question: development and evaluation of the Need For Trauma Intervention (NFTI) metric as a novel indicator of major trauma. J Trauma Nurs 2017;24:150–7. ArticlePubMed
  • 11. Roden-Foreman JW, Rapier NR, Yelverton L, Foreman ML. Avoiding Cribari gridlock: the standardized triage assessment tool improves the accuracy of the Cribari matrix method in identifying potential overtriage and undertriage. J Trauma Acute Care Surg 2018;84:718–26. ArticlePubMed
  • 12. Roden-Foreman JW, Rapier NR, Foreman ML, et al. Avoiding Cribari gridlock 2: the standardized triage assessment tool outperforms the Cribari matrix method in 38 adult and pediatric trauma centers. Injury 2021;52:443–9. ArticlePubMed
  • 13. Benjamin ER, Khor D, Cho J, Biswas S, Inaba K, Demetriades D. The age of undertriage: current trauma triage criteria underestimate the role of age and comorbidities in early mortality. J Emerg Med 2018;55:278–87. ArticlePubMed
  • 14. Demetriades D, Sava J, Alo K, et al. Old age as a criterion for trauma team activation. J Trauma 2001;51:754–7. ArticlePubMed
  • 15. Schellenberg M, Benjamin E, Bardes JM, Inaba K, Demetriades D. Undertriaged trauma patients: who are we missing. J Trauma Acute Care Surg 2019;87:865–9. ArticlePubMed
  • 16. Stonko DP, O Neill DC, Dennis BM, Smith M, Gray J, Guillamondegui OD. Trauma quality improvement: reducing triage errors by automating the level assignment process. J Surg Educ 2018;75:1551–7. ArticlePubMed
  • 17. Linder F, Holmberg L, Eklof H, Bjorck M, Juhlin C, Mani K. Better compliance with triage criteria in trauma would reduce costs with maintained patient safety. Eur J Emerg Med 2019;26:283–8. ArticlePubMed
  • 18. Qumseya B, Goddard A, Qumseya A, Estores D, Draganov PV, Forsmark C. Barriers to clinical practice guideline implementation among physicians: a physician survey. Int J Gen Med 2021;14:7591–8. ArticlePubMedPMCPDF
  • 19. Francke AL, Smit MC, de Veer AJ, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak 2008;8:38. ArticlePubMedPMCPDF
  • 20. Fischer F, Lange K, Klose K, Greiner W, Kraemer A. Barriers and strategies in guideline implementation: a scoping review. Healthcare (Basel) 2016;4:36. ArticlePubMedPMC
  • 21. Driscoll PA, Vincent CA. Variation in trauma resuscitation and its effect on patient outcome. Injury 1992;23:111–5. ArticlePubMed
  • 22. Verhoeff K, Saybel R, Fawcett V, Tsang B, Mathura P, Widder S. A quality-improvement approach to effective trauma team activation. Can J Surg 2019;62:305–14. ArticlePubMedPMC
  • 23. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012;(6):CD000259. ArticlePubMedPMC
  • 24. Prasad M, Christie JD, Bellamy SL, Rubenfeld GD, Kahn JM. The availability of clinical protocols in US teaching intensive care units. J Crit Care 2010;25:610–9. ArticlePubMedPMC
  • 25. Kane L. Physician burnout & depression report 2022: stress, anxiety, and anger [Internet]. Medscape; 2022 [cited 2022 Dec 2]. Available from: https://www.medscape.com/2022-lifestyle-burnout.
  • 26. Bardes JM, Benjamin E, Schellenberg M, Inaba K, Demetriades D. Old age with a traumatic mechanism of injury should be a trauma team activation criterion. J Emerg Med 2019;57:151–5. ArticlePubMed
  • 27. Schellenberg M, Benjamin E, Owattanapanich N, Inaba K, Demetriades D. The impact of delayed time to first CT head in traumatic brain injury. Eur J Trauma Emerg Surg 2021;47:1511–6. ArticlePubMedPDF
  • 28. Scott M, Abouelela W, Blitzer DN, Murphy T, Peck G, Lissauer M. Trauma service utilization increases cost but does not add value for minimally injured patients. Value Health 2020;23:705–9. ArticlePubMed

Figure & Data

References

    Citations

    Citations to this article as recorded by  

      Figure
      • 0
      • 1
      • 2
      • 3
      • 4
      • 5
      Impact of nonphysician, technology-guided alert level selection on rates of appropriate trauma triage in the United States: a before and after study
      Image Image Image Image Image Image
      Fig. 1. Workflow of the Standardized Triage Assessment Tool (STAT), used to determine triage rates. The STAT is a combination of the Cribari Matrix Method (CMM) and the Need for Trauma Intervention (NFTI) tool. AT, appropriate triage; OT, overtriage; UT, undertriage; ISS, Injury Severity Score.
      Fig. 2. Preintervention and postintervention processes for designating trauma alert levels. Hospital dispatchers are first responders or emergency nurses. (A) Preintervention physician-driven, free-text entry alert system. (B) Postintervention hospital dispatcher–driven, dropdown menu alert system. The hexagon represents the process intervention. EMS, emergency medical services; CPR, cardiopulmonary resuscitation; GCS, Glasgow Coma Scale; SBP, systolic blood pressure; HR, heart rate.
      Fig. 3. Trauma team activation criteria for this institution. CPR, cardiopulmonary resuscitation; GCS, Glasgow Coma Scale; LOC, loss of consciousness; TBSA, total body surface area; TBI, traumatic brain injury.
      Fig. 4. Inclusion and exclusion criteria for this study.
      Fig. 5. Compliance rates among trauma patients with objective, isolated trauma team activation (TTA) criteria in the preintervention (May 12, 2020–December 31, 2020) and postintervention (May 12, 2021–December 31, 2021) groups. The Fisher exact test was used. Includes all three TTA tiers (full, partial, and consult). EMS, emergency medical services; SBP, systolic blood pressure; HR, heart rate; RR, respiratory rate; GCS, Glasgow Coma Scale.
      Fig. 6. Appropriate triage, overtriage, and undertriage in the preintervention (May 12, 2020–December 31, 2020) and postintervention (May 12, 2021–December 31, 2021) groups. The American College of Surgeons Committee on Trauma recommends upper limits for overtriage and undertriage of 35% and 5%, respectively. The Fisher exact test was used.
      Impact of nonphysician, technology-guided alert level selection on rates of appropriate trauma triage in the United States: a before and after study
      Variable Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
      Sex 0.060
       Male 1,075 (65.3) 1,273 (62.2)
       Female 572 (34.7) 773 (37.8)
      Age (yr) 54.2±21.8 55.8±21.9 0.027
      Race 0.439
       White 1,308 (79.4) 1,671 (81.7)
       Black or African American 250 (15.2) 271 (13.3)
       Asian 10 (0.6) 15 (0.7)
       American Indian 4 (0.2) 4 (0.2)
       Native Hawaiian 2 (0.1) 1 (0.05)
       Unknown 13 (0.8) 22 (1.1)
       Other 60 (3.6) 62 (3.0)
      Injury category 0.462
       Blunt 1,445 (87.7) 1,816 (88.8)
       Penetrating 178 (10.8) 197 (9.6)
       Burn 16 (1.0) 24 (1.2)
       Other or NA 11 (0.7) 9 (0.4)
      Injury mechanism 0.099
       Fall 700 (42.5) 925 (45.2)
       Motor vehicle crash 429 (26.1) 518 (25.3)
       Assault 96 (5.8) 90 (4.4)
       Gunshot wound 92 (5.6) 87 (4.3)
       Stab wound 23 (1.4) 26 (1.3)
       Other 307 (18.6) 400 (19.6)
      Injury Severity Score 10.4±9.4 8.7±8.6 <0.001a)
      EMS vital sign
       Systolic blood pressure (mmHg) 136.7±31.9 135.5±31.5 0.253
       Heart rate (beats/min) 94.6±24.9 94.3±26.4 0.723
       Respiratory rate (breaths/min) 18.6±5.7 18.4±5.5 0.282
       GCS score 13.3±3.4 13.5±3.1 0.065
      Variable Preinterventiona) Postinterventionb) P-value (α=0.05)
      Trauma consults meeting isolated EMS vital sign criteria 31 (4.5) 24 (3.3) 0.274
      UT trauma consults meeting any EMS vital sign criteria 6 (13.0) 3 (10.7) >0.999
      Alert type Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
      Full 631 (38.3) 838 (41.0) <0.001
      Partial 325 (19.7) 487 (23.8)
      Consult 691 (42.0) 721 (35.2)
      Outcome Preintervention (n=1,647) Postintervention (n=2,046) P-value (α=0.05)
      Mortality 121 (7.4) 138 (6.7) 0.518
      Discharged to home 1,154 (70.1) 1,426 (69.7) 0.836
      Hospital LOS (day) 5.7±8.8 5.3±8.2 0.157
      ED LOS (hr) 10.4±12.0 13.5±14.0 <0.001
      Table 1. Patient characteristics in the preintervention and postintervention groups (n=3,693)

      Values are presented as number (%) or mean±standard deviation. The Fisher exact test was used for categorical variables, while the Welch t-test was employed for continuous variables.

      NA, not available; EMS, emergency medical services; GCS, Glasgow Coma Scale.

      Cohen d=0.2.

      Table 2. Assessment of trauma consults in the preintervention and postintervention groups

      Values are presented as number (%). Vital sign criteria include EMS measurements of systolic blood pressure <100 mmHg, heart rate ≤60 or ≥120 beats/min, respiratory rate <10 or >29 breaths/min, and Glasgow Coma Scale score ≤8. The Fisher exact test was used.

      EMS, emergency medical services; UT, undertriaged.

      691 Trauma consults and 46 UT trauma consults.

      721 Trauma consults and 28 UT trauma consults.

      Table 3. Alert types in the preintervention and postintervention groups (n=3,693)

      The Fisher exact test was used.

      Table 4. Clinical outcomes in the preintervention and postintervention groups (n=3,693)

      Values are presented as number (%) or mean±standard deviation. The Fisher exact test was used for categorical variables, while the Welch t-test was employed for continuous variables.

      LOS, length of stay; ED, emergency department.


      J Trauma Inj : Journal of Trauma and Injury
      TOP