Article Text

other Versions

Effects of the COVID-19 pandemic on stroke response times: a systematic review and meta-analysis
Free
  1. Noah L A Nawabi1,2,
  2. Akiro H Duey1,
  3. John L Kilgallon1,3,
  4. Charissa Jessurun1,4,
  5. Joanne Doucette1,5,
  6. Rania A Mekary1,6,
  7. Mohammad Ali Aziz-Sultan1,2
  1. 1Computational Neuroscience Outcomes Center, Harvard Medical School, Boston, Massachusetts, USA
  2. 2Department of Neurosurgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
  3. 3Department of General Internal Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
  4. 4Department of Neurosurgery, Leiden University Medical Center, Leiden, Zuid-Holland, The Netherlands
  5. 5Department of Library and Learning Resources, Massachusetts College of Pharmacy and Health Sciences, Boston, Massachusetts, USA
  6. 6Department of Pharmaceutical Business and Administrative Sciences, Massachusetts College of Pharmacy and Health Sciences, Boston, Massachusetts, USA
  1. Correspondence to Noah L A Nawabi, Computational Neuroscience Outcomes Center, Harvard Medical School, Boston, MA 02115, USA; nnawabi{at}bwh.harvard.edu

Abstract

Objectives COVID-19 presents a risk for delays to stroke treatment. We examined how COVID-19 affected stroke response times.

Methods A literature search was conducted to identify articles covering stroke during COVID-19 that included time metrics data pre- and post-pandemic. For each outcome, pooled relative change from baseline and 95% CI were calculated using random-effects models. Heterogeneity was explored through subgroup analyses comparing comprehensive stroke centers (CSCs) to non-CSCs.

Results 38 included studies reported on 6109 patients during COVID-19 and 14 637 patients during the pre-COVID period. Pooled increases of 20.9% (95% CI 5.8% to 36.1%) in last-known-well (LKW) to arrival times, 1.2% (−2.9% to 5.3%) in door-to-imaging (DTI), 0.8% (–2.9% to 4.5%) in door-to-needle (DTN), 2.8% (−5.0% to 10.6%) in door-to-groin (DTG), and 19.7% (11.1% to 28.2%) in door-to-reperfusion (DTR) times were observed during COVID-19. At CSCs, LKW increased by 24.0% (−0.3% to 48.2%), DTI increased by 1.6% (−3.0% to 6.1%), DTN increased by 3.6% (1.2% to 6.0%), DTG increased by 4.6% (−5.9% to 15.1%), and DTR increased by 21.2% (12.3% to 30.1%). At non-CSCs, LKW increased by 12.4% (−1.0% to 25.7%), DTI increased by 0.2% (−2.0% to 2.4%), DTN decreased by −4.6% (−11.9% to 2.7%), DTG decreased by −0.6% (−8.3% to 7.1%), and DTR increased by 0.5% (−31.0% to 32.0%). The increases during COVID-19 in LKW (p=0.01) and DTR (p=0.00) were statistically significant, as was the difference in DTN delays between CSCs and non-CSCs (p=0.04).

Conclusions Factors during COVID-19 resulted in significantly delayed LKW and DTR, and mild delays in DTI, DTN, and DTG. CSCs experience more pronounced delays than non-CSCs.

  • Stroke
  • COVID-19

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

In a brain suffering from an ischemic stroke, 1.9 million neurons, 14 billion synapses, and 7.5 miles of myelinated fibers are lost each minute.1 Time is brain, and COVID-19 presents a threat to care teams’ ability to treat stroke patients rapidly.

While virus-related precautions and a mass influx of COVID-19 patients into the world’s hospitals will intuitively cause delays to stroke treatment, the precise extent of these delays is a measure of critical importance. Understanding if and when delays occurred, and what specifically they were attributed to, will help us appreciate potential unintended effects of viral spread precautions and will illuminate what factors leading to delays are truly in physicians’ control. Achieving this understanding will allow for steps to be taken towards optimizing stroke response workflow for the remainder of the pandemic, and in any future disasters that may occur.

In this study, we set out to assess the effects of the COVID-19 pandemic on the systems approach to stroke care. This system is multifaceted and depends on factors that lie both in the hands of the patients and their network, and in the hands of physicians. We attempt to quantify how and where COVID-19 caused delays to stroke treatment by assessing the presence and extent of delays in individual stroke response time metrics reported by stroke centers across the globe.

Methods

Search strategy

A systematic literature search was performed in PubMed, Embase, and Cochrane on November 19, 2021. The complete search can be found in online supplemental appendix 1.

Study selection

Study screening and data extraction were conducted by two independent reviewers (NN, JK) according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 checklist. In case of disagreement, a third reviewer (AK or CJ) was consulted. Articles were included in the analysis if they: (1) reported institutional stroke response time metrics during the COVID-19 study period and compared these values to a pre-pandemic period; (2) reported on stroke patients of any kind; and (3) reported on at least five participants per group in any study design. The primary outcome of this study was stroke response times as defined by the original study, including: last-known-well (LKW) to arrival time, defined for our purposes as stroke symptom onset to hospital arrival time; door-to-imaging (DTI) time, defined for our purposes as the time elapsed between hospital arrival and first imaging exam undergone; door-to-needle (DTN) time, defined for our purposes as the time elapsed from hospital arrival to administration of intravenous tissue plasminogen activator (tPA); door-to-groin (DTG) time, defined for our purposes as the time elapsed from hospital arrival to groin puncture for mechanical thrombectomy; and door-to-reperfusion (DTR) time, defined for our purposes as the time elapsed from hospital arrival to recanalization of the occluded vessel. Exclusion criteria were: (1) studies utilizing regional or national databases as a data source, or studies containing data from more than one comprehensive stroke center; (2) non-English publications; and (3) case reports and reviews.

Data extraction

The following information was extracted: study characteristics including study design, country, and sample size; time period data including the start and end dates of the defined COVID-19 period and pre-COVID-19 period and study duration; treatment characteristics including stroke response times; and institutional characteristics including academic status of hospital and inclusion of a comprehensive stroke center (CSC) in the study. Centers were deemed to be a CSC only if authors explicitly designated their centers as such. All other centers included in the analysis were assumed to be non-CSCs. Reported reasons for increases in response times, similar response times, or shorter response times before and during the pandemic were extracted from the results and discussion sections of the original studies.

Statistical analysis

To prepare the data for meta-analysis, all medians were converted to means using the method from Hozo et al.2 All studies not reporting a measure of variance (eg, SD; IQR; range) in addition to a measure of central tendency (eg, mean; median) for any of the primary outcomes were excluded from the meta-analysis. The studies included in this meta-analysis reported significantly varied baseline stroke response times. To account for this heterogeneity in outcomes reporting, relative change from pre-COVID-19 (baseline) time (*100%) with 95% confidence intervals (95% CIs) were calculated for each of the original studies. As an extension of the central limit theorem, the difference between two means was assumed to approach a normal distribution with a mean difference equal to the difference in the true population means and a variance equal to the sum of the two variances. We assumed the two variances were not equal (heteroscedasticity). These relative changes from baseline*100% were entered in R and pooled using the DerSimonian and Laird random-effects model.3

The Higgins and Thompson I2 was used to assess heterogeneity among studies; an I2 >50% was considered to be high heterogeneity.4 Pooled analyses were performed, both unstratified and stratified by stroke center status (CSCs vs non-CSCs), and the p value with 95% CI comparing the two strata was generated and reported. Meta-analysis was conducted using the ‘metacont’ function of the meta package in R v 4.0.3 (R Core Team, Vienna, Austria).5 A two-sided p value <5% was considered statistically significant.

Risk of bias assessment

The quality assessment tool for before–after (pre–post) studies with no control group by the National Heart, Lung, and Blood Institute6 (NHLBI) was used to assess the quality of the studies. This tool consists of 12 questions focused on the key concepts for evaluating the internal validity of a study by assessing the clarity of the study question, inclusion and exclusion criteria, sample size, outcome measures, and the statistical methods that examine these outcomes. Questions not relevant to included studies were graded as ‘yes’ equally for all studies. The studies could be graded as poor (≤25%), fair (26–75%), and good (≥76%). To assess potential small-study bias, funnel plots and Egger’s linear regression tests were used for pooled analyses with at least eight studies.7

Results

Systematic review

After deduplication, we identified 1727 possible studies for inclusion in our meta-analysis. During title and abstract screening, 1553 studies were excluded, and during full-text screening, 136 studies were excluded. Reasons for exclusion at this level included insufficient time metrics reporting and reporting on differences in stroke response times between groups of patients in the COVID-19 period only (eg, time metrics for COVID-positive vs COVID-negative patients) as opposed to comparing time metrics between the COVID-19 period and a pre-COVID-19 time period. After screening, we extracted data from 38 studies for meta-analysis (figure 1).

Figure 1

Results of the systematic review of the literature for this study. The database searches returned 1727 studies. Of these, 38 were ultimately included in the analysis. Reasons for exclusion are illustrated. CSCs, comprehensive stroke centers.

Study characteristics

A wide range of countries were represented in our analysis. While the USA and China were the most common study setting (n=9), Australia, Canada, Italy, Spain, and the UK all had multiple studies included in our report. The number of patients presenting with stroke decreased by almost 60% during the study period, with 14 637 patients presenting with stroke during the collective pre-COVID-19 periods and only 6109 in the COVID-19 period. For all studies, the dates for the defined ‘COVID-19 period’ and the ‘pre-COVID-19 period’ were recorded. Twenty-four studies reported on three or more time metrics that were included in the meta-analysis. Twenty-seven studies included a comprehensive stroke center in their review, while 11 did not (table 1).

Table 1

Summary of included studies

Time periods

COVID-19 period start and end dates were similar across studies, with most of them encompassing the months of March through May 2020. The earliest COVID-19 period start date was January 1, 2020, and the latest was March 30, 2020. The earliest COVID-19 period end date was March 7, 2020, and the latest was September 30, 2020. Comparison period dates were more heterogeneous between studies and were either defined as the weeks and months directly preceding the COVID-19 period or the same time period of the previous year (2019), depending on the study. Five studies had a comparison period start date in 2020, 32 had a comparison period start date in 2019, and one had a comparison period start date in 2018 (table 2).

Table 2

Summary of study time periods

Time metrics meta-analysis

The following time metrics were included in the meta-analysis: LKW to arrival time, DTI time, DTN time, DTG time, and DTR time. The absolute mean time metrics pre-COVID-19 and during COVID-19 for each included study are reported in online supplemental appendix 2.

Last-known-well to arrival

We analyzed 33 studies which reported LKW to arrival time as a stroke care metric. The median LKW to arrival time during the COVID-19 period was 295 min (range 88–1041 min) while the median pre-COVID-19 LKW to arrival time was 239.3 (78–960 min). Relative to each studies’ baseline pre-COVID-19 LKW time, we reported a statistically significant 20.9% (95% CI 5.8% to 36.1%, p=0.01) pooled increase in mean LKW to arrival time during the COVID-19 period (figure 2A).

Figure 2

(A) Using the DerSimonian-Laird random-effects method, the normalized mean difference (percent change) in LKW to arrival time between the pre- and post-COVID-19 time periods was calculated for each study and pooled to determine the overall point estimate. The normalized means and SD were calculated by dividing by the baseline pre-COVID-19 mean for each study. (B) Using the DerSimonian-Laird random-effects method, the normalized mean difference (percent change) in DTI time between the pre- and post-COVID-19 time periods was calculated for each study and pooled to determine the overall point estimate. The normalized means and SD were calculated by dividing by the pre-COVID-19 mean for each study. (C) Using the DerSimonian-Laird random-effects method, the normalized mean difference (percent change) in DTN time between the pre- and post-COVID-19 time periods was calculated for each study and pooled to determine the overall point estimate. The normalized means and SD were calculated by dividing by the pre-COVID-19 mean for each study. (D) Using the DerSimonian-Laird random-effects method, the normalized mean difference (percent change) in DTG time between the pre- and post-COVID-19 time periods was calculated for each study and pooled to determine the overall point estimate. The normalized means and SD were calculated by dividing by the pre-COVID-19 mean for each study. (E) Using the DerSimonian-Laird random-effects method, the normalized mean difference (percent change) in DTR time between the pre- and post-COVID-19 time periods was calculated for each study and pooled to determine the overall point estimate. The normalized means and SD were calculated by dividing by the pre-COVID-19 mean for each study. DTG, door-to-groin; DTI, door-to-imaging; DTN, door-to-needle; DTR, door-to-reperfusion; LKW, last-known-well.

Door-to-imaging

We analyzed 18 studies reporting DTI time as a stroke care metric. The median DTI time during the COVID-19 period was 25 min (range 0–61 min) while the median pre-COVID-19 DTI time was 23 min (range 2.3–88.3 min). Relative to each studies’ baseline pre-COVID-19 DTI time, we reported a pooled increase of 1.2% (95% CI –2.9% to 5.3%) in DTI time during the COVID-19 period (figure 2B).

Door-to-needle

We analyzed 26 studies reporting DTN time as a stroke care metric. The median DTN time during the COVID-19 period was 51 min (range 21–221 min) while the median pre-COVID-19 DTN time was 49 min (22–129 min). Relative to each studies’ baseline pre-COVID-19 DTN time, we reported a pooled increase of 0.8% (95% CI –2.9% to 4.5%) in mean DTN time during the COVID-19 period (figure 2C).

Door-to-groin

We analyzed 24 studies reporting DTG time as a stroke care metric. The median DTG time during the COVID-19 period was 93 min (range 54–216 min) while the median DTG time during the pre-COVID-19 period was 95 min (53–445 min). Relative to each studies’ baseline pre-COVID-19 DTG time, we reported a pooled increase of 2.8% (95% CI −5.0% to 10.6%) in mean DTG time during the COVID-19 period (figure 2D).

Door-to-reperfusion

We analyzed seven studies reporting DTR time as a stroke care metric. The median DTR time during the COVID-19 period was 118 min (range 95–215 min) while the median DTR time during the pre-COVID-19 period was 101 min (range 73–180 min). Relative to each studies’ baseline pre-COVID-19 DTR time, we reported a statistically significant pooled increase of 19.7% (95% CI 11.1% to 28.2%, p=0.00) in mean DTR time during the COVID-19 period (figure 2E).

Time metric subgroup analysis

The following results were obtained after stratifying results by stroke center status. Overall analysis results are displayed in table 3.

Table 3

Relative change from baseline (95% CI) for overall and stratified center status (comprehensive; non-comprehensive)

Last-known-well to arrival

Mean LKW to arrival time increased by 24.0% (95% CI –0.3% to 48.2%) (I2 81%, n=24 studies) at CSCs and by 12.4% (95% CI –1.0% to 25.7%) (I2 46%, n=9 studies) at non-CSCs. There was no statistically significant difference in mean LKW to arrival time change between CSCs and non-CSCs (p=0.41).

Door-to-imaging

Mean DTI time increased by 1.6% (95% CI –3.0% to 6.1%) (I2 97%, n=16 studies) at CSCs and by 0.2% (95% CI –2.0% to 2.4%) (I2 0%; n=2 studies) at non-CSCs. There was no statistically significant difference in DTI time change between CSCs and non-CSCs (p=0.59).

Door-to-needle

Mean DTN time increased by 3.6% (95% CI 1.2% to 6.0%) (I2 18%; n=18 studies) at CSCs, while mean DTN time decreased by 4.6% (95% CI –11.9% to 2.7%) (I2 91%; n=8 studies) at non-CSCs. The reported difference between CSCs and non-CSCs was statistically significant (p=0.04).

Door-to-groin

Mean DTG time increased by 4.6% (95% CI –5.9% to 15.1%) (I2 70%, n=17 studies) at CSCs and decreased by 0.6% (95% CI –8.3% to 7.1%) (I2 7%, n=7 studies) at non-CSCs. There was no statistically significant difference in mean DTG time change between CSCs and non-CSCs (p=0.43).

Door-to-reperfusion

Mean DTR time increased by 21.2% (95% CI 12.3% to 30.1%) (I2 0%, n=4 studies) at CSCs and by 0.5% (95% CI –31.0% to 32.0%) (I2 33%, n=2 studies) at non-CSCs. There was no statistically significant difference in mean DTR time change between CSCs and non-CSCs (p=0.21).

Evaluation of study quality and small study effect

All included studies were found to be of ‘good’ study quality based on the quality assessment tool for before–after (pre–post) studies with no control group by the NHLBI.6 Although the funnel plots for each time metric show minor signs of asymmetry (online supplemental appendix 3), Egger’s test did not find any significant small study effect for any of these outcomes (see online supplemental appendix 4). A funnel plot was not constructed for DTR because fewer than eight studies were included in that analysis. It is possible that minor asymmetry is a result of the high heterogeneity among articles in our study.

Discussion

Our results showed that all time metrics increased in the pandemic period, though LKW to arrival and DTR times were the only statistically significant delays, and the most pronounced. Several reasons were postulated by authors of included studies as to why certain metrics may have increased during the pandemic, with many of them being consistently reported across studies.

Delays in LKW to arrival time are largely out of the hands of the caretaker. Public health guidelines and patient discretion and perception have appeared to be the major player in stroke presentation decreases and delays during the pandemic. Twenty-three studies cited shelter-in-place advisories and/or patient fear of presentation as a perceived cause for delays to hospital presentation for stroke (figure 3A). The implications of increased presentation times were a topic of focus for authors, with multiple studies drawing the connection between longer times to presentation and thus fewer people presenting within the window for stroke treatment.8–10 To address this, several studies called for the need for public awareness campaigns to stress the importance of seeking immediate medical attention for symptoms and to combat the misinterpretation of ‘stay at home’.10–12 Furthermore, 13 studies noted stressed hospital and EMS systems as a potential reason for delays to stroke treatment (figure 3A). A study out of Massachusetts assessing the impact of COVID-19 on statewide emergency medical services (EMS) found that EMS use decreased during COVID-19 irrespective of COVID-19 incidence, citing that ‘measures must be taken to clearly inform the public that immediate emergency care for time-sensitive conditions remains imperative,’13 further illustrating the importance of public perception in this matter.

Figure 3

(A) Distribution of the number of studies that cited these reasons as potential drivers for delays. (B) Distribution of the number of studies that reported potential reasons for steady or improved times in the pandemic period. EMS, emergency medical services; PPE, personal protective equipment.

In intra-hospital metrics where physicians and caretakers have more autonomy, delays were far less pronounced. Minor delays to DTI, DTN, and DTG were found in our pooled analysis. Across studies, these were widely attributed to precautions associated with COVID-19 such as symptom screening, additional PPE requirements, and isolation policies within hospitals (figure 3A). Minimal delays to stroke treatment during COVID-19 have also been identified in large multicenter studies,14 further showing the ability of hospital systems to adapt workflow to maximize patient outcomes. Interestingly, our analysis showed only a 2.8% increase in mean DTG times, but a 19.7% increase in mean DTR times. While this trend must be noted with caution, as we had 24 studies included in the DTG analysis but only seven in the DTR analysis, this points to the fact that mechanical thrombectomy procedures were taking longer during COVID-19. Given that LKW increased by over 20% during this time period, it is possible that thrombi were given more time to solidify15 and were thus harder to clear, another dangerous potential implication of increased presentation times.

When comparing CSCs to non-CSCs, our findings indicated that CSCs experienced more pronounced delays than non-CSCs during the pandemic. Although one might expect larger centers designated as CSCs to be better equipped for a mass influx of patients, and thus more prepared for public health crises, there were several factors working against them during the first phase of the pandemic. It was posited that CSCs experienced a disproportionate influx in stroke cases during the COVID-19 period as other nearby, smaller centers may have stopped taking in stroke patients to account for COVID-19 patients.16 17 As noted above, stroke patients may have been more likely to delay seeking care until their symptoms became more serious, which could increase their chances of referral to a CSC.

There are potential limitations to our study. Given that we sought to focus on how COVID-19 affected the healthcare system’s ability to respond to patients suffering from stroke, rather than stroke patients themselves, we did not analyze differences in clinical outcomes between the two study periods. As previously stated, only seven studies were included in the DTR analysis, and this was one of the statistically significant findings in this study.

This study’s strengths include a wide variety of countries represented, stratification of the studies by stroke center status, and a specific focus on relative change from baseline (pre-COVID-19), rather than absolute change, in time metrics. As these data are often reported as secondary outcomes, our study is unique in that its primary endpoint is the relative change from baseline in stroke response times. Additional information about our review can be found in online supplemental appendix 5.

Conclusion

While delays were seen in stroke presentation times such as LKW and DTR, especially in CSCs, early multidisciplinary efforts to adapt the acute stroke treatment process resulted in keeping intra-hospital stroke response time metrics close to pre-pandemic levels. Delays were attributed to shelter in place advisories, stressed hospital systems, and COVID-19 associated precautions, among others. Potential future studies may include an analysis of subsequent waves in the pandemic to evaluate whether relative changes in response times persisted later into the pandemic, and institutional studies to assess viral spread rates at stroke centers where times were increased as a result of COVID-19 precautions.

Ethics statements

Patient consent for publication

Ethics approval

Not applicable.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • RAM and MAA-S are joint senior authors.

  • Twitter @RMekary

  • Contributors All authors were involved in the design of the study, organization of the study, manuscript writing, and approval of final version of the manuscript. JD generated the search strategy and performed the search. NLAN and AHD independently performed the abstract and full text screening. NLAN and JLK performed the data extraction and summarized the data. AHD performed the data-analyses and RAM checked the data analysis and validity. NLAN, JLK, AD, and CJ wrote the manuscript.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.