Article Text

Download PDFPDF

Original research
Impact of single phase CT angiography collateral status on functional outcome over time: results from the MR CLEAN Registry
  1. Ivo GH Jansen1,
  2. Maxim JHL Mulder2,
  3. Robert-Jan B Goldhoorn3,
  4. Anna MM Boers1,4,
  5. Adriaan CGM van Es5,
  6. Lonneke SF Yo6,
  7. Jeannette Hofmeijer7,
  8. Jasper M Martens8,
  9. Marianne AA van Walderveen9,
  10. Bas FW van der Kallen10,
  11. Sjoerd FM Jenniskens11,
  12. Kilian M Treurniet1,
  13. Henk A Marquering1,4,
  14. Marieke ES Sprengers1,
  15. Wouter J Schonewille12,
  16. Joost CJ Bot13,
  17. Geert J Lycklama a Nijeholt14,
  18. Hester F Lingsma15,
  19. David S Liebeskind16,
  20. Jelis Boiten10,
  21. Jan Albert Vos17,
  22. Yvo BWEM Roos18,
  23. Robert J van Oostenbrugge3,
  24. Aad van der Lugt5,
  25. Wim H van Zwam19,
  26. Diederik WJ Dippel2,
  27. Ido R van den Wijngaard10,
  28. Charles BLM Majoie1
  29. on behalf of the MR CLEAN Registry investigators
    1. 1 Radiology & Nuclear Medicine, Amsterdam University Medical Center (AMC), Amsterdam, The Netherlands
    2. 2 Neurology, Erasmus Medical Center, Rotterdam, The Netherlands
    3. 3 Neurology, Maastricht University Medical Center, Maastricht, The Netherlands
    4. 4 Biomedical Engineering & Physics, Amsterdam University Medical Center (AMC), Amsterdam, The Netherlands
    5. 5 Radiology, Erasmus University Medical Center, Rotterdam, The Netherlands
    6. 6 Radiology, Catharina Hospital, Eindhoven, The Netherlands
    7. 7 Neurology, Rijnstate Hospital, Arnhem, The Netherlands
    8. 8 Radiology, Rijnstate Hospital, Arnhem, The Netherlands
    9. 9 Radiology, Leiden University Medical Center, Leiden, The Netherlands
    10. 10 Neurology, Haaglanden Medical Center, The Hague, The Netherlands
    11. 11 Radiology, Radboud University Medical Center, Nijmegen, The Netherlands
    12. 12 Neurology, Sint Antonius Hospital, Nieuwegein, The Netherlands
    13. 13 Radiology, Amsterdam University Medical Center (VUMC), Amsterdam, The Netherlands
    14. 14 Radiology, Haaglanden Medical Center, The Hague, The Netherlands
    15. 15 Public Health, Erasmus University Medical Center, Rotterdam, The Netherlands
    16. 16 Neurology, UCLA, Los Angeles, California, USA
    17. 17 Radiology, Sint Antonius Hospital, Nieuwegein, The Netherlands
    18. 18 Neurology, Amsterdam University Medical Center (AMC), Amsterdam, The Netherlands
    19. 19 Radiology, Maastricht University Medical Center, Maastricht, The Netherlands
    1. Correspondence to Dr. Ivo GH Jansen, Radiology and Nuclear Medicine, AMC, Amsterdam 1105 AZ, The Netherlands; ijansen{at}nico-lab.com

    Abstract

    Background Collateral status modified the effect of endovascular treatment (EVT) for stroke in several randomized trials. We assessed the association between collaterals and functional outcome in EVT treated patients and investigated if this association is time dependent.

    Methods We included consecutive patients from the Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in The Netherlands (MR CLEAN) Registry (March 2014–June 2016) with an anterior circulation large vessel occlusion undergoing EVT. Functional outcome was measured on the modified Rankin Scale (mRS) at 90 days. We investigated the association between collaterals and mRS in the MR CLEAN Registry with ordinal logistic regression and if this association was time dependent with an interaction term. Additionally, we determined modification of EVT effect by collaterals compared with MR CLEAN controls, and also investigated if this was time dependent with multiplicative interaction terms.

    Results 1412 patients were analyzed. Functional independence (mRS score of 0–2) was achieved in 13% of patients with grade 0 collaterals, in 27% with grade 1, in 46% with grade 2, and in 53% with grade 3. Collaterals were significantly associated with mRS (adjusted common OR 1.5 (95% CI 1.4 to 1.7)) and significantly modified EVT benefit (P=0.04). None of the effects were time dependent. Better collaterals corresponded to lower mortality (P<0.001), but not to lower rates of symptomatic intracranial hemorrhage (P=0.14).

    Conclusion In routine clinical practice, better collateral status is associated with better functional outcome and greater treatment benefit in EVT treated acute ischemic stroke patients, independent of time to treatment. Within the 6 hour time window, a substantial proportion of patients with absent and poor collaterals can still achieve functional independence.

    • stroke
    • intervention
    • ct angiography

    Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Introduction

    Good collateral status is associated with better functional outcome of patients with acute ischemic stroke due to intracranial large vessel occlusion of the anterior circulation.1–8 Therefore, collateral status was implemented as a patient selection tool in the Endovascular Treatment for Small Core and Anterior Circulation Proximal Occlusion with Emphasis on Minimizing CT to Recanalization Times (ESCAPE) trial.9 Collateral status has also been shown to modify the effect of endovascular treatment (EVT) in some studies.10–12 In the Highly Effective Reperfusion Evaluated in Multiple Endovascular Stroke Trials (HERMES) collaboration, this modification was not found.13 Thus the value of collateral status for prediction of the benefit of EVT benefit, and consequently its role in patient selection for EVT, remains unclear. More specifically, a defined patient group without benefit of EVT has not yet been identified, and the way in which time to treatment and collateral status interact with functional outcome and EVT effect is still a subject of debate.

    In this post hoc analysis of the Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in The Netherlands (MR CLEAN) Registry,14 a large dataset representative of clinical practice, we assessed the association between collateral status and functional outcome in patients with acute ischemic stroke and large vessel occlusion treated with EVT, and investigated if this association is time dependent.

    Methods

    Patient inclusion

    The MR CLEAN Registry is a prospective, multicenter registry, collecting data from all stroke intervention centers that perform EVT in The Netherlands. The study protocol was evaluated by a central medical ethics committee, and permission to carry out the study as a registry was granted. All patients treated with EVT for acute ischemic stroke after the final MR CLEAN trial randomization on 16 March 2014 were registered. Data for patients undergoing EVT up to 15 June 2016 are reported here.

    Patients adhering to the following criteria, comparable with the MR CLEAN trial, were included in the current analysis: age 18 years or older; treatment in a MR CLEAN intervention center; treated within 6.5 hours of stroke onset; intracranial large vessel occlusion in the anterior circulation (internal carotid artery (intracranial segment (ICA) or internal carotid artery terminus (ICA-T), middle (M1/M2), or anterior (A1/A2) cerebral artery), demonstrated by CT angiography (CTA), and availability of baseline CTA for collateral grade assessment. Upper age limit, minimal Albert Stroke Program Early CT Score (ASPECTS), and collateral grade were not used as predefined selection criteria. An extracranial carotid occlusion by atherosclerosis or dissection was not an exclusion criterion.

    Collateral assessment

    All CT scan protocols applied in the MR CLEAN Registry are provided in the online supplementary table S1. Collateral assessment was performed by 10 observers (each assessed 100–200 different CTAs) from the MR CLEAN Registry imaging core lab, who were blinded to the clinical findings. All observers were provided with a training set including relevant definitions. Collateral status was graded on single phase CTA source images on a 4 point scale, with grade 0 for absent collaterals (0% filling of the occluded vascular territory), grade 1 for poor collaterals (>0% and ≤50% filling of the occluded vascular territory), grade 2 for moderate (>50% and <100% filling of the occluded vascular territory), and grade 3 for good collaterals (100% filling of the occluded vascular territory).15 Interobserver variability for this method has previously been reported to be moderate (k=0.60).10

    Outcomes

    The primary outcome was the modified Rankin Scale (mRS) score at 90 days.16 The mRS is a 7 point disability scale ranging from 0 (no symptoms) to 6 (dead). Secondary outcomes were dichotomized mRS (mRS 0–1 vs 2–6, 0–2 vs 3–6, and 0–3 vs 4–6), National Institutes of Health Stroke Scale (NIHSS) score 24–48 hours after intervention, and the expanded Thrombolysis in Cerebral Infarction (eTICI) score at the end of the EVT procedure. The eTICI ranges from 0 (no antegrade reperfusion of the occluded vascular territory) to 3 (complete antegrade reperfusion of the occluded vascular territory).17 An eTICI of 2B or higher was considered successful reperfusion. For this score to be reached, complete DSA runs, including anteroposterior and lateral views, after EVT were mandatory. If a lateral view was missing, eTICI 2A was the highest possible score. Complications during the intervention, during hospital admittance, or in the 3 month follow-up period were registered.

    Acquisition phase

    Due to the possibility of underestimation of collaterals when assessed on single phase CTA, we evaluated CTA acquisition phase by comparing peak arterial opacification with peak venous opacification according to a predefined method.18 Opacification of two regions of interest—namely, the contralateral ICA and the transverse sinus—were measured in all patients by one observer (IGHJ). Based on these measurements, CTA studies were classified into one of five acquisition phases: ‘early arterial’ (artery Hounsfield units (HU) greater than venous structure, and venous structure ≤200 HU), ‘peak arterial’ (artery HU ≥100 greater than venous structure and venous structure >200 HU), ‘equilibrium’ (artery HU <100 greater or equal to venous structure and venous structure >200 HU), ‘peak venous’ (artery HU >200 and venous structure greater than artery), or ‘late venous’ (artery HU ≤200 and venous structure greater than artery). Additionally, a subset of 200 patients was graded by a second observer (KMT) to assess interobserver variability for this method.

    Safety measurements and complications

    Safety measurements included mortality within 7, 30, and 90 days, symptomatic intracranial hemorrhage (sICH), hemicraniectomy, progression of ischemic stroke (resulting in a decline of at least 4 points on the NIHSS), pneumonia, other infections, cardiac ischemia, extracranial hemorrhage, allergic reactions, and other complications. Intracranial hemorrhage was deemed symptomatic if the patient died or deteriorated neurologically (a decline of at least 4 points on the NIHSS) and the hemorrhage was related to the clinical deterioration (according to the Heidelberg criteria).19 Progression of ischemic stroke and development of new ischemic stroke were evaluated based on medical reports of admission.

    Statistical analysis

    Baseline characteristics were compared with the χ2 test, one-way ANOVA, or Kruskal–Wallis test, as appropriate. Differences in acquisition phase were described with the χ2 test. Interobserver variability for the five CTA acquisition phases was assessed with quadratic weighted kappa statistics. The association of collateral status with functional outcome at 90 days in the MR CLEAN Registry was assessed with univariable and multivariable ordinal logistic regression, expressed as a common odds ratio (OR). In regression analyses, we adjusted for: age, baseline NIHSS score, history of diabetes mellitus or previous stroke, and occlusion location. The effect of time to treatment on this relationship was investigated by adding an interaction term to the model (collateral status × time to treatment). The same analysis was performed for time to reperfusion (TICI 2b–3 achieved or last contrast bolus given). Additionally, the effect of time to reperfusion was investigated on a subset of patients with successful reperfusion only (TICI 2b–3). We assessed the modification of EVT benefit by collateral status by comparing the MR CLEAN Registry patients with the control group of the MR CLEAN trial and adding an interaction term to the model (collateral status × treatment allocation). Additionally, we used a triple interaction term to determine if this modification was dependent on time to treatment (collateral status × treatment allocation × time to treatment). We performed the same analysis for time to reperfusion. Statistical analyses were performed in Stata/SE 14.1 (StataCorp, Texas, USA).

    Missing data

    Missing NIHSS scores were retrospectively scored with a standardized chart based on information from the reported neurological examination. If successful reperfusion was not achieved during EVT, the time of last contrast bolus injection was used as a proxy. Any mRS score of 0–5 assessed within 30 days was considered not valid and treated as missing. These values were therefore replaced by mRS scores derived from multiple imputation.20 Multiple imputation was also applied to create time to treatment and time to reperfusion values for patients in the MR CLEAN control group. Multiple imputation was performed with Stata/SE 14.1 (StataCorp, Texas, USA) with the following variables: age, baseline NIHSS score, glucose level, diabetes mellitus, previous myocardial infarction, previous stroke, hypercholesterolemia, atrial fibrillation, medication use (antiplatelets, statins, anticoagulants, and antihypertensives), pre-stroke mRS, blood pressure, baseline ASPECTS, occlusion segment, time from symptom onset to start of EVT, time from symptom onset to successful reperfusion or last contrast bolus, eTICI score at the end of the intervention, and NIHSS score after 24–48 hours.

    Results

    In total, 1627 patients were registered in the MR CLEAN Registry between 16 March 2014 and 15 June 2016. For the current study, 215 patients were excluded: in 75 patients no baseline CTA was collected, 2 patients were <18 years old, 79 patients had a posterior circulation occlusion, 39 patients arrived after 6.5 hours of symptom onset, and 20 patients were not treated in a MR CLEAN trial hospital (see online supplementary figure S1). This resulted in 1412 patients available for the final analysis.

    Baseline characteristics

    Patients with a lower collateral status were older, more often male, had higher baseline NIHSS scores and lower ASPECTS, more often received general anesthesia, and had more proximal occlusion locations (table 1). Also, these patients were more often transferred from a primary stroke center than patients with higher collateral grades, and were more often receiving antihypertensive or antiplatelet therapy. No significant differences between the grades were observed for systolic blood pressure, atrial fibrillation, or a history of diabetes mellitus. The MR CLEAN trial control group with available collateral status consisted of 262 patients. Of these, 17 patients (6%) had grade 0 collaterals, 64 (26%) had grade 1, 110 (41%) had grade 2, and 71 (27%) had grade 3.10

    Table 1

    Baseline characteristics per collateral grade

    Outcomes

    Primary outcome

    Notably, the proportion of functional independence (mRS 0–2) in the MR CLEAN Registry was 13% in collateral grade 0 and 27% in collateral grade 1 (figure 1). In unadjusted analysis, better collateral status in the MR CLEAN Registry was significantly associated with lower mRS scores at 90 days (adjusted common OR (acOR) 1.8 (95% CI 1.6 to 2.0)) (see online supplementary table S2). After adjustments, this remained the case (acOR 1.5 (95% CI 1.3 to 1.7)) (table 2). In the MR CLEAN Registry, the relationship between collateral status and functional outcome was not time dependent for all three assessed time parameters (stroke onset to start of EVT, P=0.81; onset to end of EVT, P=0.80; and onset to successful reperfusion, P=0.11). The proportion of patients with functional independence (mRS 0–2) increased with higher collateral grade for all three time metrics (figure 2).

    Figure 1

    Distribution of scores on the modified Rankin Scale (mRS) per collateral grade in the Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in The Netherlands (MR CLEAN) Registry (before imputation) and in the MR CLEAN trial control group. Scores range from 0 to 6, with 0 indicating ‘no symptoms’ and 6 ‘dead’.

    Figure 2

    Proportion of patients achieving functional independence (a modified Rankin Scale (mRS) score of 0–2) per collateral grade relative to: time from onset to endovascular treatment (EVT) start (top); time from onset to end of EVT (middle); and time from onset to successful reperfusion (expanded Thrombolysis in Cerebral Infarction (eTICI) score of 2B–3) (bottom).

    Table 2

    Effect of endovascular treatment on outcome in the MR CLEAN Registry relative to the MR CLEAN control group, in the total population and per collateral grade, adjusted for age, baseline NIHSS score, history of diabetes mellitus or previous stroke, and occlusion location

    Treatment effect modification

    In adjusted analysis, collateral status significantly modified the effect of EVT on functional outcome (P=0.04). We observed a significant shift in the distribution on the mRS in favor of the MR CLEAN Registry group for grade 2 (acOR 1.9 (95% CI: 1.3 to 2.7)) and grade 3 (acOR 2.1 (95% CI 1.4 to 3.4)) but not for grade 0 (acOR 1.0 (95% CI 0.4 to 2.5)) or grade 1 (acOR 1.2 (95% CI: 0.8 to 2.1)) (figure 1, table 2). The modification of EVT benefit by collateral status was not dependent on time to treatment (P=0.76) or time to reperfusion (P=0.63).

    Secondary outcomes

    Rate of successful reperfusion in the MR CLEAN Registry has been reported previously.14 In the MR CLEAN Registry, collateral status was significantly associated with functional independence (mRS 0–2) (OR 1.6 (95% CI 1.3 to 1.8)) and mRS 0–3 (OR 1.5 (95% CI 1.3 to 1.7)). When compared with the MR CLEAN trial controls with functional independence or mRS 0–3 as the endpoint, collateral status did not significantly modify EVT benefit (P=0.21; P=0.19). Results of all secondary regression analyses are shown in table 2.

    Acquisition phase

    Interobserver variability for the assessment of the five CTA acquisition phases expressed by the quadratic weighted κ was 0.87 (95% CI 0.82 to 0.93). Although early CTA acquisition phase scans corresponded to lower collateral grades (P<0.001; online supplementary table S3), the effect of this difference on functional outcome was, surprisingly, absent. Collateral grade 0 patients with a CTA acquired in the early arterial phase (online supplementary table S3; row 1, column 1), the group theoretically most susceptible to underestimation of collaterals, achieved precisely the same proportion of functional independence as the overall collateral grade 0 group (13%). Moreover, for patients with an early arterial phase CTA and grade 1 collaterals, the proportion of achieved functional independence was even higher than the overall grade 1 group (35% vs 27%). After correcting for scan timing in our regression model, the association of collateral status with mRS at 90 days in the MR CLEAN Registry was practically unchanged (acOR 1.6 (95% CI 1.4 to 1.8)).

    Safety outcomes

    We observed significant differences in the MR CLEAN Registry across collateral grades for mortality and progression of ischemic stroke, but not for sICH (see online supplementary table S4). In the MR CLEAN Registry, sICH occurred in 6 (6%) patients with grade 0 collaterals, compared with none in the associated MR CLEAN trial control group (P=0.30). For patients with grade 1, we found 33 (7%) had suffered from sICH in the MR CLEAN Registry, compared with 9 (14%) in the MR CLEAN trial controls (P=0.05). For grades 2 and 3, rates of sICH were similar between the MR CLEAN Registry and MR CLEAN trial controls.

    Discussion

    In the MR CLEAN Registry, better collateral status on baseline CTA was significantly associated with better functional outcome in patients treated with EVT for acute ischemic stroke due to an intracranial large vessel occlusion in the anterior circulation. Also, better collateral status corresponded to larger EVT benefit. This relationship was not time dependent, and a substantial proportion of patients with absent and poor collateral status treated at the end of the 6 hour time window still achieved functional independence after 90 days.

    The recent literature emphasizes the strong association between collateral status and functional outcome, which is in line with our results.1–7 10 However, most of these studies were not able to adequately investigate EVT benefit due to lack of a treatment control group or because by design patients with absent and poor collateral status were excluded altogether. Our results suggest that collateral status alone might not be sufficient to discriminate between patients who will and will not benefit from EVT within the 6 hour time window, and that a multivariable approach to this important question is necessary, as has previously been proposed.21

    The potential impact of multiphase CTA in assessment of collateral status has been previously suggested, noting the added value of time based parameters such as rate of wash out and degree of delay on this assessment.22 However, in this study, single phase CTA was still significantly associated with functional independence at 90 days, and the predictive value of assessment on multiphase CTA was only slightly increased. This is in line with our study, as the effect of acquisition phase on the relationship between collateral status and functional outcome was minimal. Three recent studies reported a faster decrease over time in the chance of functional independence after EVT for patients with poor collaterals, with possible loss of benefit in these patients before expiration of the 6 hour time window.23–25 In our study we did not observe such a relationship. A strong relationship between collateral status on single phase CTA and conventional angiography has also been reported, still generally considered the gold standard for collateral assessment. This improves the validity of single phase CTA as the imaging modality for ascertaining collateral status in acute stroke situations, particularly considering the practical advantages and wide availability of CTA.25 Finally, we graded collaterals on a scale that is very common and easily applicable.15 However, it is relatively coarse. More refined grading methods could further improve prediction of patient outcome after stroke.26

    The MR CLEAN Registry is a large, consecutive, nationwide registry with core lab evaluation of all imaging and complications. Furthermore, this was one of the few studies in which a relatively large number of patients with absent or poor collaterals was treated. However, there were limitations. First, all patients underwent single phase CTA, which could have led to underestimation of collateral status in the case of delayed filling in combination with an early acquisition phase. However, in our study, the relation between collateral status and functional independence in these patients was similar to those with later acquisition phases, suggesting that the effect on collateral assessment was limited, improving the reliability of our results. Also, as single phase CTA is still widely used, we think our data are representative of current clinical practice and our results are widely applicable. Second, due to the large number of centers in our study, CTA was acquired with varying scan protocols. However, we think this heterogeneity further adds to the generalizability of our results. Third, there was no second reader available for collateral assessment in the MR CLEAN Registry, which could have led to inconsistencies in interpretation between observers. However, because interventionists were offered training sets and instructed to assess images according to relevant definitions, we expect this effect to be limited. Finally, no consideration of stroke etiology was made in this study, and thus the potential influence of this on collateral status cannot be fully appreciated. However, because stroke etiology is in general often unknown for a large proportion of patients, it might be difficult to draw meaningful conclusions from such an analysis.

    Our study underlines the beneficial effect of collaterals for patients with acute ischemic stroke. As expected, patients with moderate and good collaterals did relatively well, the latter achieving functional independence in more than half of the cases. Still, a substantial proportion of patients with absent and poor collateral status achieved functional independence. Moreover, for patients with poor collaterals, more than one in four patients achieved functional independence after 3 months. For mRS 0–3, which can also be considered an acceptable outcome for patients with poor imaging profiles, this even increased to two in five patients. This cannot be explained by underestimation of collaterals because of scan timing issues alone. A possible explanation could be that median time from stroke onset to the start of EVT in the MR CLEAN Registry was almost an hour shorter than in the MR CLEAN trial, greatly improving the chance of functional independence irrespective of collateral status. Also of note in our study is that median ASPECTS was relatively high for all collateral grades. Despite our broad inclusion criteria, we think that a combination of very low ASPECTS and poor collaterals might be underrepresented in our registry due to some patient selection for EVT by local physicians. Additionally, it is possible that depending on the time of imaging of the patient, ASPECTS and collateral status are not aligned. In our dataset the majority of patients were imaged and treated relatively early and we believe that the relatively high median ASPECTS of poor collateral grades in our dataset is partly caused by the fact that ischemic changes were not yet visible and so the ASPECTS underrepresented the infarcted territory.

    The chance of achieving functional independence after EVT is known to decrease over time, as is also seen in our study. However, we found this association with time to treatment was not significantly modified by collateral status. Despite a relative decrease over time of more than 50% in functional independence in the absent collateral group, some patients still achieved this outcome, even at the end of the 6 hour time window. Patients with moderate and good collaterals were highly likely to achieve functional independence up to 6 hours. We can speculate that the EVT benefit in these patients ranges well beyond this time point, but this is beyond the scope of our current study.

    Some advocate that collateral status can be considered when selecting patients for EVT in acute stroke.27 However, our analysis indicates that selection of patients for EVT based on collateral status alone should be approached with caution, both in clinical practice and in future clinical trials. Despite this, our study shows that collateral status is predictive of functional outcome and could therefore be useful for prognosis in patients treated with EVT for acute ischemic stroke.

    Conclusion

    In routine clinical practice, better collateral status is associated with better functional outcome and larger treatment benefit in EVT-treated acute ischemic stroke patients, independent of time to treatment. Within the 6-hour time window a substantial proportion of patients with absent and poor collaterals can still achieve functional independence.

    References

    Footnotes

    • MJHLM and R-JBG contributed equally.

    • IRW and CBLMM contributed equally.

    • Contributors IGHJ prepared the first draft. IGHJ, MJHLM, IRW ,and HFL designed the study and performed the statistical analyses. IGHJ, MJHLM, R-JBG, AMMB, KT, DWJD, CBLMM, IRW, and DL participated in the study design, data collection, data analysis, interpretation, and writing of the manuscript. GJLN, MW, MS, SJ, BK, IRW, ACGME, and LY participated in the data analysis. All authors participated in patient enrolment and data collection, critically reviewed the manuscript, and approved the final version. MJHLM and R-JBG contributed equally, as did IRW and CBLMM.

    • Funding This study was supported by an unrestricted grant from the TWIN Foundation (Toegepast Wetenschappelijk Instituut voor Neuromodulatie; http://www.stichtingtwin.nl/).

    • Competing interests All authors have completed the ICMJE uniform disclosure form at http://www.icmje.org/coi_disclosure.pdf. IGHJ owns stock in Nico lab BV, a company that focuses on the use of artificial intelligence for medical image analysis (https://www.nico-lab.com/). CBLMM reports grants from the TWIN Foundation, during the conduct of the study; grants from CVON/Dutch Heart Foundation, grants from Stryker, outside the submitted work (paid to institution); and owns stock in Nico lab BV. YBWEMR owns stock in Nico lab BV. WHZ reports personal fees from Codman and personal fees from Stryker, outside the submitted work. AL reports consulting fees from Stryker, outside the submitted work. DWJD reports grants from the Dutch Heart Foundation, AngioCare BV, Medtronic/Covidien/EV3, MEDAC Gmbh/LAMEPRO, Penumbra Inc, Top Medical/Concentric, and Stryker, during conduct of the study; and consultation fees from Stryker, Bracco Imaging, and Servier, received by the Erasmus University Medical Center, outside the submitted work. DL reports consultation fees from Stryker and Medtronic, outside the submitted work. AMMB and HAM report owning stock in Nico lab BV. All other authors did not receive support from any organization for the submitted work, had no financial relationships with any organizations that might have an interest in the submitted work in the previous three years and had no other relationships or activities that could appear to have influenced the submitted work.

    • Ethics approval The study protocol was evaluated by the central medical ethics committee of the Erasmus University Medical Center, Rotterdam, The Netherlands. Permission to carry out the study as a registry was granted.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Collaborators Executive committee: Diederik W J Dippel (Department of Neurology, Erasmus MC University Medical Center), Aad van der Lugt (Department of Radiology, Erasmus MC University Medical Center), Charles B L M Majoie (Department of Radiology, Academic Medical Center, Amsterdam), Yvo B W E M Roos (Department of Neurology, Academic Medical Center, Amsterdam), Robert J van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Wim H van Zwam (Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Jelis Boiten (Department of Neurology, MC Haaglanden, the Hague), Jan-Albert Vos (Department of Radiology, Sint Antonius Hospital, Nieuwegein). Study coordinators: Ivo G H Jansen (Department of Radiology, Academic Medical Center, Amsterdam), Maxim J H L Mulder (Department of Neurology, Erasmus MC University Medical Center, Department of Radiology, Erasmus MC University Medical Center), Robert-Jan B Goldhoorn (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM), Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)). Local principal investigators: Wouter J Schonewille (Department of Neurology, St Antonius Hospital, Nieuwegein), Jan Albert Vos (Department of Radiology, St Antonius Hospital, Nieuwegein), Charles B L M Majoie (Department of Radiology, Academic Medical Center, Amsterdam), Jonathan M Coutinho (Department of Neurology, Academic Medical Center, Amsterdam), Marieke J H Wermern (Department of Neurology, Leiden University Medical Center), Marianne A A van Walderveen (Department of Radiology, Leiden University Medical Center), Julie Staals (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Wim H van Zwam (Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem), Jasper M Martens (Department of Radiology, Rijnstate Hospital, Arnhem), Geert J Lycklama à Nijeholt (Department of Radiology, MC Haaglanden, the Hague), Jelis Boiten (Department of Neurology, MC Haaglanden, the Hague), Bob Roozenbeek (Department of Neurology, Erasmus MC University Medical Center), Bart J Emmer (Department of Radiology, Erasmus MC University Medical Center), Sebastiaan F de Bruijn (Department of Neurology, HAGA Hospital, the Hague), Lukas C van Dijk (Department of Radiology, HAGA Hospital, the Hague), H Bart van der Worp (Department of Neurology, University Medical Center Utrecht), Rob H Lo (Department of Radiology, University Medical Center Utrecht), Ewoud J van Dijk (Department of Neurology, Radboud University Medical Center, Nijmegen), Hieronymus D Boogaarts (Department of Neurosurgery, Radboud University Medical Center, Nijmegen), Paul L M de Kort (Department of Neurology, Sint Elisabeth Hospital, Tilburg), Jo J P Peluso (Department of Radiology, Sint Elisabeth Hospital, Tilburg), Jan S P van den Berg (Department of Neurology, Isala Klinieken, Zwolle), Boudewijn A A M van Hasselt (Department of Radiology, Isala Klinieken, Zwolle), Leo A M Aerden (Department of Neurology, Reinier de Graaf Gasthuis, Delft), René J Dallinga (Department of Radiology, Reinier de Graaf Gasthuis, Delft), Maarten Uyttenboogaart (Department of Neurology, University Medical Center Groningen), Omid Eshghi (Department of Radiology, University Medical Center Groningen), Tobien H C M L Schreuder (Department of Neurology, Atrium Medical Center, Heerlen), Roel J J Heijboer (Department of Radiology, Atrium Medical Center, Heerlen), Koos Keizer (Department of Neurology, Catharina Hospital, Eindhoven), Lonneke S F Yo (Department of Radiology, Catharina Hospital, Eindhoven), Heleen M den Hertog (Department of Neurology, Medical Spectrum Twente, Enschede), Emiel J C Sturm (Department of Radiology, Medical Spectrum Twente, Enschede). Imaging assessment committee: Charles B L M Majoie (chair) (Department of Radiology, Academic Medical Center, Amsterdam), Wim H van Zwam, Aad van der Lugt (Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Geert J Lycklama à Nijeholt (Department of Radiology, MC Haaglanden, the Hague), Marianne A A van Walderveen (Department of Radiology, Leiden University Medical Center), Marieke E S Sprengers (Department of Radiology, Academic Medical Center, Amsterdam), Sjoerd F M Jenniskens (Department of Radiology, Radboud University Medical Center, Nijmegen), René van den Berg (Department of Radiology, Academic Medical Center, Amsterdam), Albert J Yoo ((Department of Radiology, Texas Stroke Institute, Texas, United States of America)), Ludo F M Beenen (Department of Radiology, Academic Medical Center, Amsterdam), Stefan D Roosendaal (Department of Radiology, Academic Medical Center, Amsterdam), Bas F W van der Kallen (Department of Radiology, MC Haaglanden, the Hague), Ido R van den Wijngaard (Department of Radiology, MC Haaglanden, the Hague), Ad van Es (Department of Radiology, Erasmus MC University Medical Center), Bart Emmer (Department of Radiology, Erasmus MC University Medical Center, Department of Radiology, Academic Medical Center, Amsterdam), Jasper M Martens (Department of Radiology, Rijnstate Hospital, Arnhem), Lonneke S F Yo (Department of Radiology, Catharina Hospital, Eindhoven), Jan Albert Vos (Department of Radiology, St Antonius Hospital, Nieuwegein), Joost Bot (Department of Radiology, VUMC, Amsterdam), Pieter-Jan van Doormaal (Department of Radiology, Erasmus MC University Medical Center). Writing committee: Diederik W J Dippel (chair) (Department of Neurology, Erasmus MC University Medical Center), Aad van der Lugt (Department of Radiology, Erasmus MC University Medical Center), Charles B L M Majoie (Department of Radiology, Academic Medical Center, Amsterdam), Yvo B W E M Roos Department of Neurology, Academic Medical Center, Amsterdam), Robert J van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Wim H van Zwam (Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Geert J Lycklama à Nijeholt (Department of Radiology, MC Haaglanden, the Hague), Jelis Boiten (Department of Neurology, MC Haaglanden, the Hague), Jan Albert Vos (Department of Radiology, Sint Antonius Hospital, Nieuwegein), Wouter J Schonewille (Department of Neurology, Sint Antonius Hospital, Nieuwegein), Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem), Jasper M Martens (Department of Radiology, Rijnstate Hospital, Arnhem), H Bart van der Worp (Department of Neurology, University Medical Center Utrecht), Rob H Lo (Department of Radiology, University Medical Center Utrecht). Adverse event committee: Robert J van Oostenbrugge (chair) (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem), H Zwenneke Flach (Department of Radiology, Isala Klinieken, Zwolle). Trial methodologist: Hester F Lingsma (Department of Public Health, Erasmus MC University Medical Center), Research nurses / local trial coordinators: Naziha el Ghannouti (Department of Neurology, Erasmus MC University Medical Center), Martin Sterrenberg (Department of Neurology, Erasmus MC University Medical Center), Corina Puppels (Department of Neurology, St Antonius Hospital, Nieuwegein), Wilma Pellikaan (Department of Neurology, St Antonius Hospital, Nieuwegein), Rita Sprengers (Department of Radiology, Academic Medical Center, Amsterdam), Marjan Elfrink (Department of Neurology, Rijnstate Hospital, Arnhem), Joke de Meris (Department of Neurology, MC Haaglanden, the Hague), Tamara Vermeulen (Department of Neurology, MC Haaglanden, the Hague), Annet Geerlings (Department of Neurology, Radboud University Medical Center, Nijmegen), Gina van Vemde (Department of Neurology, Isala Klinieken, Zwolle), Tiny Simons (Department of Neurology, Atrium Medical Center, Heerlen), Cathelijn van Rijswijk (Department of Neurology, St Elisabeth Hospital, Tilburg), Gert Messchendorp (Department of Neurology, University Medical Center Groningen), Hester Bongenaar (Department of Neurology, Catharina Hospital, Eindhoven), Karin Bodde (Department of Neurology, Reinier de Graaf Gasthuis, Delft), Sandra Kleijn (Department of Neurology, Medical Spectrum Twente, Enschede), Jasmijn Lodico (Department of Neurology, Medical Spectrum Twente, Enschede), Hanneke Droste (Department of Neurology, Medical Spectrum Twente, Enschede), M Wollaert, D Jeurrissen (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Erna Bos (Department of Neurology, Leiden University Medical Center), Yvonne Drabbe (Department of Neurology, HAGA Hospital, the Hague), Berber Zweedijk (Department of Neurology, University Medical Center Utrecht), Mostafa Khalilzada (Department of Neurology, HAGA Hospital, the Hague). PhD / Medical students: Esmee Venema (Department of Neurology, Erasmus MC University Medical Center, Department of Public Health, Erasmus MC University Medical Center), Vicky Chalos (Department of Public Health, Erasmus MC University Medical Center), Kars J Compagne (Department of Radiology, Erasmus MC University Medical Center), Ralph R Geuskens (Department of Radiology, Academic Medical Center, Amsterdam), Tim van Straaten (Department of Neurology, Radboud University Medical Center, Nijmegen), Saliha Ergezen (Department of Neurology, Erasmus MC University Medical Center), Roger R M Harmsma (Department of Neurology, Erasmus MC University Medical Center), Daan Muijres (Department of Neurology, Erasmus MC University Medical Center), Anouk de Jong (Department of Neurology, Erasmus MC University Medical Center), Wouter Hinseveld (Department of Neurology, Sint Antonius Hospital, Nieuwegein), Olvert A Berkhemer (Department of Neurology, Erasmus MC University Medical Center,Department of Radiology, Academic Medical Center, Amsterdam, Department of Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)), Anna M M Boers (Department of Radiology, Academic Medical Center, Amsterdam, Department of Biomedical Engineering & Physics, Academic Medical Center, Amsterdam), J Huguet (Department of Radiology, Academic Medical Center, Amsterdam), P F C Groot (Department of Radiology, Academic Medical Center, Amsterdam), Marieke A Mens (Department of Radiology, Academic Medical Center, Amsterdam), Katinka R van Kranendonk (Department of Radiology, Academic Medical Center, Amsterdam), Kilian M Treurniet (Department of Radiology, Academic Medical Center, Amsterdam), Manon Kappelhof (Department of Radiology, Academic Medical Center, Amsterdam), Manon L Tolhuijsen (Department of Radiology, Academic Medical Center, Amsterdam0, Heitor Alves (Department of Radiology, Academic Medical Center, Amsterdam).

    • Patient consent for publication Not required.