Article Text

Original research
Thrombus imaging characteristics within acute ischemic stroke: similarities and interdependence
  1. Nerea Arrarte Terreros1,2,
  2. Agnetha AE Bruggeman2,
  3. Manon Kappelhof1,2,
  4. Manon L Tolhuisen1,2,
  5. Josje Brouwer3,
  6. Jan W Hoving2,
  7. Praneeta R Konduri1,2,
  8. Katinka R van Kranendonk2,
  9. Bruna G Dutra1,2,
  10. Heitor CBR Alves1,2,
  11. Diederik WJ Dippel4,
  12. Wim H van Zwam5,
  13. Ludo FM Beenen2,
  14. Lonneke SF Yo6,
  15. Ed van Bavel1,
  16. Charles BLM Majoie2,
  17. Henk A Marquering1,2
  18. MR CLEAN Registry Investigators
    1. 1 Department of Biomedical Engineering and Physics, Amsterdam UMC, location University of Amsterdam, Amsterdam, The Netherlands
    2. 2 Department of Radiology and Nuclear Medicine, Amsterdam UMC, location University of Amsterdam, Amsterdam, The Netherlands
    3. 3 Department of Neurology, Amsterdam UMC, location University of Amsterdam, Amsterdam, The Netherlands
    4. 4 Department of Neurology, Erasmus MC, Rotterdam, The Netherlands
    5. 5 Department of Radiology and Nuclear Medicine, Maastricht UMC, Maastricht, The Netherlands
    6. 6 Department of Radiology, Catharina Hospital Eindhoven, Eindhoven, The Netherlands
    1. Correspondence to Nerea Arrarte Terreros, Department of Biomedical Engineering and Physics, Amsterdam UMC, location University of Amsterdam, Amsterdam, The Netherlands; n.arrarteterreros{at}amsterdamumc.nl

    Abstract

    Background The effects of thrombus imaging characteristics on procedural and clinical outcomes after ischemic stroke are increasingly being studied. These thrombus characteristics – for eg, size, location, and density – are commonly analyzed as separate entities. However, it is known that some of these thrombus characteristics are strongly related. Multicollinearity can lead to unreliable prediction models. We aimed to determine the distribution, correlation and clustering of thrombus imaging characteristics based on a large dataset of anterior-circulation acute ischemic stroke patients.

    Methods We measured thrombus imaging characteristics in the MR CLEAN Registry dataset, which included occlusion location, distance from the intracranial carotid artery to the thrombus (DT), thrombus length, density, perviousness, and clot burden score (CBS). We assessed intercorrelations with Spearman’s coefficient (ρ) and grouped thrombi based on 1) occlusion location and 2) thrombus length, density and perviousness using unsupervised clustering.

    Results We included 934 patients, of which 22% had an internal carotid artery (ICA) occlusion, 61% M1, 16% M2, and 1% another occlusion location. All thrombus characteristics were significantly correlated. Higher CBS was strongly correlated with longer DT (ρ=0.67, p<0.01), and moderately correlated with shorter thrombus length (ρ=−0.41, p<0.01). In more proximal occlusion locations, thrombi were significantly longer, denser, and less pervious. Unsupervised clustering analysis resulted in four thrombus groups; however, the cohesion within and distinction between the groups were weak.

    Conclusions Thrombus imaging characteristics are significantly intercorrelated – strong correlations should be considered in future predictive modeling studies. Clustering analysis showed there are no distinct thrombus archetypes – novel treatments should consider this thrombus variability.

    • Stroke
    • CT Angiography
    • CT
    • Thrombectomy
    • Thrombolysis

    Data availability statement

    Data are available upon reasonable request. All data relevant to the study are included in the article or uploaded as supplementary information. All data relevant to the study are included in the article or uploaded as Supplemental Material. Source data for this study are not available due to privacy regulations, but analysis methods, codes, and results are available from the corresponding author upon reasonable request.

    http://creativecommons.org/licenses/by-nc/4.0/

    This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

    Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    WHAT IS ALREADY KNOWN ON THIS TOPIC

    • Collinearity of thrombus imaging characteristics in predictive models of acute ischemic stroke is commonly disregarded.

    WHAT THIS STUDY ADDS

    • We presented distributions, intercorrelations and clustering analysis of thrombus imaging characteristics measured in 937 acute ischemic stroke patients. Thrombus imaging characteristics are significantly intercorrelated, but there are no distinct thrombus archetypes.

    HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

    • Strong correlations between thrombus characteristics should be considered in future predictive models in acute ischemic stroke. The continuous spectrum and specific variability of thrombus characteristics need to be addressed when developing novel treatment approaches.

    Introduction

    Multiple thrombus characteristics are increasingly being studied for their effects on procedural and clinical outcomes after ischemic stroke.1–3 Currently, the most straightforward way to assess the thrombus is via radiological imaging, mostly computed tomography (CT), since it is part of the standard-of-care diagnostic workup for stroke.4 Thrombus imaging characteristics can provide information on the size and (micro)structure of the thrombus, which may be useful to improve and optimize treatment.

    After administration of intravenous thrombolysis with alteplase (IVT), the lysis process of the clot can be influenced by the permeability5 6 and size of the thrombus.7 8 Thrombus density, which has been associated with thrombus histology9 and etiology,10 can also affect the chance of recanalization success after IVT.11 In addition, thrombus density may suggest the use of specific endovascular treatment (EVT) strategies.12 The optimal size and positioning of the EVT stent-retriever is dependent on thrombus length,13 and EVT success can be affected by thrombus volume.14

    As such, there is a whole spectrum of thrombus imaging characteristics influencing treatment, and these characteristics are not independent from each another. Including multicollinearity in prediction models reduces their statistical significance and should therefore be accounted for. Moreover, in case of strong correlations, there is no added value in measuring all parameters and a reduced number of thrombus measures may be sufficient.

    Thrombi are commonly classified by occlusion location, etiology, and/or histopathology.3 Currently, occlusion location is the only thrombus characteristic that is used for treatment selection.4 However, the occlusion location does not account for the biomechanical characteristics of the clot, which actually may have a larger effect on treatment response and chance of successful revascularization. Alternatively, thrombi are also classified based on stroke etiology as eg, cardioembolic, atherosclerotic or cryptogenic, according to the TOAST criteria .15 With different thrombus origins, it could be expected that thrombi show distinct (imaging) features as part of typical thrombus archetypes. Clustering techniques allow for grouping of thrombus characteristics, and therefore, may determine interrelated imaging characteristics that distinguish typical groups of thrombi. Certain sets of thrombus characteristics may be associated with a better response to specific (combinations of) treatments, such as IVT with alteplase or tenecteplase, or specific EVT techniques/devices. For example, thrombolysis was shown to be successful in small, distal, pervious thrombi, whereas its beneficial effect is being debated for large, proximal, impermeable thrombi.

    In this study, we present a detailed analysis of interrelations of thrombus imaging characteristics on a large data set of EVT-treated acute ischemic stroke patients. Specifically, we aim to provide information on the distribution and correlation of thrombus imaging characteristics and to study whether thrombi can be grouped based on their imaging characteristics.

    Methods

    Patient selection

    We included patients from the MR CLEAN Registry, a multicenter prospective observational registry of all patients undergoing EVT for acute ischemic stroke in the Netherlands.16 This registry was approved by the central medical ethics committee of the Erasmus Medical Center Rotterdam, which served as the review board of all participating centers and granted permission to carry out the study as a registry (MEC-2014–235). All patients or legal representatives were provided with oral and written information on the registry and had the opportunity to withdraw consent to use their data.

    We included acute ischemic stroke patients aged 18 or older, with an anterior circulation occlusion who underwent EVT (defined as groin puncture with the intent of thrombectomy) less than 390 minutes after stroke onset between March 2014 and November 2017. Patients without contraindications received 0.9 mg/kg of intravenous alteplase before EVT. The EVT approach and choice of material was left to the individual interventionalist. All patients underwent a standardized stroke imaging protocol at baseline, consisting of baseline non-contrast computed tomography (NCCT) followed by single arterial-phase computed tomography angiography (CTA). Other imaging modalities, such as CT perfusion, were acquired at the discretion of the treating physician. Patients with thick-slice (>2.5 mm) CT imaging, and with NCCT and CTA images not acquired within 30 minutes from each other were excluded. Source data for this study are not available as we did not obtain patient approval for sharing individual, coded patient data. All analytic methods, codes, and results are available from the corresponding author on reasonable request.

    Data collection

    The thin-slice NCCT and CTA images were acquired in GE Medical Systems, Philips, Siemens, or Toshiba scanners with a median tube peak voltage of 100 (100-120) kV for CTA, and 120 (100-120) kV for NCCT. The median exposure was 156 (73-221) mA·s for CTA and 301 (240-394) mA·s for NCCT. All details on the image acquisition parameters and protocols can be found in online supplemental table S1.

    Supplemental material

    The MR CLEAN Registry imaging core laboratory consisting of 31 interventional neuroradiologists (with at least 5 years of experience assessing CTA scans in routine clinical practice) assessed the occlusion location and the clot burden score (CBS) based on the contrast-filling defects found on baseline CTA. The CBS is a 10-point scale assessing the extension of the occlusion: the 10 points are divided between vessel segments in the anterior circulation, and for each occluded segment the corresponding points are deducted from 10.16 Therefore, more occlusive thrombi have lower CBS. Core-lab members were blinded to all clinical information (demographic, treatment and outcome data) except symptom side.16 Each rater assessed a subset of the total number of cases following the provided training and guidelines.

    We additionally measured the following radiological thrombus characteristics: distance from the internal carotid artery (ICA) terminus to the thrombus (DT), thrombus length, thrombus density, and thrombus perviousness. Thrombus measurements of patients included between March 2014 and June 2016 were already available.1 For patients included between June 2016 and November 2017, additional measurements were performed similar to Bruna et al.1 These measurements were performed by trained observers (AAEB, JB, JWH, KRK, MK, MLT, NA, NAT, NB, and PRK) who were blinded to all clinical information except symptom side. Each observer was assigned a unique subset of the total number of cases. To ensure consistency and homogeneity across the measurements, the observers received training and guidelines to place the markers, including definitions of each vessel segment and a scheme similar to the one shown in figure 1A,B. Difficult cases (such as bifurcated or very long thrombi and cases without distal collateral filling) were marked and discussed among the group of observers. If the marker-placement remained unclear, the case was reviewed by a senior radiologist.

    Figure 1

    Thrombus markers. A) Schematic overview of thrombus marker placement, axial view. (B) Schematic overview of thrombus marker placement, coronal view. (C) Axial view of CTA and NCCT scans showing a left-MCA occlusion and placed markers. To visualize the markers, a zoom-in of the occlusion is displayed and the markers are circled in their corresponding color in the image in the lower row. These circles do not represent the 1 mm radius spherical regions of interest used to compute density and perviousness. (D) Coronal view of the CTA and NCCT scans displayed in C showing a left-MCA occlusion and placed markers. A closer view of the occlusion is displayed in the image in the lower row, with the markers circled in their corresponding color. A1, anterior cerebral artery A1 segment; CTA, computed tomography angiography; ICA, internal carotid artery; M1, middle cerebral artery M1 segment; M2, middle cerebral artery M2 segment; MCA, middle cerebral artery; NCCT, non-contrast computed tomography.

    For these measurements, the thin-slice NCCT and CTA images were corregistered using Elastix’ rigid-registration.17 Scans with uncorrectable registration errors, imaging artifacts (eg, beam hardening, metal artifacts), excessive noise, poor CTA contrast opacification, or an incomplete field of view were excluded. Partial occlusions (thrombi occluding 50% of the vessel diameter), bilateral thrombi, too short thrombi (<2 mm), thrombi very close to bone (affected by partial volume/blooming artifact of bone), and/or calcified emboli were also excluded.1

    For each occlusion, we placed up to nine markers along the occluded artery: one marker defining the ICA-terminus, up to three markers along the vessel segment between the ICA-terminus and the proximal thrombus border, two markers defining the thrombus’ proximal and distal borders, and three markers in the proximal, middle, and distal parts of the thrombus (figure 1). These markers were simultaneously placed on the corregistered NCCT and CTA scans using ITK-snap software.18 We used three views (axial, sagittal, and coronal) for the marker placement. The occlusion extension was determined based on the contrast-filling defects found on CTA, and aided by the NCCT hyperdense artery sign if present. Because of NCCT was performed before CTA, hyperdensities are expected to come from the thrombus rather than residual contrast.

    DT was computed as the total path length between the ICA-terminus and the proximal thrombus border marker. DT is thereby a measure of thrombus distality with respect to the ICA-terminus. If the proximal part of the thrombus was located proximal to the ICA-terminus, DT was set to zero. Thrombus length was computed as the total path length between the proximal and distal thrombus border markers. The three in-thrombus markers were used to define 1 mm radius spherical regions of interest, which were used to compute the average thrombus density and perviousness values, as described previously.1

    Statistical analyses

    Our analysis includes three main sections: summary statistics which describes the methods to present characteristic distributions, correlation analyses to assess the collinearity of these characteristics, and clustering of thrombus imaging characteristics to determine whether typical thrombus archetypes with distinct imaging features can be found. We used Python’s statistics library for the statistical analysis, Seaborn library for data visualizations and scikit-learn library for clustering analysis. We set the significance level for all analyses at p<0.05.

    Summary statistics

    For numerical variables, we presented summary statistics as median and interquartile range (IQR). For categorical variables, we presented summary statistics as frequencies and percentages. Baseline characteristics were compared between the currently included patient sample and the overall MR CLEAN Registry population. For between-group comparisons, the Kruskal-Wallis and/or Mann-Whitney-U tests were used to compare medians, and Embedded Image tests to compare frequencies. Post-hoc analyses were adjusted with Bonferroni corrections for multiple testing.

    Correlation analyses

    We included the following variables in our correlation analysis: DT, thrombus length, thrombus density, thrombus perviousness, and CBS. We generated bivariate scatterplots and computed the correlation using the pairwise Spearman’s correlation coefficient, ρ, for all occlusion locations. We evaluated the correlation strength as follows: 0.10 ≤ |ρ|<0.40, weak correlation; 0.40 ≤ |ρ|<0.60, moderate correlation; |ρ|≥0.60, strong correlation. In addition, we built pairwise linear regressions to further assess the association and variability between the variables. Although a smooth polynomial relationship like LOESS would be more appropriate to further assess the association and trend of the correlated variables, linear regressions provide simple models to explore the spectrum of thrombus characteristics. These analyses were performed for all thrombi combined and also per occlusion location (ICA, M1, and M2).

    Clustering analysis

    We used a classical, widely-used, unsupervised learning algorithm to perform the clustering: Hartigan-Wong k-means unsupervised clustering.19 For n number of features and k cluster centroids, this method aims to minimize the Euclidean distance between each point in the n-dimensional space and its closest cluster centroid ki , that is, to minimize the sum of the squared error (SSE). The following thrombus characteristics were used as features: thrombus length, density, and perviousness. All variables were standardized (transformed to a mean of 0 and a standard deviation of 1), such that their weights evenly contribute. We selected the optimal number of clusters based on three complementary techniques: the elbow method, the calculation of the silhouette coefficient, and the calculation of the Davies-Bouldin coefficient.20 For the elbow method, we computed the SSE for each cluster to find the optimal k value. By definition, the SSE decreases with an increasing number of clusters. The elbow-point indicates the optimal trade-off between the SSE and the number of clusters, and is found where the decrease in the SSE becomes linear. The silhouette coefficient is a measure of cohesion within a cluster and separation between the clusters, and ranges between −1 and 1. The higher the silhouette coefficient, the better the cohesion within the clusters and better separation from the other groups. The Davies-Bouldin coefficient is also a measure of intra-cluster similarity and inter-cluster difference. It is computed as the average ratio between within-cluster and between-cluster distances, and therefore, smaller Davies-Bouldin values indicate better clusters. For each k, we ran the algorithm for 1000 iterations with 100 different initial configurations of the cluster centroids.

    Online supplemental table 2 includes definitions of association, correlation, collinearity and unsupervised clustering for additional information.

    Results

    Our study population consisted of 934 out of3637 patients from the MR CLEAN Registry (online supplemental figure S1). Included patients had a median age of 72 (IQR 62–80) years. Median National Institutes of Health Stroke Scale (NIHSS) score at baseline was 15 (IQR 11–20). Baseline characteristics of our study cohort and the full MR CLEAN Registry cohort can be found in online supplemental table S3. Patients in our study were more often presented directly to an EVT-capable center (ie, no interhospital transfer), and correspondingly their median onset to groin puncture time was slightly shorter (188 [IQR 139–246] min vs 195 [IQR 150–260] min, p<0.01). NIHSS scores at 24–48 hours were lower in our study population (9 [IQR 3–16] vs 10 [IQR 4–17], p=0.02) compared with the full MR CLEAN Registry cohort.

    Summary statistics of the thrombus imaging characteristics can be found in online supplemental table S4. The most common occlusion location was the M1 segment (61%), followed by the ICA (22%), and the M2 (16%). The distributions and correlations of thrombus imaging characteristics are visualized in figure 2 and online supplemental table S5. We found that higher CBS was strongly correlated with longer DT (ρ=0.68, p<0.01), and moderately correlated with shorter thrombus length (ρ=−0.41, p<0.01). These correlations are individually visualized in online supplemental figure S2. The other correlations, although statistically significant, were weak (|ρ|<0.40).

    Figure 2

    Thrombus imaging characteristics. The diagonal shows the histograms of DT, thrombus length, density, perviousness and CBS. The graphs below the diagonal show bivariate scatter plots, Spearman’s correlation coefficient (ρ) and significance level of the correlation, where ** means p<0.01. The plots above the diagonal show bivariate scatter plots with a linear fit. CBS, clot burden score; DT, distance from the internal carotid artery terminus to the thrombus; HU, Hounsfield units; mm, millimeters; thr, thrombus.

    Subgroup analysis: occlusion location

    A between-group comparison of the thrombus characteristics per occlusion location can be found in table 1. Thrombus characteristics significantly differed per occlusion location. Thrombi located in the ICA were longer, denser, and less pervious compared with M1 and M2 thrombi. Similarly, M1 thrombi were longer, denser, and less pervious compared with M2 thrombi. More details on the significance level of pairwise comparisons can be found in online supplemental table S6.

    Table 1

    Thrombus imaging characteristics per occlusion location (ICA, M1, and M2).

    Similar to figure 2, the distribution and correlations of these characteristics, color-coded by occlusion location, can be found in online supplemental figure S3 and online supplemental table S7. All found correlations were weak (|ρ|<0.40).

    Clustering analysis

    Both the elbow method and silhouette coefficients indicated that the optimal number of clusters lay around 4 and 6 (figure 3A,B). The low silhouette coefficients, with values all under 0.30, indicate that the clusters cannot be clearly discerned. Davies-Bouldin coefficients indicated that the optimal number of clusters was in the range of 4–10, with two local minima at k=6 and k=9 (figure 3C). Based on the three methods, we chose to continue our analysis with four clusters. A 3D visualization of the thrombus features of the four clusters is displayed in figure 3D, next to a similar visualization clustered by occlusion location (figure 3E). The cluster centroids can be found in online supplemental table S8. The distribution characteristics for each cluster are also summarized in online supplemental table S8. Cluster 2 consists of longer, denser, and less pervious thrombi, while cluster four includes shorter and less dense thrombi, with higher perviousness values. Cluster 1 and 3 reflect a mixture of both: shorter thrombi, less pervious, with lower and higher densities, respectively.

    Figure 3

    Finding the optimal number of clusters. (A)SSE as a function of the number of clusters. The elbow point is found around 4–6, after which the decrease in SSE becomes linear. (B) Silhouette coefficients as a function of the number of clusters. The highest (and therefore, preferred) silhouette coefficients are found around 4–6. (C) Davies-Bouldin coefficients as a function of the number of clusters. Lower coefficients indicate better clustering. From k=4 onwards, Davies-Bouldin coefficients showed similar values, with two local minima at k=6 and k=9. (D) 3D visualization of thrombus imaging features clustered by 4-means unsupervised clustering. (E) 3D visualization of thrombus imaging features clustered by occlusion location. SSE, sum of the squared error.

    Discussion

    In our analysis of thrombus imaging characteristics in EVT-treated acute ischemic stroke patients, we found that all assessed thrombus imaging characteristics were significantly intercorrelated. Higher CBS was strongly correlated with longer DT and was moderately correlated with shorter thrombus length. These correlations became weak when stratifying per occlusion location. Longer, denser, and less pervious thrombi were mostly found in more proximal occlusion locations. Our clustering analysis suggests that thrombus imaging characteristics form a continuum, and that no typical thrombus types can be identified similar to the TOAST classification.

    To our knowledge, this is the largest dataset of thrombus imaging characteristics of acute ischemic stroke patients. Previous studies have focused on the association of thrombus imaging characteristics with treatment and patient outcome, and have partially assessed associations between thrombus characteristics.21 Other studies have related thrombus imaging characteristics to their histopathology,22 etiology,23 and biomechanical characteristics.24 The statistical models used to study these associations between thrombus characteristics and outcomes do not commonly account for the collinearity between these characteristics. This collinearity can lead to unreliable or unrepresentative model results, or a reduction in statistical significance. In a multivariable regression, collinearity hinders the relationship of the independent variable with the dependent one, since the independent variables change simultaneously. This implies that, although the overall predictions are unaffected, the regression coefficients, corresponding standard errors and significance can be ‘wrongly’ estimated.25 Moreover, in case of collinearity, the predictive value can be assigned to one of the parameters whereas the relation with outcome could also be affected by another collinear parameter.

    Although the results of our study do not imply a direct change in current clinical practice, they illustrate the importance of studying collinearity when building predictive models – which are used to draw conclusions of treatment effects and outcomes consequence of current clinical practice.

    In our study, we found that the correlations between most thrombus characteristics are significant but weak. This means there is still a large variety of other thrombus characteristics that are given a single thrombus variable. This was also reflected in our clustering analysis. When clustering by occlusion location, we found that even if the distributions of length, density, and perviousness significantly differed between the groups, some overlap still existed. With unsupervised clustering, thrombi were classified based on their length, density and perviousness. However, we did not observe clearly distinct thrombus archetypes, but rather found that thrombus imaging characteristics form a continuum which hinders their clustering.

    In current clinical practice, occlusion location (among other baseline characteristics) determines EVT eligibility. Stroke guidelines indicate that patients with proximal occlusions are eligible for EVT,4 whereas the eligibility of (more distal) medium vessel occlusion stroke is currently being researched. The definition of, eg, M1, M2, and M3 segments can be challenging and highly dependent on the observer.26 DT better defines the distality of the occlusion.27 However, DT does not take anatomical landmarks such as bifurcations into account (which are used to determine occlusion location) and can be critical for the chance of EVT success. In our results, we saw that for the same DT, the patient could either have an M1 or M2 occlusion. Unfortunately, the number of M3 occlusions in our database was insufficient to further study this relation.

    We found that thrombus imaging characteristics significantly differ per occlusion location and that some of these characteristics are moderately and strongly correlated with CBS. Currently, the manual assessment of thrombus characteristics is time-consuming and requires thin-slice CT imaging.1 On the other hand, assessment of occlusion location and CBS is commonly done in clinical practice/studies, is less time-consuming than manual thrombus measurements, and does not require thin-slice images.16 Correlations between occlusion-location/CBS and DT/length/density/perviousness offer the possibility of uncomplicated characterization of the thrombus, which could ultimately lead to a reduction of time-consuming assessments. With the enhanced development of automated measurements and thrombus segmentations, quantitative characterization of the thrombus might be optimized.28

    Finally, in-silico models that simulate stroke onset, treatment, and outcome require, among others, an accurate and quantitative representation of the thrombus.29 Combining thrombus imaging, histological and biomechanical properties can help to capture the whole spectrum of thrombus characteristics needed for such in-silico modeling. Once the correlations between these characteristics are well-established, typical thrombi can be sampled from such distributions and can be used to study treatment success in different scenarios. Our study contributes to the quantification of such correlations.

    Limitations

    Our study had some limitations. We only included patients with available thin-slice imaging, which led to a high exclusion rate, and therefore, to selection bias (less intra-hospital transfers, shorter onset-to-groin times, and lower NIHSS scores at 24–48 hours compared with the whole MR CLEAN Registry population).

    Occlusion location and thrombus measurements were not assessed by the same group of observers (MR CLEAN Registry core lab for occlusion location and CBS vs trained observers for DT, thrombus length, density, and perviousness) nor in the same CT modality (CTA only by MR CLEAN Registry core lab vs NCCT and CTA by trained observers). This might create some incongruencies between occlusion location and DT, especially close to the ICA-terminus. For example: on CTA, lack of contrast in distal ICA-terminus can be scored as an M1 occlusion (expected DT≠0), while when looking at both NCCT and CTA simultaneously, it is scored as an ICA-T occlusion (expected DT=0). In addition, because occlusion location was defined as the most proximal occluded (intracranial) vessel segment on CTA, patients with multiple occlusions might have been classified as one occlusion location, while the thrombus characteristics were measured in a more distal occluded segment where the NCCT hyperdense artery sign was visible.

    The measured thrombus length was based on the absence of contrast as seen in single-phase CTA, supported by the NCCT hyperdense artery sign, if present. Measurements on multiphase CTA might more accurately capture the true thrombus length.30

    Conclusion

    Thrombus imaging characteristics are significantly intercorrelated and some of them show moderate and strong correlations. The collinearity of these thrombus characteristics should be considered when multiple thrombus characteristics are included in future predictive modeling studies. The observed weak correlations reflect that there is still a large variety of characteristics for a given single thrombus variable: thrombus imaging characteristics form a continuum, which does not allow for grouping of typical thrombus archetypes based on these features. The continuous spectrum and specific variability of thrombus imaging characteristics should be considered when developing novel treatment approaches.

    Supplemental material

    Data availability statement

    Data are available upon reasonable request. All data relevant to the study are included in the article or uploaded as supplementary information. All data relevant to the study are included in the article or uploaded as Supplemental Material. Source data for this study are not available due to privacy regulations, but analysis methods, codes, and results are available from the corresponding author upon reasonable request.

    Ethics statements

    Patient consent for publication

    Ethics approval

    These patients are part of the MR CLEAN Registry, a multicenter prospective observational registry of all patients undergoing EVT for acute ischemic stroke in the Netherlands. This registry was approved by the central medical ethics committee of the Erasmus Medical Center Rotterdam, which served as the review board of all participating centers (MEC-2014-235). The requirement for written informed consent was waived, but all patients or legal representatives were provided with oral and written information on the registry, and had the opportunity to withdraw consent to use their data via an opt-out form, conforming to the European Union General Data Protection Regulation.

    References

    Supplementary materials

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Footnotes

    • Collaborators MR CLEAN Registry investigators – Group authors: Executive committee: Diederik W.J. Dippel (Department of Neurology, Erasmus MC University Medical Center); Aad van der Lugt (Radiology, Erasmus MC University Medical Center); Charles B.L.M. Majoie (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Yvo B.W.E.M. Roos (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Robert J. van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Wim H. van Zwam (Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Jelis Boiten (Neurology, Haaglanden MC, the Hague); Jan Albert Vos (Radiology, Sint Antonius Hospital, Nieuwegein). Study coordinators: Ivo G.H. Jansen (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Maxim J.H.L. Mulder (Department of Neurology, Radiology, Erasmus MC University Medical Center); Robert- Jan B. Goldhoorn (Department of Neurology, Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Kars C.J. Compagne (Radiology, Erasmus MC University Medical Center); Manon Kappelhof (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Josje Brouwer (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Sanne J. den Hartog (Department of Neurology, Radiology, Public Health, Erasmus MC University Medical Center); Wouter H. Hinsenveld (Department of Neurology, Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)). Local principal investigators: Diederik W.J. Dippel (Department of Neurology, Erasmus MC University Medical Center); Bob Roozenbeek (Department of Neurology, Erasmus MC University Medical Center); Aad van der Lugt (Radiology, Erasmus MC University Medical Center); Adriaan C.G.M. van Es (Radiology, Erasmus MC University Medical Center); Charles B.L.M. Majoie (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Yvo B.W.E.M. Roos (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Bart J. Emmer (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Jonathan M. Coutinho (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Wouter J. Schonewille (Department of Neurology, Sint Antonius Hospital, Nieuwegein); Jan Albert Vos (Radiology, Sint Antonius Hospital, Nieuwegein); Marieke J.H. Wermer (Department of Neurology, Leiden University Medical Center); Marianne A.A. van Walderveen (Radiology, Leiden University Medical Center); Julie Staals (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Robert J. van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Wim H. van Zwam (Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem); Jasper M. Martens (Radiology, Rijnstate Hospital, Arnhem); Geert J. Lycklama à Nijeholt (Department of Radiology, Haaglanden MC, the Hague); Jelis Boiten (Neurology, Haaglanden MC, the Hague); Sebastiaan F. de Bruijn (Department of Neurology, HAGA Hospital, the Hague); Lukas C. van Dijk (Radiology, HAGA Hospital, the Hague); H. Bart van der Worp (Department of Neurology, University Medical Center Utrecht); Rob H. Lo (Radiology, University Medical Center Utrecht); Ewoud J. van Dijk (Department of Neurology, Radboud University Medical Center, Nijmegen); Hieronymus D. Boogaarts (Neurosurgery, Radboud University Medical Center, Nijmegen); J. de Vries (Department of Neurology, Isala Klinieken, Zwolle); Paul L.M. de Kort (Department of Neurology, Elisabeth-TweeSteden ziekenhuis, Tilburg); Julia van Tuijl (Department of Neurology, Elisabeth-TweeSteden ziekenhuis, Tilburg); Jo P. Peluso (Radiology, Elisabeth-TweeSteden ziekenhuis, Tilburg); Puck Fransen (Department of Neurology, Isala Klinieken, Zwolle); Jan S.P. van den Berg (Department of Neurology, Isala Klinieken, Zwolle); Boudewijn A.A.M. van Hasselt (Radiology, Isala Klinieken, Zwolle); Leo A.M. Aerden (Department of Neurology, Reinier de Graaf Gasthuis, Delft); René J. Dallinga (Radiology, Reinier de Graaf Gasthuis, Delft); Maarten Uyttenboogaart (Department of Neurology, University Medical Center Groningen); Omid Eschgi (Radiology, University Medical Center Groningen); Reinoud P.H. Bokkers (Radiology, University Medical Center Groningen); Tobien H.C.M.L. Schreuder (Department of Neurology, Atrium Medical Center, Heerlen); Roel J.J. Heijboer (Radiology, Atrium Medical Center, Heerlen); Koos Keizer (Department of Neurology, Catharina Hospital, Eindhoven); Lonneke S.F. Yo (Radiology, Catharina Hospital, Eindhoven); Heleen M. den Hertog (Department of Neurology, Isala Klinieken, Zwolle); Tomas Bulut (Radiology, Medisch Spectrum Twente, Enschede); Paul J.A.M. Brouwers (Department of Neurology, Medisch Spectrum Twente, Enschede). Imaging assessment committee: Charles B.L.M. Majoie (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam) (chair); Wim H. van Zwam (Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Aad van der Lugt (Radiology, Erasmus MC University Medical Center); Geert J. Lycklama à Nijeholt (Department of Radiology, Haaglanden MC, the Hague); Marianne A.A. van Walderveen (Radiology, Leiden University Medical Center); Marieke E.S. Sprengers (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Sjoerd F.M. Jenniskens (Radiology, Radboud University Medical Center, Nijmegen); René van den Berg (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Albert J. Yoo (Department of Radiology, Texas Stroke Institute, Texas, United States of America); Ludo F.M. Beenen (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Alida A. Postma (Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Stefan D. Roosendaal (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Bas F.W. van der Kallen (Department of Radiology, Haaglanden MC, the Hague); Ido R. van den Wijngaard (Department of Radiology, Haaglanden MC, the Hague); Adriaan C.G.M. van Es (Radiology, Erasmus MC University Medical Center); Bart J. Emmer, (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Jasper M. Martens (Radiology, Rijnstate Hospital, Arnhem); Lonneke S.F. Yo (Radiology, Catharina Hospital, Eindhoven); Jan Albert Vos (Radiology, Sint Antonius Hospital, Nieuwegein); Joost Bot (Department of Radiology, Amsterdam UMC, Vrije Universiteit van Amsterdam, Amsterdam); Pieter-Jan van Doormaal (Radiology, Erasmus MC University Medical Center); Anton Meijer (Radiology, Radboud University Medical Center, Nijmegen); Elyas Ghariq (Department of Radiology, Haaglanden MC, the Hague); Reinoud P.H. Bokkers (Radiology, University Medical Center Groningen); Marc P. van Proosdij (Department of Radiology, Noordwest Ziekenhuisgroep, Alkmaar); G. Menno Krietemeijer (Radiology, Catharina Hospital, Eindhoven); Jo P. Peluso (Radiology, Elisabeth-TweeSteden ziekenhuis, Tilburg); Hieronymus D. Boogaarts (Neurosurgery, Radboud University Medical Center, Nijmegen); Rob Lo (Radiology, University Medical Center Utrecht); Wouter Dinkelaar (Radiology, Erasmus MC University Medical Center); Auke P.A. Appelman (Radiology, University Medical Center Groningen); Bas Hammer (Radiology, HAGA Hospital, the Hague); Sjoert Pegge (Radiology, Radboud University Medical Center, Nijmegen); Anouk van der Hoorn (Radiology, University Medical Center Groningen); Saman Vinke (Neurosurgery, Radboud University Medical Center, Nijmegen). Writing committee: Diederik W.J. Dippel (Department of Neurology, Erasmus MC University Medical Center) (chair); Aad van der Lugt (Radiology, Erasmus MC University Medical Center); Charles B.L.M. Majoie (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Yvo B.W.E.M. Roos (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Robert J. van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Wim H. van Zwam (Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Geert J. Lycklama à Nijeholt (Department of Radiology, Haaglanden MC, the Hague); Jelis Boiten (Neurology, Haaglanden MC, the Hague); Jan Albert Vos (Radiology, Sint Antonius Hospital, Nieuwegein); Wouter J. Schonewille (Department of Neurology, Sint Antonius Hospital, Nieuwegein); Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem); Jasper M. Martens (Radiology, Rijnstate Hospital, Arnhem); H. Bart van der Worp (Department of Neurology, University Medical Center Utrecht); Rob H. Lo (Radiology, University Medical Center Utrecht). Adverse event committee: Robert J. van Oostenbrugge (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)) (chair); Jeannette Hofmeijer (Department of Neurology, Rijnstate Hospital, Arnhem); H. Zwenneke Flach (Radiology, Isala Klinieken, Zwolle). Trial methodologist: Hester F. Lingsma (Public Health, Erasmus MC University Medical Center). Research nurses / local trial coordinators: Naziha el Ghannouti (Department of Neurology, Erasmus MC University Medical Center); Martin Sterrenberg (Department of Neurology, Erasmus MC University Medical Center); Wilma Pellikaan (Department of Neurology, Sint Antonius Hospital, Nieuwegein); Rita Sprengers (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Marjan Elfrink (Department of Neurology, Rijnstate Hospital, Arnhem); Michelle Simons (Department of Neurology, Rijnstate Hospital, Arnhem); Marjolein Vossers (Radiology, Rijnstate Hospital, Arnhem); Joke de Meris (Neurology, Haaglanden MC, the Hague); Tamara Vermeulen (Neurology, Haaglanden MC, the Hague); Annet Geerlings (Department of Neurology, Radboud University Medical Center, Nijmegen); Gina van Vemde (Department of Neurology, Isala Klinieken, Zwolle); Tiny Simons (Department of Neurology, Atrium Medical Center, Heerlen); Gert Messchendorp (Department of Neurology, University Medical Center Groningen); Nynke Nicolaij (Department of Neurology, University Medical Center Groningen); Hester Bongenaar (Department of Neurology, Catharina Hospital, Eindhoven); Karin Bodde (Department of Neurology, Reinier de Graaf Gasthuis, Delft); Sandra Kleijn (Department of Neurology, Medisch Spectrum Twente, Enschede); Jasmijn Lodico (Department of Neurology, Medisch Spectrum Twente, Enschede); Hanneke Droste (Department of Neurology, Medisch Spectrum Twente, Enschede); Maureen Wollaert (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Sabrina Verheesen (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); D. Jeurrissen (Department of Neurology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Erna Bos (Department of Neurology); Yvonne Drabbe (Department of Neurology, HAGA Hospital, the Hague); Michelle Sandiman (Department of Neurology, HAGA Hospital, the Hague); Nicoline Aaldering (Department of Neurology, Rijnstate Hospital, Arnhem); Berber Zweedijk (Department of Neurology, University Medical Center Utrecht); Jocova Vervoort (Department of Neurology, Elisabeth-TweeSteden ziekenhuis, Tilburg); Eva Ponjee (Department of Neurology, Isala Klinieken, Zwolle); Sharon Romviel (Department of Neurology, Radboud University Medical Center, Nijmegen); Karin Kanselaar (Department of Neurology, Radboud University Medical Center, Nijmegen); Denn Barning (Radiology, Leiden University Medical Center). PhD / Medical students: Esmee Venema (Public Health, Erasmus MC University Medical Center); Vicky Chalos (Department of Neurology, Public Health, Erasmus MC University Medical Center); Ralph R. Geuskens (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Tim van Straaten (Department of Neurology, Radboud University Medical Center, Nijmegen); Saliha Ergezen (Department of Neurology, Erasmus MC University Medical Center); Roger R.M. Harmsma (Department of Neurology, Erasmus MC University Medical Center); Daan Muijres (Department of Neurology, Erasmus MC University Medical Center); Anouk de Jong (Department of Neurology, Erasmus MC University Medical Center); Olvert A. Berkhemer (Department of Neurology, Erasmus MC University Medical Center; Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam; Radiology, Maastricht University Medical Center and Cardiovascular Research Institute Maastricht (CARIM)); Anna M.M. Boers (Department of Radiology and Nuclear Medicine, Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam); J. Huguet (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); P.F.C. Groot (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Marieke A. Mens (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Katinka R. van Kranendonk (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Kilian M. Treurniet (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Manon L. Tolhuisen (Department of Radiology and Nuclear Medicine, Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam); Heitor Alves (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Annick J. Weterings (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam), Eleonora L.F. Kirkels (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam), Eva J.H.F. Voogd (Department of Neurology, Rijnstate Hospital, Arnhem); Lieve M. Schupp (Department of Radiology and Nuclear Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam); Sabine L. Collette (Department of Neurology, Radiology, University Medical Center Groningen); Adrien E.D. Groot (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Natalie E. LeCouffe (Neurology, Amsterdam UMC, University of Amsterdam, Amsterdam); Praneeta R. Konduri (Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam); Haryadi Prasetya Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam; Nerea Arrarte Terreros Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam ; Lucas A. Ramos Biomedical Engineering & Physics, Amsterdam UMC, University of Amsterdam, Amsterdam.

    • Contributors NAT developed the study, performed the data analysis, wrote the manuscript, and is the guarantor of the study. AAEB, MK, MLT, JB, JWH, PRK, KRvK, BGD, and HCBRA contributed to the data analysis and interpretation. DWJD, WHvZ, LFMB, and LSFY contributed to the clinical assessment of the data. EvB, CBLMM, and HAM contributed to the research development and project supervision. All authors contributed to the final version of the manuscript by critical revisions.

    • Funding This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 777072 (INSIST project), and the AMC medical Research BV, Amsterdam UMC, location AMC, under project No 21937. The MR CLEAN Registry was partly funded by TWIN Foundation, Erasmus MC University Medical Center, Maastricht University Medical Center, and Amsterdam UMC.

    • Competing interests This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 777072 (INSIST project), and the AMC medical Research BV, Amsterdam UMC, location AMC, under project No 21937. The MR CLEAN registry is partially funded by unrestricted grants from the Applied Scientific Institute for Neuromodulation (Toegepast Wetenschappelijk Instituut voor Neuromodulatie), Erasmus Medical Center, Amsterdam University Medical Center and Maastricht University Medical Center. HAM reports being a co-founder and shareholder of Nicolab, a company that focuses on the use of artificial intelligence for medical image analysis. CBLMM reports grants from European Commission during the conduct of the study; grants from CVON/Dutch Heart Foundation, TWIN Foundation, Health Evaluation Netherlands, and Stryker, outside the submitted work; and shareholder of Nicolab. DWJD reports unrestricted grants from Stryker, Penumbra, Medtronic, Cerenovus, Thrombolytic Science, LLC, Dutch Heart Foundation, Brain Foundation Netherlands, The Netherlands Organization for Health Research and Development, Health Holland Top Sector Life Sciences and Health, and Thrombolytic Science, LLC for research, paid to institution. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.