Article Text

Download PDFPDF
Original research
Region-specific agreement in ASPECTS estimation between neuroradiologists and e-ASPECTS software
  1. Ain Neuhaus1,
  2. Seyed Mohammad Seyedsaadat2,
  3. David Mihal3,
  4. John Benson2,
  5. Ian Mark2,
  6. David F Kallmes2,
  7. Waleed Brinjikji4
  1. 1 Radcliffe Department of Medicine, University of Oxford, Oxford, UK
  2. 2 Radiology, Mayo Clinic, Rochester, Minnesota, USA
  3. 3 Neuroradiology, Cleveland Clinic, Cleveland, Ohio, USA
  4. 4 Neurosurgery, Mayo Clinic Minnesota, Rochester, Minnesota, USA
  1. Correspondence to Dr Waleed Brinjikji, Mayo Clinic Minnesota, Rochester, MN 55901, USA; Brinjikji.Waleed{at}mayo.edu

Abstract

Background and purpose The Alberta Stroke Program Early CT Score (ASPECTS) is a widely used measure of ischemic change on non-contrast CT. Although predictive of long-term outcome, ASPECTS is limited by its modest interobserver agreement. One potential solution to this is the use of machine learning strategies, such as e-ASPECTS, to detect ischemia. Here, we compared e-ASPECTS with manual scoring by experienced neuroradiologists for all 10 individual ASPECTS regions.

Materials and methods We retrospectively reviewed 178 baseline non-contrast CT scans from patients with acute ischemic stroke undergoing endovascular thrombectomy. All scans were reviewed by two independent neuroradiologists with a third reader arbitrating disagreements for a consensus read. Each ASPECTS region was scored individually. All scans were then evaluated using a machine learning-based software package (e-ASPECTS, Brainomix). Interobserver agreement between readers and the software for each region was calculated with a kappa statistic.

Results The median ASPECTS was 9 for manual scoring and 8.5 for e-ASPECTS, with an overall agreement of κ=0.248. Regional agreement varied from κ=0.094 (M1) to κ=0.555 (lentiform), with better performance in subcortical regions. When corrected for the low number of infarcts in any given region, prevalence-adjusted bias-adjusted kappa ranged from 0.483 (insula) to 0.888 (M3), with greater agreement for cortical areas. Intraclass correlation coefficients were between 0.09 (M1) and 0.556 (lentiform).

Conclusion Manual scoring and e-ASPECTS had fair agreement in our dataset on a per-region basis. This warrants further investigation using follow-up scans or MRI as the gold standard measure of true ASPECTS.

  • stroke
  • thrombectomy
  • CT
View Full Text

Statistics from Altmetric.com

Footnotes

  • Twitter @DavidMihalMD

  • Contributors AN and SMS analysed the data and drafted the manuscript. DM, JB, IM, DFK, and WB collected the data. DFK and WB supervised the project. All authors contributed to revising the manuscript, approved the final version, and agree to be accountable for all aspects of the work.

  • Funding AN was supported by an award from the Oxford University Clinical Academic Graduate School. This work was done during the term of an Award from the American Heart Association (19POST34381067) to SMS.

  • Competing interests The manuscript was reviewed by Brainomix, the developers of e-ASPECTS, but the authors retained full control over analysis, presentation, and discussion of results.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement Data are available upon reasonable request.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.