You are here

Article Text

Article menu
Download PDFPDF
Standards
Original research
Inter-rater reliability of published flow diversion occlusion scales
  1. Marcus D Mazur1,
  2. Philipp Taussky1,
  3. Lubdha M Shah2,
  4. Blair Winegar2,
  5. Min S Park1
  1. 1Department of Neurosurgery, University of Utah, Salt Lake City, Utah, USA
  2. 2Department of Neuroradiology, Clinical Neurosciences Center, University of Utah, Salt Lake City, Utah, USA
  1. Correspondence to Dr Min S Park, Department of Neurosurgery, University of Utah, 175 N Medical Drive East, Salt Lake City, UT 84132, USA; min.park{at}hsc.utah.edu

Abstract

Background With increasing use of flow-diverting stents for the treatment of intracranial aneurysms, standardized methods and a common language to evaluate angiographic outcomes are needed. Multiple grading scales have been developed for this purpose but none has been widely adopted.

Objective To analyze these scales to determine interobserver reliability.

Methods Four independent assessors scored the intraprocedural angiograms of patients who underwent flow-diverting stent deployment for an intracranial saccular or fusiform aneurysm at our institution between October 2012 and June 2015. Angiographic outcome immediately after flow-diverting stent deployment was scored using three grading scales (Kamran–Byrne (KB), Simple Measurement of Aneurysm Residual after Treatment (SMART), and O'Kelley, Krings, Marotta (OKM)). Statistical analysis was performed using Light's κ for multiple raters (κ), Kendall's coefficient of concordance (W), and intraclass correlation (ICC).

Results We included the angiograms of 50 consecutive patients (mean age 58 years, range 30–79) who underwent flow-diverting stent deployment for an intracranial aneurysm (40 saccular, 10 fusiform). Six aneurysms were located in the posterior circulation. The inter-rater reliability was typically poor or fair: SMART aneurysm filling (κ=0.30, W=0.36, ICC=0.12), SMART parent vessel stenosis (κ=0.07, W=0.33, ICC=0.12), KB axis I (κ=0.24, W=0.50, ICC=0.25), KB axis II (κ=0.07, W=0.30, ICC=0.06), OKM aneurysm filling (κ=0.23, W=0.45, ICC=0.13), OKM contrast stasis (κ=0.36,W=0.71, ICC=0.54).

Conclusions Existing flow-diverting stent grading scales have low inter-rater reliability for most categories.

  • Flow Diverter
  • Aneurysm
  • Standards
  • Angiography

https://doi.org/10.1136/neurintsurg-2015-012193

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    View Full Text

    Footnotes

    • Contributors MSP and MDM conceived the study. All authors performed the data collection. MDM performed the statistical analysis. MDM and MSP interpreted the results. MDM and MSP drafted the manuscript. MSP supervised the study. MSP approved the final manuscript.

    • Competing interests PT is a consultant for Covidien and a proctor for the Pipeline embolization device.

    • Ethics approval This study was approved by the institutional review board at our institution before data collection.

    • Provenance and peer review Not commissioned; externally peer reviewed.