Article Text

other Versions

PDF
Original research
Inter-rater reliability of published flow diversion occlusion scales
  1. Marcus D Mazur1,
  2. Philipp Taussky1,
  3. Lubdha M Shah2,
  4. Blair Winegar2,
  5. Min S Park1
  1. 1Department of Neurosurgery, University of Utah, Salt Lake City, Utah, USA
  2. 2Department of Neuroradiology, Clinical Neurosciences Center, University of Utah, Salt Lake City, Utah, USA
  1. Correspondence to Dr Min S Park, Department of Neurosurgery, University of Utah, 175 N Medical Drive East, Salt Lake City, UT 84132, USA; min.park{at}hsc.utah.edu

Abstract

Background With increasing use of flow-diverting stents for the treatment of intracranial aneurysms, standardized methods and a common language to evaluate angiographic outcomes are needed. Multiple grading scales have been developed for this purpose but none has been widely adopted.

Objective To analyze these scales to determine interobserver reliability.

Methods Four independent assessors scored the intraprocedural angiograms of patients who underwent flow-diverting stent deployment for an intracranial saccular or fusiform aneurysm at our institution between October 2012 and June 2015. Angiographic outcome immediately after flow-diverting stent deployment was scored using three grading scales (Kamran–Byrne (KB), Simple Measurement of Aneurysm Residual after Treatment (SMART), and O'Kelley, Krings, Marotta (OKM)). Statistical analysis was performed using Light's κ for multiple raters (κ), Kendall's coefficient of concordance (W), and intraclass correlation (ICC).

Results We included the angiograms of 50 consecutive patients (mean age 58 years, range 30–79) who underwent flow-diverting stent deployment for an intracranial aneurysm (40 saccular, 10 fusiform). Six aneurysms were located in the posterior circulation. The inter-rater reliability was typically poor or fair: SMART aneurysm filling (κ=0.30, W=0.36, ICC=0.12), SMART parent vessel stenosis (κ=0.07, W=0.33, ICC=0.12), KB axis I (κ=0.24, W=0.50, ICC=0.25), KB axis II (κ=0.07, W=0.30, ICC=0.06), OKM aneurysm filling (κ=0.23, W=0.45, ICC=0.13), OKM contrast stasis (κ=0.36,W=0.71, ICC=0.54).

Conclusions Existing flow-diverting stent grading scales have low inter-rater reliability for most categories.

  • Flow Diverter
  • Aneurysm
  • Standards
  • Angiography

Statistics from Altmetric.com

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.