Article Text

Original research
Rapid learning curve for Solitaire FR stent retriever therapy: evidence from roll-in and randomised patients in the SWIFT trial
  1. Sunil A Sheth1,
  2. Reza Jahan1,
  3. Elad I Levy2,
  4. Tudor G Jovin3,
  5. Blaise Baxter4,
  6. Raul G Nogueira5,
  7. Wayne Clark6,
  8. Ronald Budzik7,
  9. Osama O Zaidat8,
  10. Jeffrey L Saver9
  11. for the SWIFT Trialists
  1. 1Department of Radiology and Stroke Center, University of California, Los Angeles, Los Angeles, California, USA
  2. 2Department of Neurosurgery, Millard Fillmore Hospital, Buffalo, New York, USA
  3. 3Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
  4. 4Department of Radiology, Erlanger Hospital, Chattanooga, Tennessee, USA
  5. 5Department of Neurology, Emory University, Atlanta, Georgia, USA
  6. 6Department of Neurology, Oregon Health Science University, Portland, Oregon, USA
  7. 7Department of Radiology, Riverside Methodist Hospital, Columbus, Ohio, USA
  8. 8Department of Neurology, Medical College of Wisconsin, Milwaukee, Wisconsin, USA
  9. 9Department of Neurology and Stroke Center, University of California, Los Angeles, Los Angeles, California, USA
  1. Correspondence to Dr Reza Jahan, Division of Interventional Neuroradiology, David Geffen School of Medicine at UCLA, 757 Westwood Plaza, Suite 2129, Los Angeles, CA 90095-7430, USA; rjahan{at}mednet.ucla.edu

Abstract

Background In light of recent positive trial data for endovascular therapy in acute ischemic stroke (AIS), stent retriever use by practitioners without prior experience with these devices may become more common.

Objective To assess the safety and efficacy of thrombectomy for AIS using Solitaire for patients treated in the roll-in period of the Solitaire With the Intention For Thrombectomy (SWIFT) trial, which represented the first clinical use of the device for these interventionalists.

Methods Prospectively collected demographic, clinical, and angiographic data on patients treated in the initial roll-in and subsequent randomized phases of the SWIFT study were collected and analyzed. Key statistical analyses were validated by an independent external statistician.

Results Patients in the roll-in period achieved equivalently high rates of reperfusion (55%) compared with those treated with the device in the randomized phase (61%). Rates of adverse events were comparable (13% vs 9%). Rates of good neurological outcome were equivalent between the roll-in and randomized patients treated with Solitaire (63% vs 58%). Including the roll-in patients strengthened the conclusions of the study, that reperfusion rates without symptomatic hemorrhage with Solitaire were greater than with Merci (59% vs 24%, p<0.001).

Conclusions Thrombectomy in AIS using the Solitaire stent retriever device can be performed safely and effectively when used by experienced neurointerventionalists without previous experience with the device.

Trial registration number The SWIFT study is registered with ClinicalTrials.gov, number NCT 01054560.

  • Stroke
  • Angiography
  • Intervention
  • Technique
  • Thrombectomy

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Long-awaited positive trial data are establishing neurothrombectomy as the first new treatment in 20 years with proven benefit for patients with acute ischemic stroke (AIS). Optimism for the technique has sprung from the recent publication of the MR CLEAN trial as well as the expected positive results from other halted studies.1–4 A key driver of this success is the development and use of stent retriever devices.5–8 Initial trials of endovascular recanalization therapy using first-generation technologies failed to show any benefit over medical treatment.9–11 But concurrently, head-to-head trials of stent retrievers against earlier-generation approaches showed that the new devices achieved much higher rates of recanalization, with less hemorrhagic transformation and improved functional outcome.6 ,7 Stent retrievers went on to become the preponderant neurothrombectomy device in the subsequent trials of endovascular therapy.

For all new endovascular procedures, a key aspect is how steep the learning curve is for operators and whether the benefits of treatment accrue early or only later after a center begins to deploy the new technique. For stent retriever therapy, this subject can be examined by analysis of the earliest registration trials, which capture the first experience with device therapy overseen by device regulatory authorities. The Solitaire With the Intention For Thrombectomy (SWIFT) trial was the first to demonstrate improved recanalization rates using a stent retriever device compared with the technology existing at that time.6 In its randomized phase, this trial showed that compared with Merci coil retrievers, thrombectomy with the Solitaire stent retriever yielded much higher rates of reperfusion, required fewer device passes, had less symptomatic intracranial hemorrhage, improved disability outcomes, and reduced mortality. At the initiation of SWIFT, the Solitaire device was new to investigators in the USA, and as a result US operators in the study had no prior experience of using it in clinical settings. SWIFT therefore included a roll-in phase, in which enrolling sites were required to use the device in two cases before entering patients into the randomized phase.

In this study, we analyze the safety and efficacy of thrombectomy for AIS using Solitaire for the cohort of patients treated in this initial roll-in period. By examining the results of this group in relation to those treated in the subsequent randomized phase, we quantitatively assess the ease of use of the device, and determine whether inclusion of these early patients would have altered the results of the trial. In light of recent data demonstrating the superiority of stent retriever therapy over medical treatment alone, and the likelihood of increased frequency of stent retriever usage for AIS, these findings have implications for the effectiveness in dissemination of these treatments, particularly when performed by practitioners without substantial prior stent retriever experience.

Methods

Study design and participants

SWIFT was a multicenter, roll-in and randomized phase, prospective trial with ascertainment of a blinded primary endpoint. Details of the study design are available elsewhere.6 Briefly, patients were eligible if they had AIS with moderate to severe neurological deficits, harbored angiographically confirmed occlusions of proximal cerebral arteries, and were treatable by thrombectomy within 8 h of stroke symptom onset. Key inclusion criteria included age (22–85 years), National Institutes of Health Stroke Scale (NIHSS) score (≥8 and ≤30), and ineligibility for, or failure to respond to, intravenous recombinant tissue plasminogen activator (rt-PA).

Study site criteria

The following criteria were used in the selection of study sites and principal investigators:

  • Previous experience with clinical research and mechanical thrombectomy procedures

  • Currently treating subjects who meet the inclusion/exclusion criteria

  • Ability to enroll an adequate number of subjects

  • Ability to perform required clinical testing, including: angiography, CT, and MRI

  • Ability and willingness to provide the sponsor's representatives access to the hospital records, study files, and subject files as they pertain to the study

  • Willingness to participate, including compliance with all aspects of the study

  • Adequate staffing to conduct the study.

As mentioned in the publication detailing the methods of the study, all participating sites already had experience with the Merci retriever before the study launch, with minimum criteria of having participated in the Merci or Multi-Merci clinical trials or having Merci devices on shelf and an annual volume of ≥30 endovascular interventions for AIS.12

Roll-in period

To assure neurointerventionalist familiarity with the study device, physicians were trained in the use of the device on a bench vascular model before any procedures were done, and participating sites were required to use the device on two roll-in patients before randomization of patients. Roll-in patients received the Solitaire device as the only initial neurothrombectomy intervention and were analyzed separately from the patients who were randomly allocated to treatment. Note that the roll-in requirement of two clinical implementations of the study device before randomization was for each enrolling site and not for each neurointerventionalist.

Procedures

Once a patient was assigned to either Solitaire or Merci, the neurointerventionalist selected the proper study device size according to the device-specific instructions for use. A minimum of one deployment of the assigned study device was required within 8 h of symptom onset. The neurointerventionalist then continued recanalization attempts using the assigned device type, continuing until successful recanalization was achieved or until three passes of the study group device through any vessel had been done. The primary endpoint outcome angiogram was then obtained.

After the primary endpoint outcome angiogram was completed, rescue treatment was permitted in patients in whom adequate recanalization had not been achieved. All cases requiring rescue treatment were regarded as device treatment failures. Permitted rescue treatment interventions were as follows: a regulatory-agency-cleared neurovascular thrombectomy device, intra-arterial fibrinolysis according to US guidelines, or both. If any rescue treatment had been carried out, an additional, final, diagnostic angiogram (after all procedures had been done) was obtained.

The primary efficacy endpoint of the study was successful recanalization with the assigned study device (no use of rescue treatment) with no symptomatic intracranial hemorrhage. Successful recanalization was defined as the achievement of Thrombolysis In Myocardial Ischemia (TIMI) scale 2 or 3 flow in all treatable vessels. The stringent cerebral version of the TIMI scale was used as the recanalization metric in this study for consistency of results with prior comparable studies—namely, the Merci trials.13 ,14 Successful recanalization of the middle cerebral artery required reperfusion through all M1 and M2 segments. Successful recanalization of internal carotid artery terminus lesions required reperfusion through the internal carotid artery and all M1 and M2 branches. Successful recanalization of a vertebral artery required reperfusion through both the target vertebral artery and the basilar artery. Symptomatic intracranial hemorrhage was defined as any parenchymal hematoma, subarachnoid hemorrhage, or intraventricular hemorrhage associated with a worsening of the NIHSS score by ≥4 within 24 h.

Secondary efficacy outcomes included the following: time to achieve initial recanalization, defined as the time from baseline guide catheter run to visualization of TIMI 2 or 3 flow in all treatable vessels; good neurological outcome at 90 days, defined as a modified Rankin scale (mRS) score of ≤2 , or equal to the pre-stroke mRS if the pre-stroke mRS was >2, or NIHSS score improvement of ≥10 points; and neurological condition at 90 days, including NIHSS, Barthel Index, and mRS. The primary safety endpoint was the incidence of device-related and procedure-related serious adverse events. Additional safety endpoints included mortality and symptomatic intracranial hemorrhage.

Statistical analysis

Key statistical analyses, including the primary endpoint analysis, were validated by an independent external statistician (J Schafer, MS, NAMSA, Minneapolis, Minnesota, USA). Analyses of continuous variables were calculated by t test (when mean is reported) or Wilcoxon test (when median is reported). Analyses of discrete variables were conducted using Fisher's exact test and χ2 test. Non-inferiority analyses were performed using Wald's method with a delta of 10%, and superiority by Fisher's exact test.

Role of the funding source

An academic principal investigator (JLS), academic lead interventional investigator (RJ), and academic steering committee supervised the trial design and operations. A publications committee (principal investigator, lead interventional investigator, steering committee, and academic principal investigators of the sites that enrolled most patients) interpreted the results and wrote the report. The sponsor of the study was responsible for site management, data management, and safety reporting. The corresponding author had full access to all the data in this study and had final responsibility for the decision to submit for publication.

Results

Between February 2010 and February 2011, 18 sites (17 in the USA and one in France) consented and enrolled 144 patients, including 31 roll-in patients who received Solitaire and 113 patients who were randomly allocated to one of the two treatment groups (58 to Solitaire and 55 to Merci). Because the study results showed that the treatment effect for the primary effectiveness endpoint was not significantly different by site (p=0.3853, Breslow–Day test of homogeneity), the data across sites were pooled. The total number of subjects enrolled and the number of subjects enrolled by randomization assignment at each investigation site is presented in online supplementary table S1. Note that site number assignment for the study was at the sponsor's discretion, not in temporal order of activation nor with contiguous numbering. As shown in table 1, baseline demographic and clinical characteristics of the Solitaire roll-in, Solitaire randomized, and Merci randomized treatment groups were generally similar, including age and presenting stroke severity (NIHSS). Three group differences were noted. An increased prevalence of atrial fibrillation was seen in the Merci group compared with the combined Solitaire arms (roll-in and randomized). There was no difference in prevalence of atrial fibrillation in the roll-in Solitaire versus randomized Solitaire arms. Also, more patients in the roll-in Solitaire group received IV t-PA compared with the randomized Solitaire group. In addition, more patients in the randomized Solitaire group presented with pre-stroke mRS of 1 and fewer with mRS of 3–5 compared with those in the roll-in period.

Table 1

Univariate baseline characteristics of patients in the roll-in and randomized phases of the SWIFT trial

Primary trial endpoint results were attained with similar frequencies in the roll-in Solitaire patients and those who were randomized to the device after the roll-in period (table 2). Combining the Solitaire roll-in and randomized patients for comparison with the Merci group resulted in similar point estimates and lower p values than the randomized comparison alone. As shown in table 2, treatment with the Solitaire device in any arm resulted in an increase from 24% to 59% in the rates of successful recanalization without symptomatic ICH, as well as decreased use of rescue treatment.

Table 2

Trial technical efficacy endpoints

Similarly, there were no differences in these clinical outcomes in the roll-in phase versus randomized phase patients treated with the Solitaire device (table 3). Combining patients treated with the Solitaire device during the roll-in and randomized periods did not affect the point estimates for rates of final clinical outcomes compared with patients treated with the Merci device, and further lowered p values, indicating device differences. There was no significant difference between the rates of good neurological outcome (mRS ≤2 at 90 days, NIHSS improvement ≥10, or return to pre-stroke mRS) between the roll-in and randomized phase patients treated with the study device. As mentioned above, more patients with mRS=0 were enrolled in the roll-in phase compared with the randomized phase.

Table 3

Clinical efficacy endpoints

There was no difference in adverse events between the initial roll-in period patients and those in the randomized phase. There were no incidents of air embolism or vessel perforation in these two groups. There were slightly higher nominal rates of difficulty in device delivery and distal emboli that did not achieve statistical significance (table 4).

Table 4

Serious adverse events (SAEs)

As shown in figure 1, mortality over time was comparable for patients in the roll-in and randomized phases who received the Solitaire device. Combining the roll-in patients with the randomized patients further lowered the p value for reduction in mortality in the Kaplan–Meier analysis of Solitaire versus Merci device. Day 90 mRS values for the Solitaire groups and Merci group are shown in figure 2. Final mRS at 90 days in the combined Solitaire group were lower than those in the Merci treatment group (p<0.05, χ2 test).

Figure 1

Kaplan–Meier curves for patients in the roll-in and randomized phases of the SWIFT trial. Curves show time to the endpoint of mortality for patients enrolled in the roll-in phase, randomized phase (Merci and Solitaire arms) and for all Solitaire-treated patients (roll-in and randomized phases). The survival curves for all patients treated with Solitaire is significantly different from those treated with Merci (p=0.003, log-rank test). There is no significant difference between the survival curves of the patients treated with Solitaire in the roll-in versus randomized phases (p=0.86, log-rank test).

Figure 2

Ordinal 90-day Rankin outcomes for patients in the roll-in and randomized phases of the SWIFT trial. Modified Rankin outcomes are shown for all four groups of patients: randomized phase Merci treated, all Solitaire treated (roll-in and randomized phases), randomized phase Solitaire treated, and roll-in phase Solitaire treated. The final modified Rankin scale at 90 days in the combined Solitaire group was lower than for those in the Merci treatment group (p<0.05, χ2 test). There is no difference in Rankin outcomes between those treated with Solitaire in the roll-in versus randomized phases (p=0.25, χ2 test).

Discussion

In this study, we found that experienced neurointerventionalists using the Solitaire device for thrombectomy in AIS achieved high levels of safety and efficacy without prior experience of using the device in patients. Patients who received treatment with the device during the study roll-in period achieved equivalently high rates of core-lab assessed reperfusion with the study device alone (63%) compared with those treated with the device in the randomized phase (69%), during which time all sites had experience with using the device in clinical settings. Rates of adverse events were comparable. The final clinical outcome was also similar. Including the patients in the roll-in phase of the trial with those treated in the randomized phase strengthened the conclusions of the study, that reperfusion rates are greatly improved with the Solitaire device compared with Merci.

Our finding that patients treated in the roll-in phase, during which time US neurointerventionalists would have had no experience with the device, demonstrates the ease of use of the study stent retriever device. As 17 of 18 sites that ultimately randomized patients in SWIFT were US sites, this comprises most patients in the study. It should also be pointed out that as the Solitaire AB is not available in the USA, use of this device in ischemic stroke was the first exposure of US investigators to Solitaire. Recanalization rates were extremely high in this initial period and remained high in the randomized part of the study, suggesting that operators of the device were highly adept with it from their initial usage. Equally as important, the number of adverse events was very low and consistent over time. Single-center, retrospective studies on initial experiences with the Solitaire stent retriever for thrombectomy in stroke have found similar results. One smaller study with 20 patients reported reperfusion rates of nearly 90%, with procedure related complications of about 10%.15 Two other larger studies from France reported almost identical findings.16 ,17

Widespread dissemination of stent retriever therapy in clinical practice may be expected based on the recent positive results for neurothrombectomy. The pivotal trial demonstrating the benefit of endovascular therapy is primarily stent retriever-based, and contains inclusion criteria that more accurately mimic clinical practice, such as the requirement for intracranial occlusion on non-invasive imaging.1 Our findings in this analysis of roll-in patients in the SWIFT study suggest that diffusion of stent retriever therapy may lead rapidly to effectiveness in clinical practice, without a steep learning curve, by demonstrating the relative ease of use, safety, and efficacy of the Solitaire device.

This study has limitations. The 18 sites enrolling in the SWIFT study were high-volume stroke centers, and as such although the neurointerventionalists at the 17 US sites had no prior experience using the study device, all were highly experienced in thrombectomy approaches for AIS, as detailed previously in the ‘Methods’ section. Thus, our finding of safety and efficacy of the patients in the roll-in phase of the SWIFT study cannot be extrapolated to practitioners without prior experience in endovascular therapy for AIS. Further, it should be noted that the entire experience of the SWIFT trial may be considered an ‘early’ experience, and it is possible that the learning curve for stent-retriever usage in stroke has a continuing upward trajectory beyond the experience captured in this study. In addition, study site assessments of reperfusion allowed for the possibility of bias on the part of the interventionalists during the procedure. However, the final study assessment of reperfusion was performed by a blinded core laboratory protected from bias by removal of all angiographic images that might have identified the type of device used before adjudication.

We conclude that examination of patients treated with the Solitaire device during the roll-in period of the SWIFT study, which was the initial experience using the device in AIS for the participating neurointerventionalists, indicates equivalently high rates of recanalization, with equally low rates of adverse events as those found in the randomized phase. Clinical outcomes were also comparable in the two phases. Thrombectomy in AIS using the Solitaire stent retriever device can be performed safely and effectively when used by experienced neurointerventionalists without previous experience of the device.

Acknowledgments

The authors thank Jill Schafer for assistance with performing and independently verifying the statistical analysis in this manuscript.

References

View Abstract

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors SAS, JLS, and RJ made substantial contributions to the conception and design of the work as well as the drafting and revision of the work for important intellectual content and final approval of the version to be published. EIL, TGJ, BB, RGN, WC, RB, and OOZ participated in the design of the study, interpretation of the data, and gave final approval of the version to be published. SAS wrote the report, which was revised after review by all coauthors, all of whom provided critical review of the paper. All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The statistical analysis was performed by Jill Schafer.

  • Competing interests The University of California (The Regents) receive funding for JLS’s services as a scientific consultant for the trial design and conduct from Covidien/ev3, BrainsGate, CoAxia, Grifols/Talecris, Ferrer, Mitsubishi, Genervon, Benechill, Asubio, and Sygnis. JLS served as an investigator in the NIH FAST-MAG, MR RESCUE, ICES, CUFFS, CLEAR-ER, and IMS 3 multicenter clinical trials for which the UC Regents received payments based on clinical trial performance. JLS has also served as an unpaid site investigator in multicenter trials run by Covidien/ev3, Genervon, Lundbeck, and Mitsubishi for which the UC Regents received payments based on the clinical trial contracts for the number of participants enrolled. JLS and RJ are employees of the University of California, which holds a patent on retriever devices for stroke. The University of California Regents receive funding for RJ's services as a scientific consultant for the trial design and conduct from Covidien/ev3 and Chestnut Medical. EIL is a scientific consultant for Covidien/ev3, Codman and Shurtleff Inc, and TheraSyn Sensors Inc; and receives fees for carotid stent training from Covidien/ev3 and Abbott Vascular. TGJ has served as a scientific consultant to Covidien/ev3, CoAxia, Concentric Medical, and Micrus. RGN has served as a scientific consultant to Covidien/ev3, CoAxia, and Concentric Medical. WC and RB have served as scientific consultants to Covidien/ ev3. OOZ serves as a scientific consultant to Talecris Biotherapeutics, Stryker, Codman, and MicroVention.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement The data from this study are taken from the SWIFT trial. These data can be accessed if a request is sent to the publication committee of the SWIFT trial.

Linked Articles