Article Text

PDF

Systematic review of immunomodulatory drugs for the treatment of people with multiple sclerosis: Is there good quality evidence on effectiveness and cost?
  1. J Bryant,
  2. A Clegg,
  3. R Milne
  1. Wessex Institute for Health Research and Development, University of Southampton, Biomedical Sciences Building (Mailpoint 728), Bassett Crescent East, Southampton SO16 7PX, UK
  1. Ms J Bryantjsb1{at}soton.ac.uk

Abstract

OBJECTIVE To review the clinical effectiveness and costs of a range of disease modifying drugs in multiple sclerosis. Drugs included are azathioprine, cladribine, cyclophosphamide, intravenous immunoglobulin, methotrexate, and mitoxantrone.

METHODS Electronic databases and bibliographies of related papers were searched for randomised controlled trials (RCTs) and systematic reviews, and experts and pharmaceutical companies were contacted for further information. Inclusion and quality criteria were assessed, data extraction undertaken by one reviewer and checked by a second reviewer, with discrepancies being resolved through discussion. Costs were obtained and cost-effectiveness papers sought.

RESULTS Seventeen studies met the inclusion criteria for the review. Evidence for the clinical effectiveness of the drugs showed some reductions in relapse rates and/or progression to disability for people with MS, although benefits may be lessened by wide ranging side effects. Annual drug costs/patient are estimated to range from £60 to £10 200. No cost effectiveness studies were found.

CONCLUSION Evidence for the effectiveness of these drugs in multiple sclerosis is problematic because there are few good quality trials for each drug. Trials often have methodological limitations and use different treatment regimes, patient groups, and outcome measures. Well conducted trials using outcome measures with clinical significance for groups of patients with different types of multiple sclerosis and long term follow up are needed if the evidence base of treatment for the disease is to be improved.

  • multiple sclerosis
  • immunomodulatory drugs
  • effectiveness

Statistics from Altmetric.com

Debate over the prescribing of β-interferons in the treatment of multiple sclerosis continues, despite good evidence showing some benefit but at high cost. In England and Wales, the National Institute for Clinical Excellence (NICE) has been established to appraise the evidence on the clinical and cost effectiveness of health technologies and provide guidance to the NHS. At the time of writing, it is considering β-interferon and glatiramer in the treatment of multiple sclerosis. Excluded from the NICE appraisal are several other disease modifying drugs that may be used in the treatment of this disease. A comprehensive appraisal of disease modifying drugs for the treatment of multiple sclerosis should consider all competing alternatives.

This study is, to the best of our knowledge, the first systematic review of a range of disease modifying drugs for multiple sclerosis. We were commissioned by the NHS Research and Development Health Technology Assessment (HTA) programme to undertake a rapid systematic review to appraise the evidence on the effectiveness and cost of azathioprine, cladribine, cyclophosphamide, intravenous immunoglobulin, methotrexate, and mitoxantrone in reducing relapse rate and in limiting progression among people with multiple sclerosis. This paper summarises and takes forward analyses published in full by the HTA programme.1

Methods

Electronic databases (Medline, PubMed, Embase, Cochrane Systematic Reviews Database, Cochrane Controlled Trials Register, NHS CRD DARE and NHS EED, and the National Research Register) were searched for the period January 1980 to July 1999 (search strategies available on request). Searches were restricted to English language studies. Additional studies were identified through searching bibliographies of related publications and through contact with experts.

We included studies if they were systematic reviews of randomised controlled trials (RCTs), RCTs or cost utility studies that compared an immunomodulatory drug (azathioprine, cladribine, cyclophosphamide, intravenous immunoglobulin, methotrexate, and mitoxantrone) with placebo or another immunomodulatory drug; included people diagnosed with multiple sclerosis who met the criteria for treatment with immunomodulatory drugs; and used patient based outcomes such as relapses, disease progression, and side effects. The list of drugs included in the review was derived from a provisional list from the HTA programme modified after consultation with clinical experts and patient groups on the review advisory panel. Cyclosporine, an immunosuppressant now rarely used, was not included in the review because of its unacceptable adverse effects, notably nephrotoxicity and hypertension, which outweigh any modest clinical benefit and affect compliance. Outcome measures, either relapses or disease progression, or both, are the primary and secondary outcomes as reported in the literature, regardless of whether strictly appropriate for the type of multiple sclerosis under consideration. Side effects are listed as reported in the studies.

Included studies were assessed using standard critical appraisal criteria, with the quality of systematic reviews scored using criteria developed by NHS CRD2 and RCTs using the scale developed by Jadad et al.3 Decisions on inclusion criteria, quality criteria, and data extraction were made by one reviewer. These decisions were checked by a second reviewer, with any disagreements resolved through discussion.

Studies were combined through narrative synthesis, as differences in the type and definition of outcomes, patient characteristics (type of disease pattern, duration of disease, and duration of follow up) and drug dose and administration prevented any meta-analysis. Numbers needed to treat (NNTs) with 95% confidence intervals (95% CIs) were calculated where figures were presented in an appropriate form. For relapse outcomes, we calculated NNTs to prevent relapse at 1 year and at the longest follow up period; for disease progression, we calculated NNTs to prevent worsening by one EDSS point at 1 year and at longest follow up period available. The NNTs were included even when the effectiveness results did not reach conventional significance.

Cost data were presented as annual drug costs/patient, calculated using individual drug costs (British National Formulary 1999 and Southampton Drug Information Unit) and dosages stated in trials, British National Formulary, or from expert opinion.

Results

QUANTITY AND QUALITY OF STUDIES

Seventeen studies, either systematic reviews or RCTs, met the inclusion criteria. No studies of cost utility were found. Table 1presents study details and quality scores for the different immunomodulatory drugs. The quantity and quality of studies varied between the different immunomodulatory drugs. Evidence on the effectiveness of azathioprine came from a good quality systematic review4 and two subsequent RCTs: one good quality placebo controlled double blind trial5 and one poor open label RCT.6 Of the five RCTs assessing cyclophosphamide,7-11 only one was a good quality double blind crossover RCT.8 The remaining four were of poor quality, either lacking descriptions of randomisation or details of withdrawals, and none were double blinded. Blinding is often difficult due to the inevitable adverse effects, such as alopecia. By contrast, the three RCTs12-14 examining intravenous immunoglobulin were of good or fairly good quality. For both cladribine15 16 and mitoxantrone17 18 there were two fairly good RCTs, and for methotrexate there was one good quality19 and one poor quality RCT.20

Table 1

Details of studies of disease modifying drugs in multiple sclerosis

EVIDENCE FOR THE EFFECTIVENESS ON RELAPSE RATE (TABLE2)

Azathioprine

Two studies, the systematic review (score 4/6)4 and the RCT (score 4/5),5 showed significantly lower relapse rates among patients with relapsing-remitting, primary progressive, or secondary relapsing progressive multiple sclerosis receiving azathioprine than patients receiving placebo, after 3 years of treatment. Odds of freedom from relapse at 3 years and relative risk of relapse were reported. The NNTs to prevent relapse at 1 year were calculated as 10 and 7 (95%CI 3-infinity) respectively. The third study (score 2/5)6 did not report on relapse rate.

Table 2

Summary of evidence of effectiveness on relapse rate of disease modifying drugs in multiple sclerosis

Cladribine

One study (score 3/5)16 considered patients with relapsing-remitting disease and reported the effects of cladribine on relapse rate. Comparison of the combined measure of frequency and severity of relapses using Mantel's extension of the Mantel-Haenzel procedure showed a reduction in the cladribine group compared with placebo in patients with relapsing-remitting disease, but there were no significant differences between treatment groups in relapse rate. It was not possible to calculate NNTs from the data supplied.

Cyclophosphamide

The one study of cyclophosphamide scoring 4/58reported on the mean number of relapses in patients with relapsing-remitting disease. The cyclophosphamide group showed a decrease in the mean number of relapses compared with placebo but results did not achieve significance. The NNT was calculated from the data as 4 (95%CI 2-infinity).

Intravenous immunoglobulin

In the two studies of intravenous immunoglobulin scoring 5/512 14 in patients with relapsing-remitting multiple sclerosis, relapse rate (reported as mean annual relapse rate and yearly exacerbation rate) was significantly reduced in the intravenous immunoglobulin group compared with placebo. The relative risk of relapse was estimated from these studies at 0.79 and 0.72, suggesting that there may be some benefit of treatment with intravenous immunoglobulin in relapsing-remitting multiple sclerosis. The NNTs were calculated as 3 (95%CI 2–10) at 1 year and 6 (95%CI 4–61) at 2 years respectively. The third trial (score 3/5)13 reported an increased number of patients with no relapses in the intravenous group, with NNT calculated as 5 (95%CI 3-infinity).

Methotrexate

One study of methotrexate (score 2/5)20 reported the number of people experiencing exacerbations, in a small subset of patients with relapsing-remitting disease, and showed no overall difference in outcome between treatment groups when considering all types of multiple sclerosis. The NNT was calculated as 23 (95%CI 4-infinity) at 18 months.

Mitoxantrone

Both trials of mitoxantrone reported significant reductions in relapses and exacerbations among patients receiving mitoxantrone rather than placebo or other treatment. In one study (score 4/5)17 patients with relapsing-remitting disease receiving mitoxantrone had fewer relapses than patients on placebo during 2 years of treatment. The other study (score 3/5)18 found significantly reduced mean annual relapse rates/patient for mitoxantrone and methylprednisolone over 6 months of treatment. The NNTs were calculated as 3 (95%CI 2–6) at 1 year and 3 (95%CI 2–37) at 6 months respectively.

EVIDENCE FOR DELAY IN DISEASE PROGRESSION (TABLE3)

Azathioprine

The systematic review4 and RCT (score 4/5)5 examined azathioprine against placebo for relapsing-remitting, relapsing-progressive and progressive multiple sclerosis, and results suggested that there was slower progression in disease severity among patients receiving azathioprine compared with controls. Although not significant, these differences increased over time, up to 3 years. The NNT to prevent worsening on EDSS could not be calculated from the systematic review as data were not available. Therefore the NNT was calculated from the one study that reported this outcome as –66 (95%CI −infinity to −3) at 1 year.5This represents a small and non-significant worsening in outcome on azathiprine: a result in the opposite direction to the result in column 2 of table 3, which was based on a non-significant reduction in the mean changes in EDSS from baseline compared with placebo. Patients with relapsing-progressive multiple sclerosis treated with cyclosporine had a delay in progression compared with azathioprine although results were not significantly different.6 No patient data were reported for calculation of NNT.

Table 3

Summary of evidence of effectiveness on disease progression of disease modifying drugs in MS

Cladribine

One crossover study (score 3/5)15 reported highly significant treatment effects of cladribine on disease progression in chronic progressive multiple sclerosis at both 1 year and 2 years compared with placebo. The NNT was calculated from the data as 4 (95%CI 3–19). The other study (score 3/5),16 showed no delay in progression, but this can be expected as only patients with relapsing-remitting multiple sclerosis were considered and disability accrues more slowly in such patients and therefore progression may not be a good outcome measure for this group. No patient data were reported to allow calculation of NNT.

Cyclophosphamide

One study (score 1/5)7 in progressive multiple sclerosis suggested that cyclophosphamide combined with adrenocorticotropic hormone may be of some benefit, with NNT to prevent worsening on EDSS at 1 year calculated from the data as 2 (95%CI 2–4). Another trial (score 1/5)11 suggested that boosters of cyclophosphamide may slow progression, with NNT calculated as 9 (95%CI 5-infinity). The other studies (scores 4/5, 2/5, 2/5)8-10 did not confirm a delay in progression; this was to be expected in one trial8 which only included patients with relapsing-remitting multiple sclerosis.

Intravenous immunoglobulin

One trial (score 5/5)14 in patients with relapsing-remitting disease, suggested that there was some improvement in clinical disability in the intravenous immunoglobulin group compared with further deterioration in the placebo group after 2 years of treatment. The NNT was calculated as 14 (95%CI 5-infinity) at 2 years. The other two studies (score 5/5, 3/5)12 13 did not produce significant results, although this was not unexpected in one study12 as only patients with relapsing-remitting multiple sclerosis were included. There were no patient data from which to calculate NNTs.

Methotrexate

Results from the study of methotrexate in chronic progressive multiple sclerosis (score 4/5)19 suggested a treatment effect when using a composite outcome measure of treatment failure only. The NNT was calculated as 3 (95%CI 2–7) for the composite score and 5 (95%CI 3–44) for EDSS alone. The other study (score 2/5)20 showed no overall difference in outcome between the treatment groups when considering all types of multiple sclerosis.

Mitoxantrone

Both trials of mitoxantrone reported significant delays in disability progression. The trial with patients with relapsing-remitting multiple sclerosis (score 4/5)17showed that fewer patients treated with mitoxantrone progressed one point on the EDSS compared with patients on placebo. The NNT was calculated as 6 (95%CI 3-infinity). The other study (score 3/5)18 considered both patients with relapsing-remitting multiple sclerosis and those with secondary progressive disease treated with mitoxantrone plus methylprednisolone, and showed a greater improvement in mean EDSS compared with patients receiving methylprednisolone alone. The NNT was calculated as 5 (95%CI 3–85) at 6 months.

SIDE EFFECTS

A range of adverse effects was reported for these six immunomodulatory drugs for multiple sclerosis, some of which were transient and mild, others more severe. Azathioprine may cause gastrointestinal side effects, with up to 11% of patients reported in one study5 having intolerable vomiting, which may affect compliance. A wide range of side effects was reported in all studies of cyclophosphamide, most commonly alopecia, vomiting, nausea, amenorrhoea, and urticaria and this may not be well tolerated. For intravenous immunoglobulin, mild headache may occur transiently within the first 24 hours of infusion. Mitoxantrone is generally well tolerated but may cause nausea, amenorrhoea, and alopecia. Methotrexate is reported as being tolerated reasonably well, but side effects include nausea and alopecia. Cladribine is generally well tolerated.

COSTS OF MULTIPLE SCLEROSIS DRUGS

Annual drug costs (table 4) ranged widely from £60/year for treatment with methotrexate to £10 200 for intravenous immunoglobulin. These costs do not include administration of the drug, any other drugs prescribed with an immunomodulatory drug, or any costs associated with monitoring. It is not possible to quantify potential savings to the health care and welfare sectors due to reduced admission to hospital due to relapse, reduced disability, and maintenance of employment by the patient and carer.

Table 4

Annual drug costs/patient

Discussion and conclusions

Our rapid and systematic review summarises the quantity and quality of the evidence on six immunomodulatory drugs for the treatment of people with multiple sclerosis. We found that the 17 studies identified for inclusion in the review were of variable quality. Although there were good quality studies, all too often these were of small size and/or short duration. As a consequence, it is not known how long any of the potential benefits of these drugs may last and whether if maintained they accumulate over time. In those studies affected by methodological limitations, the most important were inadequate blinding to treatment allocation, poor description of withdrawals and drop outs, and incomplete reporting of results and contextual information. Although some limitations are difficult to avoid, they make interpretation of evidence difficult and provide the opportunity for bias. In addition, comparisons were restricted by the lack of consistency in treatment regimes, patient groups, and outcome measures used. Change in terminology over time has also made interpretation difficult, with the term chronic progressive multiple sclerosis now commonly divided into primary and secondary progressive. Also, it should be noted that the widely recognised quality assessment method used here may reflect how well a study has been reported rather than the actual methodological quality of the study.21

Trials did not always report the most appropriate outcome measure for the patient group recruited to the study—for example, disability progression is reported for patients with relapsing-remitting multiple sclerosis although disease progression may accrue more slowly in this group. However, severity of relapses may be measured by change in disability. Some studies recruited patients with relapsing and progressive forms of disease but did not distinguish patient groups in results. Side effects are not well measured or reported in the studies, but need to be considered in terms of individual patients and general compliance.

Although these drugs have been shown to have some beneficial effect on relapse rates or disease progression in different groups of patients, these are limited and their benefit may be lessened by the side effects of treatment. Azathioprine may reduce the relapse rate in patients with relapsing-remitting, relapsing-progressive, and progressive multiple sclerosis, but unpleasant side effects are common and some patients are unable to tolerate them. Cladribine may be effective in delaying disease progression in progressive multiple sclerosis, but seems to have little benefit in relapsing-remitting multiple sclerosis. Cyclophosphamide, when combined with adrenocorticotropic hormone or when used as a booster, may slow progression but is associated with a wide range of side effects. Intravenous immunoglobulin seems to reduce relapse rates among patients with relapsing-remitting multiple sclerosis, but also has a wide range of side effects. Methotrexate may have a beneficial effect on patients with progressive disease, although this is only evident through a composite measure of treatment failure. Mitoxantrone may benefit patients with relapsing-remitting multiple sclerosis through delayed progression and reduce relapse rates, although side effects are reported.

The main strength of this rapid systematic review is that it is comprehensive for a wide range of disease modifying drugs for multiple sclerosis, and methodologically sound, applying consistent methods of critical appraisal and presentation. The review was guided by the principles for undertaking a systematic review2 and followed a research protocol which was commented on by an advisory group. The advisory group, comprising representation from a patient group, academic and clinical neurology, and health authority advisors, informed the review from its initiation through to completion, offering invaluable advice at all stages.

The systematic review focused on patient based outcome measures, such as disease progression, relapses, and side effects. Studies using non-patient outcomes only, specifically the use of MRI, were excluded from the review. The omission of MRI may be regarded as weakening the strength of the review. However, uncertainty remains about the interpretation and clinical significance of MRI results in multiple sclerosis.22 As such, it was decided to exclude results of MRI or other non-patient outcomes from the outset and this restriction is unlikely to have introduced any bias into the review.

Another potential opportunity for bias was the lack of unpublished studies and the restriction of the research to English language studies only. Although companies manufacturing the drugs and experts in the topic area were contacted, no additional unpublished studies were obtained.

Some of the drugs considered in this review are expensive. That of course does not mean they should not be prescribed: what will matter to those who formulate clinical policy, whether at the hospital or national level, is the balance of benefits, harms, acceptability to patients, and costs. This will require a full economic evaluation, probably in the form of a cost-effectiveness or cost-utility study. A recent systematic review of the cost-utility of β-interferon in multiple sclerosis found four studies but concluded that none of them provided a full comparison of relevant healthcare strategies.24 Further economic evaluations of a wider range of possible interventions, such as improved supportive care, were needed so that scarce resources could be used effectively.

Access to good quality evidence on the clinical and cost effectiveness of disease modifying drugs for multiple sclerosis is restricted by concerns over the methodological rigour of studies and the variations between treatment regimes, patients groups, and outcome measures. Current evidence suggests that disease modifying drugs provide some limited benefit to people with multiple sclerosis, but with a wide range of side effects. Further long term RCTs using clinically significant outcome measures for different groups of people with multiple sclerosis, alongside well conducted comparative economic evaluations, are required.

Acknowledgments

This review was funded by the NHS R and D Health Technology Assessment Programmes. The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the NHS Executives.

References

View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.