Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Donegan, Sarah; Williamson, Paula; Gamble, Carrol; Tudur-Smith, Catrin (2010)
Publisher: Public Library of Science
Journal: PLoS ONE
Languages: English
Types: Article
Subjects: Q, R, Evidence-Based Healthcare/Clinical Decision-Making, Research Article, Mathematics/Statistics, Evidence-Based Healthcare/Statistical Methodologies and Health Informatics, wa_20_5, Science, Medicine
Background: The indirect comparison of two interventions can be valuable in many situations. However, the quality of an indirect comparison will depend on several factors including the chosen methodology and validity of underlying\ud assumptions. Published indirect comparisons are increasingly more common in the medical literature, but as yet, there are no published recommendations of how they should be reported. Our aim is to systematically review the quality of published indirect comparisons to add to existing empirical data suggesting that improvements can be made when reporting and applying indirect comparisons.\ud \ud Methodology/Findings: Reviews applying statistical methods to indirectly compare the clinical effectiveness of two\ud interventions using randomised controlled trials were eligible. We searched (1966–2008) Database of Abstracts and Reviews of Effects, The Cochrane library, and Medline. Full review publications were assessed for eligibility. Specific criteria to assess quality were developed and applied. Forty-three reviews were included. Adequate methodology was used to calculate the indirect comparison in 41 reviews. Nineteen reviews assessed the similarity assumption using sensitivity analysis, subgroup analysis, or meta-regression. Eleven reviews compared trial-level characteristics. Twenty-four reviews assessed statistical\ud homogeneity. Twelve reviews investigated causes of heterogeneity. Seventeen reviews included direct and indirect evidence for the same comparison; six reviews assessed consistency. One review combined both evidence types. Twentyfive reviews urged caution in interpretation of results, and 24 reviews indicated when results were from indirect evidence by stating this term with the result.\ud Conclusions: This review shows that the underlying assumptions are not routinely explored or reported when undertaking indirect comparisons. We recommend, therefore, that the quality of indirect comparisons should be improved, in particular, by assessing assumptions and reporting the assessment methods applied. We propose that the quality criteria applied in this article may provide a basis to help review authors carry out indirect comparisons and to aid appropriate interpretation.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • 1. Song F, Harvey I, Lilford R (2008) Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. Journal of Clinical Epidemiology 61(5): 455-463.
    • 2. Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, et al. (2005) Indirect comparisons of competing interventions. Health Technology Assessment 9(26): 1-134.
    • 3. Bucher HC, Guyatt GH, Griffith LE, Walter SD (1997) The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. Journal of Clinical Epidemiology 50(6): 683-91.
    • 4. Higgins J, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.0 [updated February 2008]. The Cochrane Collaboration. Available: www.cochrane-handbook.org.
    • 5. Altman DG, Bland JM (2003) Statistics Notes: Interaction revisited: the difference between two estimates. Bmj 326(7382): 219.
    • 6. Song F, Loke YK, Walsh T, Glenny A-M, Eastwood AJ, et al. (2009) Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. Bmj 338(apr03_1): b1147-.
    • 7. Cooper N, Sutton A, Morris D, Ades A, Welton N (2009) Addressing betweenstudy heterogeneity and inconsistency in mixed treatment comparisons: Application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation. Statistics in Medicine 28(14): 1861-1881.
    • 8. Song F, Altman DG, Glenny A-M, Deeks JJ (2003) Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ 326(7387): 472.
    • 9. Song F, Glenny AM, Altman DG (2000) Indirect comparison in evaluating relative efficacy illustrated by antimicrobial prophylaxis in colorectal surgery. Controlled Clinical Trials 21(5): 488-497.
    • 10. Edwards SJ, Clarke MJ, Wordsworth S, Borrill J (2009) Indirect comparisons of treatments based on systematic reviews of randomised controlled trials. International Journal of Clinical Practice 63(6): 841-854.
    • 11. Altman DG, Bland JM (2003) Statistics Notes: Interaction revisited: the difference between two estimates. BMJ 326: 219.
    • 12. Costa J, Espirito-Santo C, Borges A, Ferreira JJ, Coelho M, et al. (2005) Botulinum toxin type A therapy for cervical dystonia. Cochrane Database of Systematic Reviews (1): CD003633.
    • 13. Vestergaard P, Jorgensen NR, Mosekilde L, Schwarz P (2007) Effects of parathyroid hormone alone or in combination with antiresorptive therapy on bone mineral density and fracture risk-a meta-analysis. Osteoporosis International 18(1): 45-57.
    • 14. Sanchez-Ramos L, Kaunitz AM, Delke I (2002) Labor induction with 25 microg versus 50 microg intravaginal misoprostol: a systematic review. Obstetrics & Gynecology 99(1): 145-51.
    • 15. Indolfi C, Pavia M, Angelillo IF (2005) Drug-eluting stents versus bare metal stents in percutaneous coronary interventions (a meta-analysis). American Journal of Cardiology 95(10): 1146-1152.
    • 16. Biondi-Zoccai GG, Agostoni P, Abbate A, Testa L, Burzotta F, et al. (2005) Adjusted indirect comparison of intracoronary drug-eluting stents: evidence from a metaanalysis of randomized bare-metal-stent-controlled trials. International Journal of Cardiology 100(1): 119-123.
    • 17. Abou-Setta AM (2007) What is the best site for embryo deposition? A systematic review and meta-analysis using direct and adjusted indirect comparisons. Reproductive Biomedicine Online 14(5): 611-9.
    • 18. Berner MM, Kriston L, Harms A (2006) Efficacy of PDE-5-inhibitors for erectile dysfunction. A comparative meta-analysis of fixed-dose regimen randomized controlled trials administering the International Index of Erectile Function in broad-spectrum populations. International Journal of Impotence Research 18(3): 229-35.
    • 19. Boonen S, Lips P, Bouillon R, Bischoff-Ferrari HA, Vanderschueren D, et al. (2007) Need for additional calcium to reduce the risk of hip fracture with vitamin d supplementation: evidence from a comparative metaanalysis of randomized controlled trials. Journal of Clinical Endocrinology & Metabolism 92(4): 1415-23.
    • 20. Brown TJ, Hooper L, Elliott RA, Payne K, Webb R, et al. (2006) A comparison of the cost-effectiveness of five strategies for the prevention of non-steroidal antiinflammatory drug-induced gastrointestinal toxicity: a systematic review with economic modelling. Health Technology Assessment 10(38): iii-iv, xi-xiii, 1-183.
    • 21. Buscemi N, Vandermeer B, Friesen C, Bialy L, Tubman M, et al. (2007) The efficacy and safety of drug treatments for chronic insomnia in adults: a metaanalysis of RCTs. Journal of General Internal Medicine 22(9): 1335-50.
    • 22. Chou R, Fu R, Huffman LH, Korthuis PT (2006) Initial highly-active antiretroviral therapy with a protease inhibitor versus a non-nucleoside reverse transcriptase inhibitor: discrepancies between direct and indirect meta-analyses. Lancet 368(9546): 1503-15.
    • 23. Clark W, Jobanputra P, Barton P, Burls A (2004) The clinical and costeffectiveness of anakinra for the treatment of rheumatoid arthritis in adults: a systematic review and economic analysis. Health Technology Assessment 8(18): iii-iv, ix-x, 1-105.
    • 24. Collins R, Fenwick E, Trowman R, Perard R, Norman G, et al. (2007) A systematic review and economic model of the clinical effectiveness and costeffectiveness of docetaxel in combination with prednisone or prednisolone for the treatment of hormone-refractory metastatic prostate cancer. Health Technology Assessment 11(2): iii-iv, xv-xviii, 1-179.
    • 25. Coomarasamy A, Knox EM, Gee H, Song F, Khan KS (2003) Effectiveness of nifedipine versus atosiban for tocolysis in preterm labour: a meta-analysis with an indirect comparison of randomised trials. BJOG: An International Journal of Obstetrics & Gynaecology 110(12): 1045-9.
    • 26. Dolovich LR, Ginsberg JS, Douketis JD, Holbrook AM, Cheah G (2000) A meta-analysis comparing low-molecular-weight heparins with unfractionated heparin in the treatment of venous thromboembolism: examining some unanswered questions regarding location of treatment, product type, and dosing frequency. Archives of Internal Medicine 160(2): 181-8.
    • 27. Eckert L, Falissard B (2006) Using meta-regression in performing indirectcomparisons: comparing escitalopram with venlafaxine XR. Current Medical Research and Opinion 22(11): 2313-2321.
    • 28. Einarson TR, Kulin NA, Tingey D, Iskedjian M (2000) Meta-analysis of the effect of latanoprost and brimonidine on intraocular pressure in the treatment of glaucoma. Clinical Therapeutics 22(12): 1502-15.
    • 29. Gisbert JP, Gonzalez L, Calvet X, Roque M, Gabriel R, et al. (2000) Helicobacter pylori eradication: proton pump inhibitor versus ranitidine bismuth citrate plus two antibiotics for 1 week. A meta-analysis of efficacy. Alimentary Pharmacology and Therapeutics 14(9): 1141-1150.
    • 30. Habib AS, El-Moalem HE, Gan TJ (2004) The efficacy of the 5-HT3 receptor antagonists combined with droperidol for PONV prophylaxis is similar to their combination with dexamethasone. A meta-analysis of randomized controlled trials. Canadian Journal of Anaesthesia 51(4): 311-9.
    • 31. Hind D, Calvert N, McWilliams R, Davidson A, Paisley S, et al. (2003) Ultrasonic locating devices for central venous cannulation: meta-analysis. BMJ 327(7411): 361.
    • 32. Hochberg MC, Tracy JK, Hawkins-Holt M, Flores RH (2003) Comparison of the efficacy of the tumour necrosis factor alpha blocking agents adalimumab, etanercept, and infliximab when added to methotrexate in patients with active rheumatoid arthritis. Annals of the Rheumatic Diseases 62 Suppl 2: ii13-6.
    • 33. Jones L, Griffin S, Palmer S, Main C, Orton V, et al. (2004) Clinical effectiveness and cost-effectiveness of clopidogrel and modified-release dipyridamole in the secondary prevention of occlusive vascular events: a systematic review and economic evaluation. Health Technology Assessment 8(38): iii-iv, 1-196.
    • 34. Li Wan Po A, Zhang WY (1997) Systematic overview of co-proxamol to assess analgesic effects of addition of dextropropoxyphene to paracetamol. BMJ 315: 1565-1571.
    • 35. Lim E, Ali Z, Ali A, Routledge T, Edmonds L, et al. (2003) Indirect comparison meta-analysis of aspirin therapy after coronary surgery. BMJ 327: 1309-1311.
    • 36. Lowenthal A, Buyse M (1994) Secondary prevention of stroke: does dipyridamole add to aspirin? Acta Neurologica Belgica 94(1): 24-34.
    • 37. Mason L, Moore RA, Edwards JE, Derry S, McQuay HJ (2004) Topical NSAIDs for acute pain: a meta-analysis. BMC Family Practice 5: 10.
    • 38. McAlister FA, Stewart S, Ferrua S, McMurray JJ (2004) Multidisciplinary strategies for the management of heart failure patients at high risk for admission: a systematic review of randomized trials. Journal of the American College of Cardiology 44(4): 810-819.
    • 39. McLeod C, Bagust A, Boland A, Dagenais P, Dickson R, et al. (2007) Adalimumab, etanercept and infliximab for the treatment of ankylosing spondylitis: a systematic review and economic evaluation. Health Technology Assessment 11(28): iii-iv, 1-158.
    • 40. Mudge MA, Davey PJ, Coleman KA, Montgomery W, Croker VS, et al. (2005) A comparison of olanzapine versus risperidone for the treatment of schizophrenia: a meta-analysis of randomised clinical trials. International Journal of Psychiatry in Clinical Practice 9(1): 3-15.
    • 41. Norris SL, Carson S, Roberts C (2007) Comparative effectiveness of pioglitazone and rosiglitazone in type 2 diabetes, prediabetes, and the metabolic syndrome: a meta-analysis. Current Diabetes Reviews 3(2): 127-40.
    • 42. Otoul C, Arrigo C, van Rijckevorsel K, French JA (2005) Meta-analysis and indirect comparisons of levetiracetam with other second-generation antiepileptic drugs in partial epilepsy. Clinical Neuropharmacology 28(2): 72-8.
    • 43. Otto MW, Tuby KS, Gould RA, McLean RY, Pollack MH (2001) An effectsize analysis of the relative efficacy and tolerability of serotonin selective reuptake inhibitors for panic disorder. American Journal of Psychiatry 158(12): 1989-92.
    • 44. Panidou ET, Trikalinos TA, Ioannidis JP (2004) Limited benefit of antiretroviral resistance testing in treatment-experienced patients: a meta-analysis. Aids 18(16): 2153-61.
    • 45. Pignon JPAR, Ihde DC, Johnson DH, Perry MC, Souhami RL, et al. (1992) A meta-analysis of thoracic radiotherapy for small-cell lung cancer. N Engl J Med 327(23): 1618-24.
    • 46. Richy F, Schacht E, Bruyere O, Ethgen O, Gourlay M, et al. (2005) Vitamin D analogs versus native vitamin D in preventing bone loss and osteoporosis-related fractures: a comparative meta-analysis. Calcified Tissue International 76(3): 176-86.
    • 47. Rocha E, Martinez-Gonzalez MA, Montes R, Panizo C (2000) Do the low molecular weight heparins improve efficacy and safety of the treatment of deep venous thrombosis: a meta-analysis. Haematologica 85(9): 935-942.
    • 48. Sauriol L, Laporta M, Edwardes MD, Deslandes M, Ricard N, et al. (2001) Meta-analysis comparing newer antipsychotic drugs for the treatment of schizophrenia: evaluating the indirect approach. Clinical Therapeutics 23(6): 942-56.
    • 49. Stettler C, Allemann S, Egger M, Windecker S, Meier B, et al. (2006) Efficacy of drug eluting stents in patients with and without diabetes mellitus: indirect comparison of controlled trials. Heart 92(5): 650-657.
    • 50. Vis PM, van Baardewijk M, Einarson TR (2005) Duloxetine and venlafaxineXR in the treatment of major depressive disorder: a meta-analysis of randomized clinical trials. Annals of Pharmacotherapy 39(11): 1798-807.
    • 51. Wu P, Wilson K, Dimoulas P, Mills EJ (2006) Effectiveness of smoking cessation therapies: a systematic review and meta-analysis. BMC Public Health 6: 300.
    • 52. Yazdanpanah Y, Sissoko D, Egger M, Mouton Y, Zwahlen M, et al. (2004) Clinical efficacy of antiretroviral combination therapy based on protease inhibitors or non-nucleoside analogue reverse transcriptase inhibitors: indirect comparison of controlled trials. BMJ 328: 249.
    • 53. Zhou Z, Rahme E, Pilote L (2006) Are statins created equal: evidence from randomized trials of pravastatin, simvastatin, and atorvastatin for cardiovascular disease prevention. American Heart Journal 151(2): 273-281.
    • 54. Buttner M, Walder B, von Elm E, Tramer MR (2004) Is low-dose haloperidol a useful antiemetic: a meta-analysis of published and unpublished randomized trials. Anesthesiology 101(6): 1454-1463.
    • 55. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, et al. (1999) Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. The Lancet 354(9193): 1896-1900.
    • 56. Thompson SGH, Julian PT (2002) How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 21(11): 1559-1573.
    • 57. Salanti G, Marinho V, Higgins JPT (2009) A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. Journal of Clinical Epidemiology In Press.
    • 58. Mulrow CD (1994) Systematic Reviews: Rationale for systematic reviews. BMJ 309(6954): 597-599.
  • Inferred research data

    The results below are discovered through our pilot algorithms. Let us know how we are doing!

    Title Trust
  • No similar publications.

Share - Bookmark

Cite this article