Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-23T09:00:22.387Z Has data issue: false hasContentIssue false

Making Sense of Data Analytic Techniques used in a Cochrane Systematic Review

Published online by Cambridge University Press:  15 January 2018

Paul Gertler*
Affiliation:
The John Walsh Centre for Rehabilitation Research, Northern Clinical School, The University of Sydney, Australia
Ian D. Cameron
Affiliation:
The John Walsh Centre for Rehabilitation Research, Northern Clinical School, The University of Sydney, Australia
*
Address for correspondence: Paul Gertler, John Walsh Centre for Rehabilitation Research, The University of Sydney, Kolling Institute of Medical Research, Royal North Shore Hospital, St Leonards NSW, 2065Australia. E-mail: [email protected]
Get access

Abstract

Systematic reviews have developed over the past 40 years as a method for integrating findings from the available studies relating to clinical problems and interventions into one publication. Systematic reviews employ a variety of data analytic techniques including meta-analysis, which combines treatment effects across disparate studies in order to produce a truer estimate of treatment effect. The Cochrane Collaboration was established in order to facilitate access to high-quality evidence and specifies stringent guidelines for the production of systematic reviews. A Cochrane Systematic Review (CSR) includes consideration of the risk-of-bias of the selected studies in reaching conclusions. A recent CSR is used as an example to demonstrate the process of conducting a CSR, the data analytic methods employed and the assumptions made when employing these methods. There is a discussion of issues the reader will need to be aware of when considering the findings of a CSR and how this might differ from other systematic reviews including some consideration of how CSRs apply to the brain impairment literature.

Type
Articles
Copyright
Copyright © Australasian Society for the Study of Brain Impairment 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alderfer, B. S., Arciniegas, D. B., & Silver, J. M. (2005). Treatment of depression following traumatic brain injury. The Journal of Head Trauma Rehabilitation, 20 (6), 544562. doi: 00001199-200511000-00006 [pii].CrossRefGoogle ScholarPubMed
Anker, A. E., Reinhart, A. M., & Feeley, T. H. (2010). Meta-analysis of meta-analyses in communication: Comparing fixed effects and random effects analysis models. Communication Quarterly, 58 (3), 257278. doi:10.1080/01463373.2010.503154 Google Scholar
Cicerone, K. D., Dahlberg, C., Kalmar, K., Langenbahn, D. M., Malec, J. F., Bergquist, T. F., . . . Morse, P. A. (2000). Evidence-based cognitive rehabilitation: Recommendations for clinical practice. Archives of Physical and Medicine Rehabilitation, 81 (12), 15961615. doi:10.1053/apmr.2000.19240 CrossRefGoogle ScholarPubMed
Cicerone, K. D., Dahlberg, C., Malec, J. F., Langenbahn, D. M., Felicetti, T., Kneipp, S., . . . Catanese, J. (2005). Evidence-based cognitive rehabilitation: Updated review of the literature from 1998 through 2002. Archives of Physical and Medicine Rehabilitation, 86 (8), 16811692. doi:10.1016/j.apmr.2005.03.024 Google Scholar
Cicerone, K. D., Langenbahn, D. M., Braden, C., Malec, J. F., Kalmar, K., Fraas, M., . . . Ashman, T. (2011). Evidence-based cognitive rehabilitation: Updated review of the literature from 2003 through 2008. Archives of Physical and Medicine Rehabilitation, 92 (4), 519530. doi:10.1016/j.apmr.2010.11.015 Google Scholar
Fann, J. R., Hart, T., & Schomer, K. G. (2009). Treatment for depression after traumatic brain injury: A systematic review. Journal of Neurotrauma, 26 (12), 23832402. doi:10.1089/neu.2009.1091 Google Scholar
Gertler, P., Tate, R. L., & Cameron, I. D. (2015). Non-pharmacological interventions for depression in adults and children with traumatic brain injury. Cochrane Database of Systematic Reviews, (12), CD009871. doi: 10.1002/14651858.CD009871.pub2 Google ScholarPubMed
Glass, G. V. (2015). Meta-analysis at middle age: A personal history. Research Synthesis Methods, 6 (3), 221231. doi:10.1002/jrsm.1133 CrossRefGoogle ScholarPubMed
Hawkes, N. (2014). Lifetime achievement award 2014: Sir Iain Chalmers. BMJ, 348, g2921.CrossRefGoogle ScholarPubMed
Hayes, S. (2017). ACT Randomized Controlled Trials since 1986. Retrieved from https://contextualscience.org/ACT_Randomized_Controlled_Trials Google Scholar
Higgins, J., & Green, S. (2011). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. Available from www.cochrane-handbook.org: The Cochrane Collaboration.Google Scholar
Hoffman, J. M., Bell, K. R., Powell, J. M., Behr, J., Dunn, E. C., Dikmen, S., & Bombardier, C. H. (2010). A randomized controlled trial of exercise to improve mood after traumatic brain injury. PM R, 2 (10), 911919. doi: S1934-1482(10)00509-5 [pii] 10.1016/j.pmrj.2010.06.008 CrossRefGoogle ScholarPubMed
Lane-Brown, A., & Tate, R. (2009). Interventions for apathy after traumatic brain injury. Cochrane Database of Systematic Reviews, (2), (CD006341). doi: http://doi.org/10.1002/14651858.CD006341.pub2 Google Scholar
Lockwood, C., Sfetcu, R., & Oh, E. G. (2011). Synthesizing Quantitative Evidence. Lippincott Williams & Wilkins.Google Scholar
McDonald, S., Tate, R., Togher, L., Bornhofen, C., Long, E., Gertler, P., & Bowen, R. (2008). Social skills treatment for people with severe, chronic acquired brain injuries: A multicenter trial. Archives of Physical and Medicine Rehabilitation, 89 (9), 16481659. doi: S0003-9993(08)00431-0 [pii] CrossRefGoogle ScholarPubMed
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., . . . Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, c869.Google Scholar
Rohling, M. L., Faust, M. E., Beverly, B., & Demakis, G. (2009). Effectiveness of cognitive rehabilitation following acquired brain injury: A meta-analytic re-examination of Cicerone et al.’s (2000, 2005) systematic reviews. Neuropsychology, 23 (1), 2039. doi: 10.1037/a0013659 Google Scholar
Shadish, W. R. (2015). Introduction to the special issue on the origins of modern meta-analysis. Research Synthesis Methods, 6 (3), 219220. doi:10.1002/jrsm.1148 CrossRefGoogle Scholar
Shadish, W. R., & Lecy, J. D. (2015). The meta-analytic big bang. Research Synthesis Methods, 6 (3), 246264. doi:10.1002/jrsm.1132 CrossRefGoogle ScholarPubMed
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011). Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Medical Research Methodology, 11 (1), 15. doi:10.1186/1471-2288-11-15 CrossRefGoogle ScholarPubMed
Soo, C., & Tate, R. (2007). Psychological treatment for anxiety in people with traumatic brain injury. Cochrane Database of Systematic Reviews (Online), (3), CD005239.Google ScholarPubMed
Sterne, J. A., Sutton, A. J., Ioannidis, J. P., Terrin, N., Jones, D. R., Lau, J., . . . Higgins, J. P. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343, d4002.Google Scholar
Tate, R. L., Moseley, A., Perdices, M., McDonald, S., Togher, L., Schultz, R., . . . Winders, K. (2006). Update on Cicerone's systematic review of cognitive rehabilitation: The PsycBITE perspective. Archives of Physical Medicine and Rehabilitation, 87 (3), 446. doi:10.1016/j.apmr.2006.01.011 Google Scholar
The Cochrane Collaboration (2013). History | Archive. Retrieved from http://community-archive.cochrane.org/about-us/history Google Scholar
The Standard of Reporting Trials Group (1994). A proposal for structured reporting of randomised controlled trials. JAMA, 272, 1926–31.Google Scholar
Waldron, B., Casserly, L. M., & O'Sullivan, C. (2013). Cognitive behavioural therapy for depression and anxiety in adults with acquired brain injury. What works for whom?. Neuropsychological Rehabilitation, 23 (1), 64101.CrossRefGoogle Scholar