Hostname: page-component-586b7cd67f-l7hp2 Total loading time: 0 Render date: 2024-11-26T18:17:38.945Z Has data issue: false hasContentIssue false

Risk assessment and evidence-based medicine

Published online by Cambridge University Press:  02 January 2018

Matthew Large*
Affiliation:
School of Psychiatry, University of New South Wales, Sydney, Australia, email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Type
Columns
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Royal College of Psychiatrists, 2014

The article by Roychowdhury & Adshead starts to place violence risk assessment in the context of medical care. Reference Roychowdhury and Adshead1 Although this is welcome, their partial defence of risk assessment in general, and of structured professional judgement in particular, is based on some significant distortions.

The first distortion is the gross overestimation of the power of risk assessment to discriminate between low-risk and high-risk people. The authors present a contingency table that they imagine shows the ‘potential’ outcomes of a violence risk assessment (Table 2). Using their tabulated data, a diagnostic odds ratio for risk assessment can be calculated to be 81, indicating that the risk of violence in the high-risk group (50%) is hugely higher than in the low-risk group (1.2%). These figures are totally unrealistic. In fact, the diagnostic odds ratio of violence risk assessment in replication studies was recently estimated by meta-analysis Reference Singh, Grann and Fazel2 to be 3. Roychowdhury & Adshead overestimate the discriminating power of risk assessment by 27 times. Moreover, even an unrealistically powerful risk assessment with diagnostic odds of 16 is of little or no value because of failure to detect potential violence in the low-risk group and the large proportion of false positives in the high-risk group. Reference Hoffman, TenBrook, Wolf, Pauker, Salem and Wong3

The second distortion relates to the underestimation of the precision of medical tests. In fact, the authors seem to have had difficulty finding any medical test with diagnostic odds that they could compare to a violence risk assessment. Instead they chose to compare two medical treatments. They argue that the high number-needed-to-treat as a result of a violence risk assessment is acceptable in psychiatry because in cardiology the number of bypass grafts needed to prevent one fatal outcome has been calculated to be 53. Reference Hoffman, TenBrook, Wolf, Pauker, Salem and Wong3 However, the meta-analysis they derived this figure from compared coronary bypass surgery to angioplasty - both of which are highly efficacious treatments for angina. Reference Hoffman, TenBrook, Wolf, Pauker, Salem and Wong3 In reality, medical tests that are used to diagnose conditions with serious implications for the patient are very accurate - biopsy is an excellent indicator of cancer and an angiogram a good indicator of coronary heart disease.

Despite these limitations, I support the authors' general idea of viewing risk assessment as a medical procedure. I would go further: surely violence risk assessment should be judged by the standards of evidence-based medicine. The real questions then become: (1) are there any rational interventions that can be justified in terms of cost and benefit that might reduce violence among high-risk patients (many of whom will not be violent) and yet should not be offered to low-risk patients (who commit as many or even the majority of acts of violence); and (2) is there evidence that shifting treatment resources from low-risk to high-risk people can, in any way, reduce overall levels of harm?

The answer to both these questions is no. Reference Large, Ryan, Callaghan, Paton and Singh4,Reference Wand and Large5 There is no doubt that medical diagnostic tests serve as a good basis for medical treatment and that medical and surgical treatment can save lives. It is simply disingenuous to suggest that the same can be said of violence risk assessment.

Footnotes

Declaration of interest: M.L. has provided expert evidence in matters relating to risk assessment.

References

1 Roychowdhury, A, Adshead, G. Violence risk assessment as a medical intervention: ethical tensions. Psychiatr Bull 2014; 38: 7582.CrossRefGoogle ScholarPubMed
2 Singh, JP, Grann, M, Fazel, S. Authorship bias in violence risk assessment? A systematic review and meta-analysis. PLoS One 2013; 8: e72484.CrossRefGoogle ScholarPubMed
3 Hoffman, SN, TenBrook, JA, Wolf, MP, Pauker, SG, Salem, DN, Wong, JB. A meta-analysis of randomized controlled trials comparing coronary artery bypass graft with percutaneous transluminal coronary angioplasty: one- to eight-year outcomes. J Am Coll Cardiol 2003; 41: 1293–304.CrossRefGoogle ScholarPubMed
4 Large, MM, Ryan, CJ, Callaghan, S, Paton, MB, Singh, SP. Can violence risk assessment really assist in clinical decision-making? Aust N Z J Psychiatry 2014; 48: 286–8.CrossRefGoogle ScholarPubMed
5 Wand, T, Large, M. Little evidence for the usefulness of violence risk assessment. Br J Psychiatry 2013; 202: 468.CrossRefGoogle ScholarPubMed
Submit a response

eLetters

No eLetters have been published for this article.