Hostname: page-component-586b7cd67f-gb8f7 Total loading time: 0 Render date: 2024-11-25T19:01:48.611Z Has data issue: false hasContentIssue false

Little evidence for the usefulness of violence risk assessment

Published online by Cambridge University Press:  02 January 2018

Timothy Wand
Affiliation:
Emergency Department, Royal Prince Alfred Hospital and Sydney Nursing School, University of Sydney, NSW, Australia. Email: [email protected]
Matthew Large
Affiliation:
School of Psychiatry, University of New South Wales, Randwick, NSW, Australia
Rights & Permissions [Opens in a new window]

Abstract

Type
Columns
Copyright
Copyright © Royal College of Psychiatrists, 2013 

Troquete and colleagues report a cluster randomised trial of the effect of violence risk assessment on future offending.Reference Troquete, van den Brink, Beintema, Mulder, van Os and Schoevers1 They found that people in the risk assessment group were non-significantly more likely to re-offend than those in the control group. We welcome this analysis of the practical value of risk assessment. There are now literally thousands of published violence risk assessment studies, most of which claim validity for their risk assessment method on the basis of statistical discrimination between violent and non-violent groups using measures such as the area under the curve (AUC) or other indicators of effect size.Reference Wand2 Recent criticism of the AUC as an outcome measure has emerged because it does not reflect the accuracy of predictions in the real world, and even high AUC values are associated with a low positive predictive value (PPV) for rare events. However, the PPV of a risk assessment is only a proxy for the usefulness of a risk assessment. A risk assessment alone is not valuable unless it leads reasonable interventions that can reduce future harm. Therefore, the utility of a risk assessment must ultimately be judged by its ability to contribute to harm reduction. In contrast to the large number of papers about the statistical aspects of risk assessment, there may be as few as four published controlled studies of the ability of risk assessment to reduce harm.Reference Wand2

The British Journal of Psychiatry has published two earlier studies of the utility of risk assessment. Abderhalden et al reported a cluster randomised trial of risk assessment among in-patients that found that intervention wards had a reduction in violence. However, interpretation of this study is difficult because the intervention wards had high rates of violence pre-trial and post-trial rates of violence in the experimental and control wards did not differ.Reference Abderhalden, Needham, Dassen, Halfens, Haug and Fischer3 Also in the Journal, van de Sande and colleagues reported a cluster randomised trial that found that risk assessment was associated with a reduction in violence but not seclusion among in-patients.Reference van de Sande, Nijman, Noorthoorn, Wierdsma, Hellendoorn and van der Staak4 In the nursing literature, Kling et al reported a study in in-patient settings that found that risk assessment was not helpful in reducing violence.Reference Kling, Yassi, Smailes, Lovato and Koehoorn5

Risk assessment has become the dominant paradigm in mental health practice, policy and legislation in most high-income countries. It should therefore trouble colleagues who support ‘evidence-based practice’ to know that there is so little evidence for the effectiveness of risk assessment.

References

1 Troquete, NAC van den Brink, RHS Beintema, H Mulder, T van Os, TWDP Schoevers, RA et al Risk assessment and shared care planning in out-patient forensic psychiatry: cluster randomised controlled trial. Br J Psychiatry 2013; 202: 365–71.Google Scholar
2 Wand, T. Investigating the evidence for the effectiveness of risk assessment in mental health care. Issues Ment Health Nurs 2012; 33: 27.Google Scholar
3 Abderhalden, C Needham, I Dassen, T Halfens, R Haug, H-J Fischer, JE Structured risk assessment and violence in acute psychiatric wards: randomised controlled trial. Br J Psychiatry 2008; 193: 4450.Google Scholar
4 van de Sande, R Nijman, HLI Noorthoorn, EO Wierdsma, AI Hellendoorn, E van der Staak, C et al Aggression and seclusion on acute psychiatric wards: effect of short-term risk assessment. Br J Psychiatry 2011; 199: 473–8.Google Scholar
5 Kling, RN Yassi, A Smailes, E Lovato, CY Koehoorn, M Evaluation of a violence risk assessment system (the Alert System) for reducing violence in an acute hospital: a before and after study. Int J Nurs Stud 2011: 48: 543–9.Google Scholar
Submit a response

eLetters

No eLetters have been published for this article.