Hostname: page-component-cd9895bd7-dk4vv Total loading time: 0 Render date: 2024-12-18T11:53:51.976Z Has data issue: false hasContentIssue false

A randomized study of a smartphone application compared with booklet to improve service user’s knowledge of their legal rights

Published online by Cambridge University Press:  18 October 2017

B. O’Donoghue*
Affiliation:
Orygen, the National Centre of Excellence in Youth Mental Health, Melbourne, VIC, Australia Centre for Youth Mental Health, University of Melbourne, Melbourne, VIC, Australia Orygen Youth Health, Melbourne, VIC, Australia
E. Roche
Affiliation:
North Dublin Mental Health Services, Curam Clinic, Swords, Co. Dublin, Ireland
A. Naji
Affiliation:
Royal College of Surgeons in Ireland, St. Stephen’s Green, Dublin, Ireland
R. Daly
Affiliation:
North Dublin Mental Health Services, Royal College of Surgeons in Ireland, St. Stephen’s Green, Dublin, Ireland
K. Madigan
Affiliation:
St John of God Community Mental Health Services, Stillorgan, Co. Dublin, Ireland
I. Cole
Affiliation:
Dublin North City Mental Health Services, Dublin, Ireland
J. Lyne
Affiliation:
North Dublin Mental Health Services, Royal College of Surgeons in Ireland, St. Stephen’s Green, Dublin, Ireland
*
*Address for correspondence: B. O’Donoghue, Orygen, the National Centre of Excellence in Youth Mental Health, Melbourne, VIC, Australia. (Email: [email protected])
Rights & Permissions [Opens in a new window]

Abstract

Background

The Mental Health Act 2001 has introduced significant changes to the process of admission to hospital for individuals affected by mental health disorders. This study aimed to determine whether a newly designed smartphone application could result in an improvement in service users’ knowledge of their rights compared with the paper booklet.

Methods

This was a randomized study conducted in an outpatient and day-hospital in North Dublin. Participants were randomized to receive the information booklet as either a smartphone application or in the paper form. A questionnaire which was scored from 0 to 10 was devised and was completed at baseline and at 1-week follow-up.

Results

A total of 42 individuals completed the baseline and follow-up questionnaire and of these, 53.7% were female and the mean age was 38.2 years (s.d.±13.5). A total of 34.1% had a diagnosis of a psychotic disorder, 29.3% had a depressive disorder and 22% had bipolar-affective disorder. The mean score before the intervention in the total group was 3.5 (s.d.±2.2) and this increased to 5.8 (s.d.±2.2) at follow-up. Participants randomized to the smartphone application improving by a mean of 2.5 (s.d.±2.5), while those randomized to the booklet improving by a mean of 2.3 (s.d.±2.6), which was not statistically significant.

Conclusions

Both forms of the information booklet showed improvement in service users’ knowledge of their legal rights. It is possible that each individual will have preference for either a paper form or a smartphone form and this study suggests that both forms should be offered to each individual service user.

Type
Short Report
Copyright
© College of Psychiatrists of Ireland 2017 

Background

The last decade has seen substantial changes in the Republic of Ireland to the processes of involuntary admission and legal rights of individuals admitted to hospital for mental health treatment. These changes resulted from the implementation of the Mental Health Act 2001 (MHA2001) (Kelly, Reference Kelly2002) and the establishment of the ‘Mental Health Commission,’ which aims to promote, encourage and foster high standards and good practices in the delivery of mental health services, and to protect the interests of patients who are involuntarily admitted. These were welcome changes, as prior to the introduction of the MHA2001, it was reported in one study that nearly half of individuals were unaware that they had been admitted involuntarily, and only 14% perceived that they had their rights explained to them on admission (Rooney et al. Reference Rooney, Murphy, Mulvaney, O’Callaghan and Larkin1996). Although awareness of legal status was found to have improved substantially following the introduction of the MHA2001 (O’Donoghue et al. Reference O’Donoghue, Lyne, Hill, Larkin, Feeney and O’Callaghan2010), service users continue to have poor knowledge of their rights. For example, it was found that just over half of service users were aware of how mental health tribunals functioned, and over one quarter were unaware that they had the right to appeal the decision of the tribunal (O’Donoghue et al. Reference O’Donoghue, Lyne, Hill, Larkin, Feeney and O’Callaghan2010). A qualitative study of service users’ who had been admitted to hospital involuntarily also found that individuals perceived that they had a lack of information and felt disempowered (Murphy et al. Reference Murphy, McGuinness, Bainbridge, Brosnan, Felzmann, Keys, Murphy, Hallahan, McDonald and Higgins2017).

Ensuring that service users are adequately informed of their rights when admitted to hospital is an important duty of the mental health services and this practice could lead to positive change, such as service users feeling more informed, empowered and less apprehensive about an admission to hospital. Providing service users with information on the process of involuntary admission could lead to an improvement in the level of procedural justice perceived and this in turn, could improve the therapeutic relationship and reduce the perception of coercion (Roche et al. Reference Roche, Madigan, Lyne, Feeney and O’Donoghue2014). As such, the Mental Health Commission produced an information booklet entitled ‘Your guide to the Mental Health Act 2001’ which is provided to individuals who are detained involuntarily.

Concurrently over the last decade there has been a dramatic change in how individuals obtain information. A study conducted by the Health Research Board in Ireland that involved over 1500 individuals found that nearly half (49%) of people used the internet as a source of information on health (Gallagher et al. Reference Gallagher, Doherty, Tedstone and Katralova-O’Doherty2008). Importantly, the study found that individuals with mental health problems frequently used the internet as a source of information on healthcare.

Therefore, this study aimed to determine whether a smartphone application (app) could result in an improvement in service users’ knowledge of their rights under mental health act legislation compared with a paper booklet. It was hypothesized that individuals who received the information via smartphone app would have a greater improvement in knowledge compared with those allocated to the paper booklet.

Methodology

Setting and participants

This study took place in the Swords outpatient mental health clinic and day-hospital in North Dublin Mental Health Services. Individuals attending these services were informed of the study and invited to participate. Exclusion criteria included an inability to provide informed consent or an inability to read English. Service users attending outpatient clinics and day hospitals were invited to participate as these were individuals who could potentially be admitted to hospital.

Intervention

There were two allocation groups in this study. One group received the booklet ‘Your Guide to the Mental Health Act 2001’ via a smartphone app and the other group received it as a paper document. The booklet ‘Your Guide to the Mental Health Act 2001’ has six sections, entitled: Introduction, Your Rights, Your Admission, Mental Health Tribunals, Mental Health Commission and Support Organisations. The smartphone app replicates the exact wording of the paper booklet. The smartphone app is available for android and iOS (Apple iphone or ipad) systems and for participants who possessed a smartphone or tablet, with their consent, the app was installed on their device. The participants were shown how to use the app and how to navigate the different sections and obtain information, such as using the search function. If a participant did not have a smartphone or if the app was not compatible with their smartphone or tablet, then a tablet computer was made available for them to use at the mental health clinic or day hospital.

Instruments

A 10 item questionnaire was devised based on information in the booklet ‘Your guide to the Mental Health Act 2001’ and is attached as an appendix. The questionnaire was reviewed by an external expert in mental health and mental health legislation. The questionnaire was administered before the intervention and after 1 week. The questionnaire was scored from 0 to 10, with higher scores representing better knowledge of legal rights under the MHA2001. Each item of the questionnaire was allocated a score of one for a correct answer and zero for an incorrect answer.

Study design

The study design was a two-armed randomized study. It was not possible to maintain blinding for this study, however participants undertook the initial questionnaire prior to randomization and the follow-up questionnaire was self-reporting.

Consent process and randomization

An information sheet on the study was provided to potential participants and they were informed about the study verbally. If the service user consented to participate in the study, they were asked to first fill out the baseline questionnaire on their knowledge of their legal rights. Following this, participants were randomized by generating a random number between 1 and 2, with each number representing the allocation to a specific arm of the study, using the website www.random.org. This method facilitated immediate allocation and the appropriate intervention was then delivered.

Power analysis

The questionnaire is scored from 0 to 10, with the higher scores representing higher knowledge. It was estimated that a clinically significant difference in knowledge would be represented by a difference of 2, therefore with 90% power at a significance level of 0.05, it was estimated that a total of 40 participants would be required (20 in each arm).

Statistical analysis

Descriptive statistics including means and standard deviations for parametric data were used. For the primary outcome, a t-test was conducted to determine whether the mean differences in baseline and follow-up scores differed between the intervention groups. Paired t-tests were used to determine whether baseline and follow-up data differed. χ 2 Tests were performed to determine if there were differences between categorical groups. Statistical analysis was conducted using IBM SPSS version 24 (IBM, 2011).

Ethical approval and copyright permission

Ethical approval was obtained from the Beaumont Hospital Ethics Committee. The Mental Health Commission provided permission for the booklet ‘Your Guide to the Mental Health Act 2001’ to be converted into a smartphone app.

Results

Description of participants

A total of 52 individuals were screened for eligibility and of these, one individual was not eligible. Of the 51 individuals eligible, 94.1% (n=48) provided consent to participate and completed the baseline assessment and of these, 87.5% (n=42) completed the follow-up questionnaire. The flow diagram of recruitment of participants is displayed in Fig. 1. One individual provided consent to participate in the study but not for their clinical file to be accessed and therefore demographic and clinical information is missing for this participant. A total of 53.7% (n=22) of participants were females and the mean age of the total cohort was 38.2 years (s.d.±13.5). A total of 34.1% (n=14) had a diagnosis of a psychotic disorder, 29.3% (n=12) had a depressive disorder and 22% (n=9) had a diagnosis of bipolar-affective disorder. The demographic and clinical characteristics of participants is presented in Table 1 and there were no differences between the group allocated to the smartphone app compared to the paper booklet.

Fig. 1 Flow diagram of recruitment of participants.

Table 1 Demographic and clinical characteristics of participants and comparison according to group allocation

Knowledge of legal rights

The mean score of the questionnaire prior to the intervention in the total group was 3.5 (s.d.±2.2) out of a potential score of 10 and there was no difference in the baseline scores between groups (3.1 v. 3.6, t=−0.86, df=40, p=0.39). In the total cohort, the mean score of the questionnaire following the intervention was 5.8 (s.d.±2.2). There was no difference in the scores between groups following the intervention (5.5 v. 6.0, t=−0.61, df=40, p=0.55). There was a mean improvement in the scores by 2.4 (s.d.±2.5) points in the total cohort and this difference from baseline to follow-up scores was statistically significant (t=−6.05, df=41, p<0.001). Participants randomized to the smartphone application improved by a mean of 2.5 (SD±2.5) and those randomized to the booklet improved by a mean of 2.3 (S.D.±2.6), a difference which was not statistically significant (t=0.21, df=40, p=0.84). The proportion of participant who answered each question correctly before and after the intervention are displayed in Table 2 and this demonstrated that there was an improvement in all questions at follow-up.

Table 2 Individual item answers pre- and post-intervention

a This is the original wording of the question, however it should have read: ‘After a person makes an application for another person to be admitted to hospital under the Mental Health Act, how soon must a doctor see them to make a recommendation (or not) for admission after receiving the application?*

Discussion

Summary of findings

This study found that service users had an overall poor baseline knowledge of their legal rights under the MHA2001 legislation, however this knowledge improved significantly following allocation to either study interventions, a smartphone application or paper booklet. While there was an improvement in knowledge in the overall group, there was no difference in the level of improvement dependent on allocation to either smartphone application or paper booklet.

Clinical implications

The results of this study are encouraging, as it has demonstrated that both mediums for providing crucial information to service users regarding their rights are effective and each medium offers its own advantage. If a service user owns a smartphone or tablet, they could be encouraged to download the application on entry to the mental health service and this offers a free, convenient method to readily access ones rights if admitted. For those service users without a smartphone or tablet, the paper booklet has been demonstrated to be just as effective in improving knowledge on legal rights. Smartphone applications offer other potential benefits for individuals affected by mental health disorders, such as reminders to encourage adherence (Kannisto et al. Reference Kannisto, Adams, Koivunen, Katajisto and Valimaki2015) and interventions to improve symptoms (Donker et al. Reference Donker, Petrie, Proudfoot, Clarke, Birch and Christensen2013) and thus should be seen as an effective and inexpensive method to offer support.

Strengths and limitations

This study has a number of strengths, in that it was adequately powered to determine if the intervention was effective and it was conducted in a clinical cohort who should be informed of their rights as a service user. However, the findings have to be considered within the limitations of the study. First, it is possible that there could be a test–retest bias by conducting the same questionnaire twice and the initial questionnaire could have focused participants on what information to look for within the smartphone application or paper booklet. Therefore, if used in regular clinical practice, without the initial questionnaire, service users may not obtain as much information from the smartphone application or booklet. The study was also conducted in a clinical cohort who were not inpatients and only a minority of whom had been involuntary inpatients previously. It is not clear whether the interventions would be as effective in an inpatient population, who may be more acutely unwell, which could limit their capacity to retain information (Christensen & Rogne, Reference Christensen and Rogne1994). Anecdotally, the practice of restricting service users access to their mobile phones while an inpatient in psychiatric units is known to occur. One of the rationales for this practice is that most mobile phones have camera’s built into the phone and this represents a potential threat to other patients confidentiality. However, there appears to be no published literature on this practice or it’s justification and the practice varies according to local policies and protocols. If this was the case, it would limit the applicability of the smartphone application in the acute setting, although it could still be given to service users prior to any admission.

Conclusions

The current study provides initial evidence that a smartphone application may be at least as effective in disseminating information on the MHA2001 to a group of mental health service attenders. Given that some service users may have a preference for this mode of communication, strong consideration should be given to offering this app to service users detained under the MHA2001, in addition to the paper booklet. Future research should focus on developing apps for dissemination of other knowledge within mental health services, and on ensuring service users are appropriately informed when they are treated under Mental Health Act legislation.

Access to smartphone application

The smartphone application is available on the Android and iOS system. It is available for download free from the Google play store at: https://play.google.com/store/apps/details?id=com.boostedhuman.mha_guidebook_app and also from the iTunes store by searching ‘Your guide to the Mental Health Act 2001.’

Acknowledgments

The authors thank the Mental Health Commission for funding for the production of the smartphone application and also for granting copyright permission to use the content of the booklet: ‘Your Guide to the Mental Health Act 2001.’ The authors also thank Dr Declan Murray, Consultant Psychiatrist for his support of the project and Dr Larkin Feeney, Consultant Psychiatrist who reviewed the smartphone application during its production. The authors are grateful to Prof Brendan Kelly for reviewing and providing valuable feedback on the questionnaire used in the study. The smartphone application was produced by the company ‘Boosted Human,’ based in Melbourne, Australia.

Financial Support

This research received funding from the Mental Health Commission for the production of the smartphone application.

Conflicts of Interest

All authors declare that they have no conflicts of interest.

Ethical Standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committee on human experimentation with the Helsinki Declaration of 1975, as revised in 2008. Ethical approval was obtained from the Beaumont Hospital Ethics Committee. The Mental Health Commission provided permission for the booklet ‘Your Guide to the Mental Health Act 2001’ to be converted into a smartphone app.

Footnotes

These authors contributed equally to this work.

References

Christensen, AM, Rogne, TA (1994). Involuntary admissions and other compulsions in psychiatry. Patients’ knowledge of their rights and ability to receive information concerning these matters. Ugeskr Laeger 156, 53005303.Google Scholar
Donker, T, Petrie, K, Proudfoot, J, Clarke, J, Birch, MR, Christensen, H (2013). Smartphones for smarter delivery of mental health programs: a systematic review. Journal of Medical Internet Research 15, e247.Google Scholar
Gallagher, S, Doherty, D, Tedstone, Moran R, Katralova-O’Doherty, K (2008). Internet use and seeking health information online in Ireland: demographic characteristics and mental health characteristics of users and non users. HRB Research Series 4. (http://www.hrb.ie/uploads/media/HRBResearchSeries4.pdf).Google Scholar
IBM (2011). IBM SPSS Statistics for Windows, version 21.0. IBM.Google Scholar
Kannisto, KA, Adams, CE, Koivunen, M, Katajisto, J, Valimaki, M (2015). Feedback on SMS reminders to encourage adherence among patients taking antipsychotic medication: a cross-sectional survey nested within a randomised trial. BMJ Open 5, e008574, doi: 10.1136/bmjopen-2015-008574.CrossRefGoogle ScholarPubMed
Kelly, BD (2002). The Mental Health Act 2001. Irish Medical Journal 95, 151152.Google ScholarPubMed
Murphy, R, McGuinness, D, Bainbridge, E, Brosnan, L, Felzmann, H, Keys, M, Murphy, K, Hallahan, B, McDonald, C, Higgins, A (2017). Service users’ experiences of involuntary hospital admission under the Mental Health Act 2001 in the Republic of Ireland. Psychiatric Service. appips201700008. doi: 10.1176/appi.ps.201700008.Google Scholar
O’Donoghue, B, Lyne, J, Hill, M, Larkin, C, Feeney, L, O’Callaghan, E (2010). Involuntary admission from the patients’ perspective. Social Psychiatry and Psychiatric Epidemiology 45, 631638.Google Scholar
Roche, E, Madigan, K, Lyne, JP, Feeney, L, O’Donoghue, B (2014). The therapeutic relationship after psychiatric admission. Journal of Nervous and Mental Disease 202, 186192.Google Scholar
Rooney, S, Murphy, K, Mulvaney, F, O’Callaghan, E, Larkin, C (1996). A comparison of voluntary and involuntary patients admitted to hospital. Irish Journal of Psychological Medicine 13, 132137.CrossRefGoogle Scholar
Figure 0

Fig. 1 Flow diagram of recruitment of participants.

Figure 1

Table 1 Demographic and clinical characteristics of participants and comparison according to group allocation

Figure 2

Table 2 Individual item answers pre- and post-intervention