Hostname: page-component-586b7cd67f-rdxmf Total loading time: 0 Render date: 2024-11-22T19:29:47.393Z Has data issue: false hasContentIssue false

How subjective well-being, patient-reported clinical improvement (PROMs) and experience of care (PREMs) relate in an acute psychiatric care setting?

Published online by Cambridge University Press:  17 February 2023

Elisabetta Scanferla*
Affiliation:
CMME, GHU Paris Psychiatrie et Neurosciences, Hôpital Sainte-Anne, Paris, France Université Paris Cité, ED 450, Paris, France
Katherine de Bienassis
Affiliation:
Organisation for Economic Co-operation and Development, Paris, France
Bernard Pachoud
Affiliation:
Université Paris Cité, ED 450, Paris, France
Philip Gorwood
Affiliation:
CMME, GHU Paris Psychiatrie et Neurosciences, Hôpital Sainte-Anne, Paris, France Université Paris Cité, INSERM, U1266 (Institute of Psychiatry and Neuroscience of Paris), Paris, France
*
*Author for correspondence: Elisabetta Scanferla, E-mail: [email protected]

Abstract

Background

Patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are increasingly acknowledged as critical tools for enhancing patient-centred, value-based care. However, research is lacking on the impact of using standardized patient-reported indicators in acute psychiatric care. The aim of this study was to explore whether subjective well-being indicators (generic PROMs) are relevant for evaluating the quality of hospital care, distinct from measures of symptom improvement (disease-specific PROMs) and from PREMs.

Methods

Two hundred and forty-eight inpatients admitted to a psychiatric university hospital were included in the study between January and June 2021. Subjective well-being was assessed using standardized generic PROMs on well-being, symptom improvement was assessed using standardized disease-specific PROMs, and experience of care using PREMs. PROMs were completed at admission and discharge, PREMs were completed at discharge. Clinicians rated their experience of providing treatment using adapted PREMs items.

Results

Change in subjective well-being (PROMs) at discharge was significantly (p < 0.001), but moderately (r2 = 28.5%), correlated to improvement in symptom outcomes, and weakly correlated to experience of care (PREMs) (r2 = 11.0%), the latter being weakly explained by symptom changes (r2 = 6.9%). Patients and clinicians assessed the experience of care differently.

Conclusions

This study supports the case for routinely measuring patients’ subjective well-being to better capture the unmet needs of patients undergoing psychiatric hospital treatment, and the use of standardized patient-reported measures as key indicators of high quality of care across mental health services.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of the European Psychiatric Association

1. Introduction

Two overlapping but distinct patient care approaches have gained political and professional momentum over the past decades: patient-centred care (PCC), defined as “providing care that is respectful of and responsive to individual patient preferences, needs and values, and ensuring that patients’ values guide all clinical decisions” [Reference Baker1], and value-based healthcare (VBHC) where patient-centred outcome measures determine the evaluation of the efficacy of care [Reference Porter2, Reference Porter3]. Both approaches encourage health systems to reframe provided services so they are person-oriented [Reference Tseng and Hicks4] and reflect patients’ preferences [Reference Hung and Jerng5, Reference Cooney, Warren, Altman, Abreu and Travis6]. Newly tailored measures have emerged to capture and quantify the patient’s voice. These metrics are complementary to clinician-reported measures, which have a limited ability to capture key aspects of patient needs and outcomes [Reference de Bienassis, Kristensen, Hewlett, Roe, Mainz and Klazinga7Reference Bravo, Edwards, Barr, Scholl, Elwyn and McAllister10]. Best practices in collecting patient-reported data involve the use of standardized, validated, self-administered questionnaires, to capture patient-reported outcome measures (PROMs). PROMs can be either (1) “generic” (non “disease-specific”), which measure various aspects of quality of life, or (2) “disease-specific,” that is concentrating on the perception of symptoms and health status of a particular group of patients or conditions [Reference Bodger, Ormerod, Shackcloth and Harrison11]. Patient-reported metrics also include patient-reported experience measures (PREMs), which are designed to discern patients’ perception of their experience with health services and healthcare delivery [Reference Benson12]. In this article, we refer to “patient-reported measures” as comprising both PROMs and PREMs.

Researchers, policy makers, and patient groups have documented numerous benefits of utilizing patient-reported measures across medical specialties [Reference Cooney, Warren, Altman, Abreu and Travis6, 13Reference Svendsen, Ellegaard, Jeppesen, Riiskjær and Nielsen17]. In clinical management, the use of patient-reported metrics has been found to correspond with increases in clinician awareness and consideration of patient needs, values, and preferences [Reference Tseng and Hicks4], and can be used to support shared decision-making during treatment [Reference de Bienassis, Kristensen, Hewlett, Roe, Mainz and Klazinga7, Reference Roe, Mazor and Gelkopf18Reference Kuzman, Slade, Puschner, Scanferla, Bajic and Courtet21]. Embedding harmonized patient-reported measures in routine care can lead to their more consistent use, increase systematic uptake for measuring care quality, and generate information to inform the implementation of health policies [Reference de Bienassis, Hewlett, Kendir, Kristensen, Mainz and Klazinga22].

In mental health research and practice, patient-reported measures have gained growing attention. They are being recognized as an effective instrument for improving high-quality care [Reference de Bienassis, Kristensen, Hewlett, Roe, Mainz and Klazinga7, Reference Kendrick, El‐Gohary, Stuart, Gilbody, Churchill and Aiken20, Reference Kristensen, Holmskov, Baandrup, Videbech, Bonde and Mainz23] and performance across its three core dimensions: effectiveness, safety, and patient-centredness [Reference Arah, Westert, Hurst and Klazinga24]. For example, the Organisation for Economic Co-operation and Development (OECD) is promoting the routine use of patient-reported measures to facilitate national and international comparisons of these measures, and in policy making [Reference de Bienassis, Kristensen, Hewlett, Roe, Mainz and Klazinga25]. OECD is testing in particular standardized indicators in the field of mental health care, and in particular PROMs of subjective well-being [Reference de Bienassis, Kristensen, Hewlett, Roe, Mainz and Klazinga25]. Subjective well-being dimension encompasses elements of good psychological functioning, notably affective reactions of individuals to their experiences [Reference de Bienassis, Hewlett, Kendir, Kristensen, Mainz and Klazinga22] (presence of positive and negative feelings) [Reference Diener, Inglehart and Tay26], eudaimonia, the condition of human flourishing [Reference Keyes27], and life evaluation (satisfaction and worthwhileness). Subjective well-being is a distinct concept from health-related quality of life (HRQoL), a multidimensional construct that consists of three broad domains—physical, psychological, and social functioning—and refers in particular to individuals’ cognitive assessment of the impact of their health on their daily lives [Reference Upton and Upton28]. Thus, it is important to capture subjective well-being in addition to traditional HRQoL data.

Improving well-being is particularly relevant for individuals experiencing severe mental disorders where the chronicity of particular symptoms can adversely affect their well-being and general quality of life [Reference Nicolas-Boluda, Oppenheimer, Bouaziz and Fauconnier16, Reference Megari29]. Nevertheless, limited research has investigated the use of standardized patient-reported indicators in this patient population [Reference Nelson, Eftimovska, Lind, Hager, Wasson and Lindblad30], and their potential to fill the gap between clinician and patient views on well-being [Reference Aunjitsakul, Teetharatkul, Vitayanont and Liabsuetrakul31]. Recent research includes Shadmi and colleagues [Reference Shadmi, Gelkopf, Garber-Epstein, Baloush-Kleinman, Doudai and Roe32] whose findings demonstrate that psychiatric service users’ reports of their quality of life may predict the risk of future hospitalization. In addition, a research study conducted by Mendlovic et al. [Reference Mendlovic, Roe, Markusfeld, Mainz, Kristensen and Goldzweig33] analysed data collected from people recently admitted to a psychiatric hospital, finding a strong correlation between patients’ assessment of patient-rated HRQoL, experience of care, and overall severity of their disease. However, none of these studies specifically addressed the area of subjective well-being.

The main objective of this study was to evaluate the relevance of patient-reported measures to capture the domain of subjective well-being as an indicator of the quality of hospital care, distinct from, though complementary to, measures of symptom improvement and patient experience reported by patients.

We hypothesized that the patients’ measures of subjective well-being (generic PROMs) at discharge may only be partially related to the satisfaction with the experience of care (PREMs) and symptom improvement (disease-specific PROMs), and potentially unrelated to clinician experience of provided care.

2. Methods

Participants

This was a prospective cross-sectional study that assessed data collected in routine care of patients admitted to a university group psychiatric hospital. Consecutively hospitalized patients in two departments of the GHU Paris psychiatrie et neurosciences, a university hospital group, between 31 January 2021 and 30 June 2021, were assessed for eligibility (N = 379). The first participating department was a university department specialized in mood and eating disorders; the second was a general psychiatric department providing care to the residents of a given geographic area suffering from diverse severe psychiatric disorders. Inclusion criteria were age > 18 years, hospitalization of two weeks or more, with a principal diagnosis code of mental health and behavioral disorders (ICD-10 codes F10-F69 and F90–99). The inclusion criteria related to the length of hospitalization is due to the construct of the World health organization well-being index (WHO-5) assessment tool, which covers a two-week look-back period.

Of the 357 inpatients eligible for inclusion, 311 were enrolled in the study, 52 did not complete the assessment at discharge, and 11 were excluded because the final length of their stay did not meet the inclusion criteria (see Figure 1). A total of 248 participants were included in the final sample (dropout rate, 20.2%). Seventy-six (30.6%) of the participants suffered from eating disorders, 72 (29.0%) from psychotic disorders, 46 (18.5%) from mood disorders, 44 (17.8%), were hospitalized for suicidal crises and 10 (4.0%) suffered from alcohol-use disorder (AUD). The mean age of enrolment was 37.0 years(SD = 14.1, range: 18–85); 74.2% (n = 184) were female. The mean length of hospitalization was 45.6 days (SD = 32.5, range: 14–222) (see Table 1). Patients suffering from psychotic disorders and AUD were not asked to complete the disease-specific PROMs to align with existing departmental workflows. Consequently, all statistics are based on N values of 248 or 166, respectively. Participants were assessed using the Mini International Neuropsychiatric Interview (M.I.N.I) [Reference Lecrubier, Sheehan, Weiller, Amorim, Bonora and Harnett Sheehan34], a brief structured diagnostic interview evaluating the most common psychiatric disorders. Evaluations were conducted by trained clinicians. This information was used to inform the principal diagnosis. Non-French-speaking patients and those having a primary neurological disorder were excluded from assessment with the M.I.N.I.

Figure 1. Flow chart of participants’ selection.

Table 1. Main demographic and clinical characteristics of the population sample (N = 248).

Abbreviation: SD, standard deviation.

Clinical assessment

Patients were invited to complete the questionnaires assessing subjective well-being (generic PROMs) and changes in symptoms that caused the hospitalization (disease-specific PROMs), at day of admission (+ maximum of 48 h) and at day of discharge (+ maximum of 48 h). At discharge, they also completed a questionnaire assessing their experience of care (PREMs). PREMs and PROMs collection was conducted via paper-and-pencil questionnaires. The patients’ primary clinicians completed a self-administered questionnaire about their experience of caregiving. Patients’ sociodemographical data (age, sex) were collected from the participants’ medical records.

Instruments

Generic PROMs

The selected instruments followed the survey of the OECD PaRIS on Mental Health care, 2021 [Reference de Bienassis, Hewlett, Kendir, Kristensen, Mainz and Klazinga22] and included:

(a) The World Health Organization Well-Being Index (WHO-5) [Reference Topp, Østergaard, Søndergaard and Bech35]: a self-report questionnaire consisting of five items that cover important aspects of subjective well-being (cheerfulness, calmness, activity, rest, and interest). The scoring is on a five-point scale, ranging from “All the time” to “At no time” (see Appendix 1). The total score ranges from 0 to 25, with high scores indicating an increased sense of well-being. The WHO-5 has demonstrated adequate psychometric properties across different somatic settings [Reference Topp, Østergaard, Søndergaard and Bech35Reference Bech, Olsen, Kjoller and Rasmussen37], with reported Cronbach α coefficients estimated between 0.83 [Reference Bonnín, Yatham, Michalak, Martínez-Arán, Dhanoa and Torres38] and 0.92 [Reference Krieger, Zimmermann, Huffziger, Ubl, Diener and Kuehner39]. Studies conducted among adults for monitoring patient response to treatment in psychiatric services, demonstrated the high reliability, validity and clinical utility of the WHO-5 [Reference Newnham, Hooke and Page40].

(b) The OECD Assessment of Subjective Well-being Core Items (two items) module [Reference Shadmi, Gelkopf, Garber-Epstein, Baloush-Kleinman, Doudai and Roe32] on overall life satisfaction, intended to capture the respondent’s evaluative judgment of how their life is going (item 1), and finding meaning and worth in life (item 2) (see Appendix 1). The total score ranges from 1 to 10, with higher scores indicating an increased satisfaction with life and a higher sense that things in life are worthwhile. The reliability and validity for multiple-item measures of life satisfaction is good, with a Cronbach α of between 0.80 and 0.96 [Reference Diener, Inglehart and Tay26].

Disease-specific PROMs

(a) HADS: The French version of the Hospital Anxiety and Depression Scale (HADS) [Reference Zigmond and Snaith41]: a self-assessment scale measuring anxiety (HADS-A) and depression (HADS-D) in general medical populations. For both scales, higher scores indicate more severe psychopathology [Reference Zigmond and Snaith41]. The internal consistency for patients of non-psychiatric clinics has been estimated between 0.68 and 0.93 for the HADS-A (mean 0.83), and between 0.67 and 0.90 for the HADS-D (mean 0.82) [Reference Bjelland, Dahl, Haug and Neckelmann42].

(b) EDI-2: The Eating Disorder Inventory-2 (EDI-2) [Reference Garner43, Reference Criquillion-Doublet, Divac, Dardennes and Guelfi44]: a self-rating inventory with 91 items and 11 subscales designed for the exploration of attitudinal and behavioral dimensions relevant to eating disorders. Higher scores indicate more severe psychopathology [Reference Garner, Olmstead and Polivy45]. The internal consistency found for the eight original scales of the EDI was above 0.80 for patients suffering from anorexia nervosa, and above 0.60 for healthy subjects [Reference Garner, Olmstead and Polivy45], while the three added scales showed a Cronbach α ranging from 0.65 (ascetism) to 0.75 (impulse regulation) in an eating disordered sample [Reference Eberenz and Gleaves46].

(c) BSS: Beck Scale for Suicide Ideation [Reference Brown, Beck, Steer and Grisham47, Reference Beurs, de Vries, de Groot, de Keijser and Kerkhof48]: a self-report instrument designed to assess the severity of a patient’s suicidal ideation and to identify a risk of acting on it. The BSS is composed of 21 items that assess: reasons for living or dying, duration and frequency of suicidal thoughts, anticipation of a real attempt, and degree of preparation. Higher values indicate a greater risk of suicide. The Cronbach α coefficient for patients admitted to psychiatric services has been estimated 0.93 and indicated internal consistency [Reference Beck, Steer and Ranieri49].

PREMs

Patients’ treatment satisfaction was measured using a four-item rating scale adapted from the OECD-Proposed Set of Questions on Patient Experiences with Ambulatory Care [Reference Shadmi, Gelkopf, Garber-Epstein, Baloush-Kleinman, Doudai and Roe32]. It explores the following dimensions: courtesy and respect; time spent with the clinician; clarity of the explanations and involvement in decisions about care and treatment (see Appendix 1). The scale comprises four responses categories on a 0–3 scale ranging from “Yes, definitely” to “No, definitely not.” Higher scores indicate more positive levels of satisfaction with the experience of care. The internal consistency was greater than 0.80.

Clinician-rated experience of care delivered

In order to compare patients’ and clinicians’ experience, clinicians were asked to rate their experience of the treatment delivered to their patients using the PREMs questionnaire adapted to clinicians. The response scale was the same as for the PREMs (see Appendix 2).

Statistical analysis

All items measured in the study (patient and clinician-reported measures) were standardized to zero mean and unit variance. For comparative purposes, a z-score was used to standardize the results of the disease-specific symptom outcomes questionnaires (PROMs). For continuous measures, the mean and standard deviation (SD) are reported. The relationship between the variables was tested using the Pearson correlation coefficient, Kendal Tau test, and linear regression models. For the generic PROMs, the PREMs, and the CREMs, after verifying their internal consistency (Cronbach α), a synthetic index was calculated by summing the evaluations as performed in previous research and using the same measures [57]. For the generic and disease-specific PROMs, temporal evolution was considered as the difference between the assessment on the day of admission and the assessment on the day of discharge.

A linear regression analysis was performed to test predictors of well-being score changes (standardized difference between admission and discharge scores). The independent variables were symptom change scores (disease-specific PROMs, standardized difference between admission and discharge scores), patient’s experience of care (standardized sum of PREMs scores), and clinicians’ experience of caregiving (standardized sum of CREMs scores).

Finally, a principal component analysis (PCA) was used to identify potential overlapping groups of items of PROMs (well-being and symptoms evolution), PREMs, and CREMs. An orthogonal varimax rotation with Kaiser normalization was used to derive orthogonal factor loadings. Only components with eigenvalues greater than one were considered relevant. Two supplementary qualitative variables (diagnosis and sex) and two quantitative variables (length of hospitalization and age in years) were included in the analysis.

The Ascending Hierarchical Clustering (AHC) algorithm was performed on the PCA-transformed data to identify homogeneous subgroups of patients either suffering from eating and mood disorders, or hospitalized for a suicidal crisis (N = 166). For this purpose, the v-test [~ Normal (0, 1)] was estimated, representing the positive or negative association of the variables with the clusters. The variables with the highest v-test values were selected to interpret the main characteristics in each cluster. All tests are two-tailed with a significance level of 5%; in the case of multiple comparisons, Bonferroni adjustment was performed. All statistical analyses were carried out using SPSS, version 26 (IBM Corp. Released 2019. IBM SPSS Statistics for Windows, Version 26.0).

3. Results

Subjective well-being as measured with PROMs and PREMs was positively correlated (r = 0.331, p < 0.0001) across disorders, implying that patients’ satisfaction with the experience of care explained only 11% of the improvement of the well-being scores (r 2 = 0.109). Subjective well-being measures were negatively correlated (r = −0.534, p < 0.0001) to symptom severity measures (disease-specific PROMs), indicating that symptom improvement explained 28.5% of the variance in subjective well-being (r 2 = 0.285). We found a weak, negative, correlation between symptom changes (disease-specific PROMs) and the experience of care (PREMs) (r = −0.262, p < 0.003), revealing that patients’ satisfaction with the experience of care did not fully explain (6.8%) the improvement in symptoms (r 2 = 0.068). Moreover, a low level of agreement was found between patients’ and their primary clinicians’ ratings of the hospital care sequence (for all items Kendall test W ≤ 0.118, p < 0.001). Clinicians rated most items significantly higher than patients (p < 0.001).

In addition, linear regression analysis assessing the explanatory value of change in symptoms, patient experience, and clinicians’ experience of care scores (predictor variables) in the participants’ subjective well-being scores (generic PROMs), confirmed that symptom improvement values significantly explained the variability of subjective well-being (p < 0.001). The p-value observed was 0.078 for PREMs scores (see Table 2).

Table 2. Predictors of the variability of subjective well-being: results of linear regression model.

Note: Dependent variable: Change in well-being total score (PROMs). All items of patient and clinician-reported measures were standardized to zero scores. Significant p-value ≤ 0.05.

Abbreviations: CI, confidence interval; CREM, clinician-reported experience of delivered care; PREM, patient-reported experience measure; PROM, patient-reported outcome.

a Synthetic index (standardized sum).

Finally, the results of the PCA analysis showed that the patient-reported measures’ items and the clinicians’ experience of caregiving values could be loaded into four relevant factors (eigenvalue >1). This four-factor solution globally explained 60.60% of the overall variance, of which 39.97% related to the first two components. Findings of the orthogonal varimax rotation showed that most of the items were strongly clustered for each of the four factors. The first component “patient-reported outcomes” covered all PROMs (well-being and symptoms improvement). The second, “patient-reported experience,” reflected all the PREM items, and rejected all of the equivalent ratings made by clinicians. The third and fourth factors covered the “clinician-reported experience.” None of these factors overlapped with the “patients-reported experience” factor (see Table 3).

Table 3. Principal component analysis of patient-reported outcome measures of well-being and symptoms change, patient-reported experience of care, and clinician-reported experience of delivered care.

Abbreviations: CREM, clinician-reported experience of caregiving measure; PREM, patient-reported experience measure; PROM, patient-reported outcome measure.

a Symptoms change: a z-score was used to standardize the results of the disease-specific symptom outcomes questionnaires. The change is the difference between scores at admission and discharge.

Cluster analysis performed with an ascending hierarchical classification model on subjects’ PCA-transformed data to the first three axes identified a total of three homogeneous groups (see Table 4). The distribution of the qualitative variables in the three clusters showed significant differences by gender and diagnosis. The first cluster was characterized by poor well-being and symptom improvement scores (PROMs), significantly low satisfaction with care experience (PREM), and delivered care (CREMs). It consisted mainly of eating disorder patients (67.7% vs 44.9% of the patients suffering from eating disorders in the sample; p = 0.003), and, consequently, a high concentration of female patients (96.8% vs 81.9%; p = 0.009). The second cluster included patients reporting low increases in PROMs, particularly in symptom outcome scores, a positive experience of care, and a length of hospital stay significantly shorter (28 vs 38 days in the sample). The third cluster was characterized by higher scores of well-being and symptom measures, as well as higher satisfaction with the experience of received care and experience of delivered care. In this cluster, there were significantly more male patients than in the sample (31.9% vs 18.1%; p = 0.003).

Table 4. Ascending hierarchical clustering: variables with a greater weight according to the v-test in each cluster.

Note: Following standardization for all variables, the overall mean = 1 and standard deviation = 0. Significant p-value ≤ 0.05.

Abbreviations: CREM, clinician-reported experience of delivered care measure; PREM, patient-reported experience measure; PROM, patient-reported outcome measure.

4. Discussion

This study investigated whether the domain of subjective well-being is a relevant indicator of the quality of hospital care, distinct from patient-reported measures of symptom improvement and satisfaction with care. Findings confirmed our hypothesis showing that across mental disorders improvement in subjective well-being was weakly correlated to experience of care and moderately, negatively, correlated to higher prevalence of symptoms. Improvement in symptoms was found to be the strongest predictor of increase in subjective well-being at discharge, but only explained a moderate part of its variance. We also observed that patient-reported measure scores differed between homogenous groups of patients and were potentially driven by their diagnosis: patients suffering from eating disorders were over-represented in the cluster characterized by poorer improvements in symptoms and a less satisfactory care experience.

Overall, the results of the present study suggest that a positive experience of care and the reduction of symptoms, as a traditional goal of acute treatment for psychiatric disorders, only partially contributes to the global sense of well-being at the end of a hospital stay. This provides evidence that the measures of patient-centredness and effectiveness of care (generic PROMs, such as well-being measures, and disease-specific PROMs, such as symptom improvement) are distinct and yet and should both be incorporated separately in clinical practice for comprehensive assessment [Reference Cuyún Carter, Milton, Ascher-Svanum and Faries50, Reference Skevington and Böhnke51].

These findings are consistent with previous research exploring how patient-reported measures interact, and describing a weak association between experience and outcome measures [Reference Coelho, de Bienassis, Klazinga, Santo, Frade and Costa52Reference Yamaguchi, Ojio, Koike, Matsunaga, Ogawa and Tachimori54]. Black et al.’s [Reference Black, Varaganum and Hutchings55] findings highlighted that having a positive experience of care can increase symptom improvement scores by approximately 4%, and health-related quality of life scores by approximately 2%. Interestingly, in the clinical field of mental health, Mendlovic et al. [Reference Mendlovic, Roe, Markusfeld, Mainz, Kristensen and Goldzweig33] reported a stronger correlation coefficient (r = 0.57) between patient’s ratings of their quality of life (generic PROMs) and experience of care, whereas our study showed a weak relationship between subjective well-being scores (generic PROMs) and experience of care. This highlights the value of well-being measures: they may contribute deeper insight into what matters to patients, notably in contexts where the hospital treatment fails to achieve full symptom remission [Reference Dolan, Lee and Peasgood56Reference Attwood, Penney, O’Leary, Klahn and Kelly58]. For example, by capturing patients’ emotions [57], the emotional stressors associated with the effects of hospitalization in acute psychiatric care can be further understood [Reference Johnson, Dalton‐Locke, Baker, Hanlon, Salisbury and Fossey59, Reference Causey, McKay, Rosenthal and Darnell60] and interventions for their management can be developed and implemented. However, further research is needed to investigate the specificity of various domains of generic PROMs (e.g. quality of life, recovery-oriented component of care, patient empowerment) [Reference Bejerholm and Roe61] and dimensions of subjective well-being (e.g. satisfaction in life, sense of fulfillment, hope, optimism, connection), to better understand their distinctive contribution to the patient’s global perception of the quality of hospital care [57].

Future studies should also consider how to better contextualize the strength of the correlations between various domains of PROMs and assess the factors that might contribute to the discrepancies observed between PREMs and PROMs across diagnoses. They should also investigate if discrepancies in outcomes could be due to biases related to patients’ differences in sociodemographic background and clinical characteristics (such as age, family situation, education, severity of illness, comorbidities) or the type of care received (voluntary or involuntary treatment). Of particular interest would be research on specific clinical populations or profiles, such as patients with eating disorders, who report lower levels of outcome improvement and satisfaction with hospital care. It may be suggested that, more than in other groups of patients, the subjective well-being of patients with eating disorders depends on factors other than symptom improvement, for example, interfering personality traits such as “perfectionism” [Reference Miles, Nedeljkovic and Phillipou62]. Exploring this hypothesis could shed valuable light on how to adapt clinical care strategies and interventions accordingly for this subset of patients.

Three limitations should be considered in the present study. Firstly, all data were collected in a single center, which may have resulted in selection bias as results might reveal the perception of patients who shared a similar experience of care. Nevertheless, patients were enrolled in different units treating different populations and using specific therapeutic approaches, delivered by separate care teams. In addition, patients reported significant differences in their perception of the quality of care. The study sample is also similar to other publications exploring relations between patient-reported measures of inpatients in psychiatric settings [Reference Mendlovic, Roe, Markusfeld, Mainz, Kristensen and Goldzweig33], and in other medical specialties [Reference Black, Varaganum and Hutchings55, Reference Lerdal, Hofoss, Gay and Fagermoen63, Reference Veltkamp, Teela, van Oers, Haverman and Bouts64]. Secondly, the most severe patients in an acute phase of the disease more often declined to be included in the study or failed to complete the assessments, which may result in possible attrition bias. However, considering the acuity of the timing of the data collection (within the first 48 hours of hospital admission), an attrition rate of 20.2% is relatively normative that is to say still in an acute phase. Lastly, this study focused on the appointed psychiatrists’ view of the caregiving experience, future studies could include other health professionals (e.g., nurses and psychologists) who spend significant time with service users in inpatient settings.

Despite the articulated limitations, this is one of the first studies to provide real data on the relationship between various domains of patient-reported measures from a large sample of patients receiving acute care in a French psychiatric hospital. It offers a unique insight into the value of specifically assessing subjective well-being with PROMs. These shed light on key aspects of care from the patient’s perspective that might otherwise go unassessed, and hence, unaddressed. As shown, the activity of implementing measures of subjective well-being may influence changes in clinical focus and improve the quality of care. For example, from the beginning of the hospital stay, by improving providers’ clinical judgment, identifying what is meaningful to patients, encouraging personalized treatment goals, and shared decision making. In addition, regularly measuring the patient’s well-being may provide valuable information on the evolution of these indicators in patients with chronic disorders that require long-term monitoring. Finally, the use of standardized indicators, such as those based on the OECD work on mental health, provides opportunities for data sharing, benchmarking, and sharing of best practices across settings.

In conclusion, this study strengthens existing research that standardized PROMs and PREMs can serve as key indicators of high-quality care, and supports the case for using PROMs of subjective well-being in clinical practice as relevant indicators in their own right for patients undergoing psychiatric hospital treatment.

Data Availability Statement

The datasets analyzed during the current study and that support its findings are available from the corresponding author on reasonable request.

Acknowledgements

The authors would like to thank A. Gibert and C. Mordacq who helped with the collection of data, D. Poupon and R. L. Mancusi for facilitating data analysis, and Y. Adebola for editorial support. Furthermore, the authors would like to acknowledge all members of the CMME and the Sector 13 departments of the GHU Paris psychiatrie et neurosciences two participated in this study.

Author Contributions

E.S., B.P. and P.G. were involved in study design. K.B. supported the harmonization with OECD developed standards. P.G. had full access to all the data in the study, and provided clinical interpretation of the findings. E.S. drafted the manuscript. All authors reviewed, edited and confirmed their acceptance of the final submitted version.

Conflicts of Interest

The authors declare none.

Ethics Standards

This study was performed in line with the Declaration of Helsinki of 1975, as revised in 2008. It was registered in the national Health Data Hub (health-data-hub.fr) (PR-O&E Ms trial). Each patient was informed of the objectives of the study and data anonymity prior to the signature of an informed consent form that systematically confirmed their participation.

A. Appendix 1: Patient-reported outcome and experience measures questionnaires used for the study

(nb: the participants completed the French version of the present questionnaire)

B. Appendix 2: Clinician-reported experience of care questionnaire used for the study

(nb: the clinicians completed the French version of the present questionnaire)

References

Baker, A. Crossing the quality chasm: a new health system for the 21st century. BMJ. 2001;323:1192. doi:10.1136/bmj.323.7322.1192.CrossRefGoogle Scholar
Porter, ME. A strategy for health care reform–toward a value-based system. N Engl J Med. 2009;361:109–12. doi:10.1056/NEJMp0904131.CrossRefGoogle ScholarPubMed
Porter, ME. What is value in health care? N Engl J Med. 2010;363:2477–81. doi:10.1056/NEJMp1011024.CrossRefGoogle ScholarPubMed
Tseng, EK, Hicks, LK. Value based care and patient-centered care: divergent or complementary? Curr Hematol Malig Rep. 2016;11:303–10. doi:10.1007/s11899-016-0333-2.CrossRefGoogle ScholarPubMed
Hung, K-Y, Jerng, J-S. Time to have a paradigm shift in health care quality measurement. J Formos Med Assoc. 2014;113:673–9. doi:10.1016/j.jfma.2014.06.003.CrossRefGoogle ScholarPubMed
Cooney, RM, Warren, BF, Altman, DG, Abreu, MT, Travis, SP. Outcome measurement in clinical trials for ulcerative colitis: towards standardisation. Trials. 2007;8:17. doi:10.1186/1745-6215-8-17.CrossRefGoogle ScholarPubMed
de Bienassis, K, Kristensen, S, Hewlett, E, Roe, D, Mainz, J, Klazinga, N. Measuring patient voice matters: setting the scene for patient-reported indicators. Int J Qual Health Care. 2022;34:ii3–6. doi:10.1093/intqhc/mzab002.CrossRefGoogle Scholar
Gaebel, W, Janssen, B, Zielasek, J. Mental health quality, outcome measurement, and improvement in Germany. Curr Opin Psychiatry. 2009;22:636–42. doi:10.1097/YCO.0b013e3283317c00.CrossRefGoogle ScholarPubMed
Chassin, MR, Loeb, JM, Schmaltz, SP, Wachter, RM. Accountability measures—using measurement to promote quality improvement. N Engl J Med. 2010;363:683–8. doi: 10.1056/NEJMsb1002320.CrossRefGoogle ScholarPubMed
Bravo, P, Edwards, A, Barr, PJ, Scholl, I, Elwyn, G, McAllister, M, et al. Conceptualising patient empowerment: a mixed methods study. BMC Health Serv Res. 2015;15:252. doi:10.1186/s12913-015-0907-z.CrossRefGoogle ScholarPubMed
Bodger, K, Ormerod, C, Shackcloth, D, Harrison, M, On behalf of the IBD Control Collaborative. Development and validation of a rapid, generic measure of disease control from the patient’s perspective: the IBD-control questionnaire. Gut. 2014;63:1092–102. doi:10.1136/gutjnl-2013-305600.CrossRefGoogle ScholarPubMed
Benson, T. Patient-Reported Measures. In: Patient-Reported Outcomes and Experience. Springer, Cham, 2022. doi:10.1007/978-3-030-97071-0_9CrossRefGoogle Scholar
American Society of Clinical Oncology. The state of cancer care in America, 2015: a report by the American society of clinical oncology. J Oncol Pract. 2015;11:79113. doi:10.1200/JOP.2015.003772.CrossRefGoogle Scholar
Black, N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167. doi:10.1136/bmj.f167.CrossRefGoogle ScholarPubMed
Bastemeijer, CM, Voogt, L, van Ewijk, JP, Hazelzet, JA. What do patient values and preferences mean? A taxonomy based on a systematic review of qualitative papers. Patient Educ Couns. 2017;100:871–81. doi:10.1016/j.pec.2016.12.019.CrossRefGoogle Scholar
Nicolas-Boluda, A, Oppenheimer, A, Bouaziz, J, Fauconnier, A. Patient-reported outcome measures in endometriosis. J Clin Med. 2021;10:5106. doi:10.3390/jcm10215106.CrossRefGoogle ScholarPubMed
Svendsen, M, Ellegaard, T, Jeppesen, K, Riiskjær, E, Nielsen, B. Family involvement and patient-experienced improvement and satisfaction with care: a nationwide cross-sectional study in Danish psychiatric hospitals. BMC Psychiatry. 2021;21:190. doi:10.1186/s12888-021-03179-1.CrossRefGoogle Scholar
Roe, D, Mazor, Y, Gelkopf, M. Patient-reported outcome measurements (PROMs) and provider assessment in mental health: a systematic review of the context of implementation. Int J Qual Health Care. 2022 Mar 28;34(1). doi:10.1093/intqhc/mzz084.CrossRefGoogle Scholar
Fernandes, S, Fond, G, Zendjidjian, X, Michel, P, Lançon, C, Berna, F, et al. A conceptual framework to develop a patient-reported experience measure of the quality of mental health care: a qualitative study of the PREMIUM project in France. J Mark Access Health Policy. 2021;9:1885789. doi:10.1080/20016689.2021.1885789.CrossRefGoogle ScholarPubMed
Kendrick, T, El‐Gohary, M, Stuart, B, Gilbody, S, Churchill, R, Aiken, L, et al. Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database Syst Rev. 2016;2016:CD011119. doi:10.1002/14651858.CD011119.pub2.Google Scholar
Kuzman, MR, Slade, M, Puschner, B, Scanferla, E, Bajic, Z, Courtet, P, et al. Clinical decision-making style preferences of European psychiatrists: results from the ambassadors survey in 38 countries. Eur Psychiatry. 2022;65:e75. doi:10.1192/j.eurpsy.2022.2330.CrossRefGoogle Scholar
de Bienassis, K, Hewlett, E, Kendir, C, Kristensen, S, Mainz, J, Klazinga, N. Establishing standards for assessing patient-reported outcomes and experiences of mental health care in OECD countries: Technical report of the PaRIS mental health working group pilot data collection. Paris: OCDE; 2022. doi:10.1787/e45438b5-en.Google Scholar
Kristensen, S, Holmskov, J, Baandrup, L, Videbech, P, Bonde, M, Mainz, J. Evaluating the implementation and use of patient-reported outcome measures in a mental health hospital in Denmark: a qualitative study. Int J Qual Health Care. 2022 Mar 31;34(Supplement_1)34:ii49–58. doi:10.1093/intqhc/mzab155.CrossRefGoogle Scholar
Arah, OA, Westert, GP, Hurst, J, Klazinga, NS. A conceptual framework for the OECD health care quality indicators project. Int J Qual Health Care. 2006;18(Suppl 1):513. doi:10.1093/intqhc/mzl024.CrossRefGoogle ScholarPubMed
de Bienassis, K, Kristensen, S, Hewlett, E, Roe, D, Mainz, J, Klazinga, N. Patient-reported indicators in mental health care: towards international standards among members of the OECD. Int J Qual Health Care. 2022 Mar 28;34(1). doi:10.1093/intqhc/mzab020.CrossRefGoogle Scholar
Diener, E, Inglehart, R, Tay, L. Theory and validity of life satisfaction scales. Soc Indic Res. 2013;112:497527. doi:10.1007/s11205-012-0076-y.CrossRefGoogle Scholar
Keyes, CLM. The mental health continuum: from languishing to flourishing in life. J Health Soc Behav. 2002;43:207–22.CrossRefGoogle ScholarPubMed
Upton, D, Upton, P. Quality of life and well-being. In: Psychology of wounds and wound care in clinical practice. Cham: Springer International Publishing; 2015, p. 85111. doi:10.1007/978-3-319-09653-7_4.CrossRefGoogle Scholar
Megari, K. Quality of life in chronic disease patients. Health Psychol Res. 2013;1:e27. doi:10.4081/hpr.2013.e27.CrossRefGoogle ScholarPubMed
Nelson, EC, Eftimovska, E, Lind, C, Hager, A, Wasson, JH, Lindblad, S. Patient reported outcome measures in practice. BMJ. 2015;350:g7818. doi:10.1136/bmj.g7818.CrossRefGoogle ScholarPubMed
Aunjitsakul, W, Teetharatkul, T, Vitayanont, A, Liabsuetrakul, T. Does the psychiatrist’s use of subjective well-being measurement in people with schizophrenia provide a better alignment with the patient’s well-being perception than clinical judgement alone? Adm Policy Ment Health. 2021;48:768–79. doi:10.1007/s10488-021-01127-5.CrossRefGoogle Scholar
Shadmi, E, Gelkopf, M, Garber-Epstein, P, Baloush-Kleinman, V, Doudai, R, Roe, D. Routine patient reported outcomes as predictors of psychiatric rehospitalization. Schizophr Res. 2018;192:119–23. doi:10.1016/j.schres.2017.04.049.CrossRefGoogle ScholarPubMed
Mendlovic, S, Roe, D, Markusfeld, G, Mainz, J, Kristensen, S, Goldzweig, G. Exploring the relation between clinician ratings and patient-reported experience and outcomes. Int J Qual Health Care. 2022;34:ii98–104. doi:10.1093/intqhc/mzac004.CrossRefGoogle ScholarPubMed
Lecrubier, Y, Sheehan, D, Weiller, E, Amorim, P, Bonora, I, Harnett Sheehan, K, et al. The MINI international neuropsychiatric interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12:224231.CrossRefGoogle Scholar
Topp, CW, Østergaard, SD, Søndergaard, S, Bech, P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84:167–76. doi:10.1159/000376585.CrossRefGoogle ScholarPubMed
Carrozzino, D, Svicher, A, Patierno, C, Berrocal, C, Cosci, F. The euthymia scale: A clinimetric analysis. Psychother Psychosom. 2019;88:119–21. doi:10.1159/000496230.CrossRefGoogle Scholar
Bech, P, Olsen, LR, Kjoller, M, Rasmussen, NK. Measuring well‐being rather than the absence of distress symptoms: a comparison of the SF‐36 mental health subscale and the WHO‐five well‐being scale. Int J Methods Psychiatr Res. 2003;12:8591. doi:10.1002/mpr.145.CrossRefGoogle Scholar
Bonnín, CM, Yatham, LN, Michalak, EE, Martínez-Arán, A, Dhanoa, T, Torres, I, et al. Psychometric properties of the well-being index (WHO-5) Spanish version in a sample of euthymic patients with bipolar disorder. J Affect Disord. 2018;228:153–9. doi:10.1016/j.jad.2017.12.006.CrossRefGoogle Scholar
Krieger, T, Zimmermann, J, Huffziger, S, Ubl, B, Diener, C, Kuehner, C, et al. Measuring depression with a well-being index: further evidence for the validity of the WHO well-being index (WHO-5) as a measure of the severity of depression. J Affect Disord. 2014;156:240–4. doi:10.1016/j.jad.2013.12.015.CrossRefGoogle ScholarPubMed
Newnham, EA, Hooke, GR, Page, AC. Progress monitoring and feedback in psychiatric care reduces depressive symptoms. J Affect Disord. 2010;127:139–46. doi:10.1016/j.jad.2010.05.003.Google ScholarPubMed
Zigmond, AS, Snaith, RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67:361–70. doi:10.1111/j.1600-0447.1983.tb09716.x.CrossRefGoogle ScholarPubMed
Bjelland, I, Dahl, AA, Haug, TT, Neckelmann, D. The validity of the hospital anxiety and depression scale. J Psychosom Res. 2002;52:6977. doi:10.1016/S0022-3999(01)00296-3.CrossRefGoogle ScholarPubMed
Garner, D. Eating disorder inventory2: Professional manual. Psychological assessment resources. 1991.Google Scholar
Criquillion-Doublet, S, Divac, S, Dardennes, R, Guelfi, JD Le eating disorder inventory (EDI). In: Psychopathologie quantitative. Paris: Masson; 1995, p. 2257–60.Google Scholar
Garner, DM, Olmstead, MP, Polivy, J. Development and validation of a multidimensional eating disorder inventory for anorexia nervosa and bulimia. Int J Eat Disord. 1983;2:1534. doi:10.1002/1098-108X(198321)2:2<15::AID-EAT2260020203>3.0.CO;2-6.3.0.CO;2-6>CrossRefGoogle Scholar
Eberenz, KP, Gleaves, DH. An examination of the internal consistency and factor structure of the eating disorder inventory-2 in a clinical sample. Int J Eat Disord. 1994;16:371–9. doi:10.1002/1098-108X(199412)16:4<371::AID-EAT2260160406>3.0.CO;2-W.3.0.CO;2-W>CrossRefGoogle Scholar
Brown, GK, Beck, AT, Steer, RA, Grisham, JR. Risk factors for suicide in psychiatric outpatients: a 20-year prospective study. J Consult Clin Psychol. 2000;68:371–7. doi:10.1037/0022-006X.68.3.371.CrossRefGoogle ScholarPubMed
Beurs, DPD, de Vries, AL, de Groot, MH, de Keijser, J, Kerkhof, AJ. Applying computer adaptive testing to optimize online assessment of suicidal behavior: a simulation study. J Med Internet Res. 2014;16:e3511. doi:10.2196/jmir.3511.CrossRefGoogle ScholarPubMed
Beck, AT, Steer, RA, Ranieri, WF. Scale for suicide ideation: psychometric properties of a self-report version. J Clin Psychol. 1988;44:499505. doi:10.1002/1097-4679(198807)44:4<499::AID-JCLP2270440404>3.0.CO;2-6.3.0.CO;2-6>CrossRefGoogle ScholarPubMed
Cuyún Carter, GB, Milton, DR, Ascher-Svanum, H, Faries, DE. Sustained favorable long-term outcome in the treatment of schizophrenia: a 3-year prospective observational study. BMC Psychiatry. 2011;11:143. doi:10.1186/1471-244X-11-143.CrossRefGoogle ScholarPubMed
Skevington, SM, Böhnke, JR. How is subjective well-being related to quality of life? Do we need two concepts and both measures? Soc Sci Med. 2018;206:2230. doi:10.1016/j.socscimed.2018.04.005.CrossRefGoogle Scholar
Coelho, A, de Bienassis, K, Klazinga, N, Santo, S, Frade, P, Costa, A, et al. Mental health patient-reported outcomes and experiences assessment in Portugal. Int J Environ Res Public Health. 2022;19:11153. doi:10.3390/ijerph191811153.CrossRefGoogle ScholarPubMed
Doyle, C, Lennox, L, Bell, D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3:e001570. doi:10.1136/bmjopen-2012-001570.CrossRefGoogle ScholarPubMed
Yamaguchi, S, Ojio, Y, Koike, J, Matsunaga, A, Ogawa, M, Tachimori, H, et al. Associations between readmission and patient-reported measures in acute psychiatric inpatients: a study protocol for a multicenter prospective longitudinal study (the ePOP-J study). Int J Ment Health Syst. 2019;13:40. doi:10.1186/s13033-019-0298-3.Google ScholarPubMed
Black, N, Varaganum, M, Hutchings, A. Relationship between patient reported experience (PREMs) and patient reported outcomes (PROMs) in elective surgery. BMJ Qual Saf. 2014;23:534–42. doi:10.1136/bmjqs-2013-002707.CrossRefGoogle Scholar
Dolan, P, Lee, H, Peasgood, T. Losing sight of the wood for the trees: some issues in describing and valuing health, and another possible approach. PharmacoEconomics. 2012;30:1035–49. doi:10.2165/11593040-000000000-00000.CrossRefGoogle ScholarPubMed
Organisation for Economic Co-operation and Development (OECD). OECD guidelines on measuring subjective well-being. OECD, Paris; 2013. doi:10.1787/9789264191655-en.Google Scholar
Attwood, S, Penney, TL, O’Leary, R, Klahn, C, Kelly, B. Measuring wellbeing in a healthcare setting: a qualitative study of staff and service user perspectives. Appl Res Qual Life. 2020;15:127–45. doi:10.1007/s11482-018-9664-6.CrossRefGoogle Scholar
Johnson, S, Dalton‐Locke, C, Baker, J, Hanlon, C, Salisbury, TT, Fossey, M, et al. Acute psychiatric care: approaches to increasing the range of services and improving access and quality of care. World Psychiatry. 2022;21:220–36. doi:10.1002/wps.20962.CrossRefGoogle ScholarPubMed
Causey, DL, McKay, M, Rosenthal, C, Darnell, C. Assessment of hospital-related stress in children and adolescents admitted to a psychiatric inpatient unit. J Child Adolesc Psychiatr Nurs. 1998;11:135–45. doi:10.1111/j.1744-6171.1998.tb00029.x.CrossRefGoogle Scholar
Bejerholm, U, Roe, D. Personal recovery within positive psychiatry. Nord J Psychiatry. 2018;72:420–30. doi:10.1080/08039488.2018.1492015.CrossRefGoogle ScholarPubMed
Miles, S, Nedeljkovic, M, Phillipou, A. Can cognitive flexibility and clinical perfectionism be used to identify people with anorexia nervosa? J Clin Med. 2022;1954:11. doi:10.3390/jcm11071954.Google Scholar
Lerdal, A, Hofoss, D, Gay, CL, Fagermoen, MS. Perception of illness among patients with heart failure is related to their general health independently of their mood and functional capacity. J Patient-Rep Outcomes. 2019;3:55. doi:10.1186/s41687-019-0142-1.CrossRefGoogle ScholarPubMed
Veltkamp, F, Teela, L, van Oers, HA, Haverman, L, Bouts, AHM. The use of patient-reported outcome measures in daily clinical practice of a pediatric nephrology department. Int J Environ Res Public Health. 2022;19:5338. doi:10.3390/ijerph19095338.CrossRefGoogle ScholarPubMed
Figure 0

Figure 1. Flow chart of participants’ selection.

Figure 1

Table 1. Main demographic and clinical characteristics of the population sample (N = 248).

Figure 2

Table 2. Predictors of the variability of subjective well-being: results of linear regression model.

Figure 3

Table 3. Principal component analysis of patient-reported outcome measures of well-being and symptoms change, patient-reported experience of care, and clinician-reported experience of delivered care.

Figure 4

Table 4. Ascending hierarchical clustering: variables with a greater weight according to the v-test in each cluster.

Figure 5

1.

Figure 6

8.

Figure 7

1.

Submit a response

Comments

No Comments have been published for this article.