Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-22T04:42:37.608Z Has data issue: false hasContentIssue false

Understanding mental health help-seeking and stigma among Hungarian adults: A network perspective

Published online by Cambridge University Press:  19 September 2024

Valerie S. Swisher
Affiliation:
The Pennsylvania State University, State College, University Park, PA, USA
Dorottya Őri*
Affiliation:
Institute of Behavioural Sciences, Semmelweis University, Budapest, Hungary
Zoltán Rihmer
Affiliation:
Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary Nyírő Gyula National Institute for Psychiatry and Addictions, Budapest, Hungary
Róbert Wernigg
Affiliation:
National Directorate-General for Hospitals, Budapest, Hungary
*
Corresponding author: Dorottya Őri; Email: [email protected]

Abstract

Background

Hungarians exhibit more negative attitudes toward help-seeking for mental health problems compared to other European countries. However, research on help-seeking in Hungary is limited, and it is unclear how stigma relates to help-seeking when considering demographic and clinical characteristics. We used a network analytic approach to simulate a stigma model using hypothesized constructs in a sizable sample of Hungarian adults.

Methods

Participants were 345 adults recruited from nine primary care offices across Hungary. Participants completed self-report measures assessing public stigma, self-stigma, experiential avoidance (EA), attitudes toward seeking professional psychological help, anxiety, depression, demographics, prior use of mental health services, and whether they have a family member or friend with a mental health condition.

Results

EA and anxiety were the most central nodes in the network. The network also revealed associations between greater EA with greater public stigma, anxiety, depression, and having a family member or friend with a mental health condition. More positive attitudes toward seeking help were associated with lower self-stigma, public stigma, and having received psychological treatment in their lifetime. Being female was associated with lower income, higher education, and having received psychological treatment in their lifetime. Finally, having a family member or friend with a mental health condition was associated with having received psychological treatment in their lifetime and greater public stigma.

Conclusions

The strength centrality and associations of EA with clinical covariates and public stigma implicate its importance in stigma models. Findings also suggest that while some aspects of existing stigma models are retained in countries like Hungary, other aspects may diverge.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of European Psychiatric Association

Introduction

Despite an increased demand for mental health services [Reference Thornicroft, Deb and Henderson1], up to 74% of people experiencing mental illness do not receive treatment in Europe and the USA [Reference Investigators, Alonso, Angermeyer, Bernert, Bruffaerts and Brugha2, Reference Thornicroft3]. Stigma toward mental illness, or the process by which people with mental illness experience implicit or explicit social rejection, is one barrier that contributes to reduced help-seeking [Reference Corrigan and Watson4, Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko and Bezborodovs5]. However, while research on stigma has grown in the last few decades, it largely focuses on American and Western European populations, neglecting other countries that may exhibit different beliefs and values. One example is Eastern Europe, which exhibits some of the highest annual suicide rates worldwide [Reference Rihmer, Gonda, Kapitany and Dome6, Reference Rihmer and Akiskal7]. Hungary, in particular, exhibited the highest suicide rate in the world for the majority of the 1960s to 2000s [Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko and Bezborodovs5, Reference Rihmer and Akiskal7]. Despite this mental health crisis, research on mental health-related stigma is largely limited in Hungary.

Population survey research found that Hungarians exhibit more negative attitudes toward help-seeking for mental health problems and the highest levels of personal stigma relative to participants in Germany, Portugal, and Ireland [Reference Kohls, Coppens, Hug, Wittevrongel, Van Audenhove and Koburger8, Reference Coppens, Van Audenhove, Scheerder, Arensman, Coffey and Costa9]. Additionally, research on post-communist countries suggests that people with mental illness may experience more discrimination in these locations [Reference Harangozo, Reneses, Brohan, Sebes, Csukly and López-Ibor10]. This aligns with research on stigma toward mental illness among psychiatrists, in which Hungary was in the middle between Western European and Eastern European countries based on their stigma scores [Reference Őri, Szocsics, Molnár, Motlova, Kazakova and Mörkl11]. Importantly, despite improved mental health services and initiatives across Hungary in recent years (e.g., [Reference Székely, Konkolÿ Thege, Mergl, Birkás, Rózsa, Purebl and Hegerl12Reference Szanto, Kalmar, Hendin, Rihmer and Mann15]), serial cross-sectional research suggests that there has been no meaningful change in attitudes toward people with mental illness in Hungary [Reference Őri, Szocsics, Molnár, Ralovich, Huszár and Bene16].

While research on stigma in Hungary is limited, research on stigma in other populations can inform conceptualizations of a stigma model among Hungarians. Individuals experience various types of stigma, including self-stigma, expressed as shame toward oneself, and public stigma, defined as perceived societal stereotypes toward mental illness, which both can hinder help-seeking [Reference Vogel, Wade and Hackler17Reference Corrigan and Watson19]. The Internalized Stigma Model suggests that public stigma is internalized as self-stigma over time, predicting help-seeking behavior [Reference Vogel, Wade and Hackler17, Reference Lannin, Vogel, Brenner and Tucker20, Reference Vogel, Bitman, Hammer and Wade21].

Demographic variables, including gender, age, and socioeconomic status, have been examined as predictors of stigma and mental health help-seeking, though the findings are mixed. Men tend to have more negative attitudes toward seeking help, underutilize services, and experience greater self and public stigma relative to females [Reference Gonzalez, Alegria and Prihoda22, Reference Gender23], though other studies find that females report higher perceived stigma relative to males [Reference Griffiths, Christensen and Jorm24Reference Calear, Griffiths and Christensen26]. Regarding age, some studies find that older adults demonstrate more positive attitudes toward help-seeking and lower stigma relative to younger adults [Reference Gonzalez, Alegria and Prihoda22, Reference Mackenzie, Heath, Vogel and Chekay27], though findings remain mixed [Reference Bradbury28, Reference Ward and Heidrich29]. Research also suggests that higher education is associated with decreased stigma [Reference Corrigan and Watson30], but higher income is associated with greater stigma [Reference Foster and O’Mealey31], with some researchers suggesting that higher income individuals may be exposed to resource-rich environments that contribute to a greater likelihood of perceiving mental illness as controllable [Reference Foster and O’Mealey31].

Experiencing mental health symptoms oneself and exposure to others with mental health conditions are other important predictors of stigma and help-seeking. One study found that contact with people with mental illness improved attitudes toward people with mental illness [Reference Corrigan, Morris, Michaels, Rafacz and Rüsch32]. Similarly, greater contact and knowledge of mental illness predicted lower levels of personal stigma toward anxiety and depression [Reference Grant, Bruce and Batterham33]. However, familiarity with mental illness may not always attenuate stigma. Family members of those with mental illness may experience increased burden, which may lead to internalized stereotypes and increased self and public stigma [Reference Corrigan and Nieweglowski34]. Additionally, family members or close friends may experience courtesy stigma, or stigma received due to being associated with someone with mental illness, which may lead family members to have more negative attitudes toward mental illness, thereby increasing stigma. Lastly, personal experience with symptoms may worsen stigmatizing attitudes. Studies have found that those experiencing anxiety and depression were more likely to have greater perceived and self-stigma [Reference Grant, Bruce and Batterham33], and depression severity moderated the relationship between anticipated stigma and treatment seeking over time [Reference Fox, Smith and Vogt35].

Finally, experiential avoidance (EA), or attempts to avoid experiencing unpleasant emotions, thoughts, or feelings, has been examined as a contributor to stigma and reduced help-seeking behavior. EA is a transdiagnostic feature of and highly correlated with emotional disorders (e.g., anxiety, depression) [Reference Spinhoven, Drost, de Rooij, van Hemert and Penninx36] and is associated with increased self-stigma [Reference Donahue, Levin, Olson, Panza and Lillis37]. EA may serve as both a maladaptive coping strategy against stigmas (e.g., avoiding unpleasant feelings associated with experiencing stigma) and as a barrier to help-seeking (e.g., avoiding unpleasant feelings that therapy may evoke). Applications of this conceptualization have found that self-stigma mediates the relationship between public stigma and intentions to seek help, and that this mediation model is moderated by EA [Reference Brenner, Cornish, Heath, Lannin and Losby38]. These authors conclude that, as existing interventions to reduce public and self-stigma have mixed efficacy (e.g., [Reference Corrigan, Morris, Michaels, Rafacz and Rüsch32, Reference Lannin, Guyll, Vogel and Madon39, Reference Mittal, Sullivan, Chekuri, Allee and Corrigan40]), targeting EA may be a novel approach to reducing stigma and increasing help-seeking [Reference Brenner, Cornish, Heath, Lannin and Losby38]. Therefore, the present study used a network analytic approach to simulate a stigma model using hypothesized constructs in a sample of Hungarian patients visiting their primary care providers. Network analysis allows for the simultaneous examination of the partial correlations among all variables to delineate the importance, or strength, of each variable in the network without specifying outcome and predictor variables. Identifying the variable with the greatest strength may be helpful in identifying targets for future anti-stigma interventions. Thereby, network analysis is a data-driven, exploratory approach that allows us to visualize and understand the complex relationships between variables. We examined the association between demographic (age, gender, income, education), stigma (self-stigma, public stigma, attitudes toward seeking help), exposure to mental health (receiving psychological treatment in their lifetime, having a close family member or friend with a mental health condition), and clinical (anxiety, depression, EA) variables to examine the most central nodes (i.e., nodes with the most connections to all other nodes in the network) and relevant associations in a stigma network. In line with research indicating the relevance of EA to both stigma and clinical symptoms, we hypothesized that EA would be the most central node in the network.

Method

Participants

Participants were 345 adults (214 females, 62%), ages 18–85 (M = 46.37, SD = 14.62), recruited from nine primary care offices across four counties of Hungary (Budapest, Heves, Pest, and Borsod-Abaúj-Zemplén). Between November 2023 and February 2024, a member of the research team visited each office at least once and invited all visiting patients to partake in the survey, either by paper, pencil, or online (via Qualtrics). In addition, four of the nine participating primary care doctors emailed survey links to their patient listserv. Participants agreeing to participate completed measures assessing demographics, personal experiences with mental health problems, public stigma, self-stigma, EA, attitudes toward seeking help, anxiety, and depression. Of the 361 patients who consented, 6 were excluded for incompleteness (i.e., completed only the demographics or less) and 10 were excluded due to failed attention checks (e.g., answered anything other than “Very Much So” when asked “Please selected “Very Much So” for this question.”), resulting in a final sample of 345 participants. All study procedures were approved by the local National Scientific and Ethical Committee (TUKEB # BM/30518-1/2023).

One hundred and eleven (32.2%) participants reported having received treatment for their psychological or mental health problems in their lifetime and 52 (15.1%) reported receiving help in the last 12 months. Significantly more females (n = 83) endorsed having received treatment for their psychological or mental health problems in their lifetime relative to males (n = 28), Χ 2 (1, N = 344) = 10.23, p = 0.001. Additionally, 37.7% (n = 130) endorsed having a close family member or friend with a mental health condition. Out of those who endorsed receiving treatment in their lifetime (n = 111), 58 (52.3%) endorsed receiving psychotherapy or counseling and 41 (36.9%) endorsed taking medication. Participants endorsed receiving anxiolytics (n = 21), anti-depressants (n = 15), anti-psychotics (n = 1), and other (n = 5; e.g., “Antihistamines”). See Table 1 for all sample characteristics.

Table 1. Sample demographics and use of psychological services

Note: Percentages are out of all 345 participants including those who left the question unanswered.

Measures

Demographics and experience with mental health

Participants completed a questionnaire assessing age, gender, ethnicity, occupation, education, income, residence (i.e., town, county), and personal experiences with mental health. Personal experience with mental health was assessed using a yes (0) or no (1) response option to the questions, “In [your lifetime/the past 12 months], did you think you needed help for emotional or mental health problems such as feeling sad, blue, anxious, or nervous?” and “In [your lifetime/the past 12 months], have you received any treatment for emotional or mental health problems (e.g., therapy, counseling, medication)?” To assess experience with mental health via a close friend or family member, participants were asked, “Do you have a friend or family member who is experiencing mental illness?” Participants who endorsed receiving mental health treatment in their lifetime were asked to specify the treatment type (e.g., Psychotherapy, Medication, Other) and were allowed to select multiple responses (i.e., both medication and psychotherapy). Participants selecting “Medication” were given an open-ended response option to specify the type of medication received. Open-ended medication responses were coded into four categories: anti-anxiety (e.g., Benzodiazepines); selective serotonin reuptake inhibitors (SSRIs; e.g., Escitalopram); antipsychotic (e.g., Haloperidol); and other.

Attitudes toward seeking professional psychological help-short form (ATSPPH-S)

The ATSPPH-S [Reference Fischer and Farina41] is a 10-item questionnaire measuring attitudes toward help-seeking for psychological problems. Items are rated from 0 (Disagree) to 3 (Agree), with higher scores indicating greater openness and more positive attitudes toward help-seeking. For example, participants were asked, “If I thought I was having a mental breakdown, my first thought would be to get professional attention.” It was translated into Hungarian by Coppens and colleagues (2013), and permission was obtained to use the questionnaire in the present study. Prior studies suggest that the ATSPPH-SF exhibits good test–retest reliability and internal consistency [Reference Fischer and Farina41].

Stigma scale for receiving psychological help (SSRPH)

The SSRPH [Reference Komiya, Good and Sherrod18] is a five-item measure examining individual perceptions from society regarding receiving psychological help (i.e., public stigma). Items are rated from 0 (Strongly Disagree) to 3 (Strongly Agree), with higher scores indicating greater public stigma. For example, participants rated the item, “People tend to like less those who are receiving professional psychological help.” The Hungarian translation was derived from Kiss and colleagues (2020) and exhibited good internal consistency [Reference Kiss, Csekõ-Szél, Gyarmathy and Rácz42].

The acceptance and action questionnaire, version 2 (AAQ-II)

The AAQ [Reference Bond, Hayes, Baer, Carpenter, Guenole and Orcutt43] is a 7-item measure assessing EA. Items are rated on a 7-point Likert scale with higher scores indicating greater EA. For example, participants rated the statement, “I’m afraid of my feelings,” from 1 (Never True) to 7 (Always True). The Hungarian translation exhibits good psychometric properties [Reference Eisenbeck and Szabó-Bartha44].

Self-stigma of seeking help (SSOSH)

The SSOSH [Reference Vogel, Wade and Haake45] is a 10-item measure assessing self-stigma associated with seeking psychological help. Items are rated from 1 (Strongly Disagree) to 5 (Strongly Agree), with higher scores indicating greater self-stigma. For example, participants rated the statement, “I would feel inadequate if I went to a therapist for psychological help.” The English version of the SSOSH exhibits good psychometric properties [Reference Vogel, Wade and Haake45]. The SSOSH was translated into Hungarian by a bilingual professional in psychiatry. It was then back translated into English by another psychiatry professional. The back translated version was compared with the original English version by a third member of the research team, and discrepancies were discussed among the group of three translators. A sample of five native Hungarian speakers then read the Hungarian-translated SSOSH for concept checking. Appendix A provides the full Hungarian translation.

Beck’s Depression Inventory-shortened version (BDI-H)

The Beck Depression Inventory 2nd Edition (BDI-II) [Reference Beck, Steer and Brown46] is a 21-item self-report measure assessing somatic, affective, and behavioral symptoms (e.g., “I am too tired to do anything”) of depression over the prior 2 weeks. Items are rated on a 0-to-3-point scale and summed to yield a total score ranging from 0 (no symptoms) to 63 (very severe symptoms). The BDI-II was converted into a 9-item Hungarian version by Rózsa (2001) and exhibited good internal consistency and reliability [Reference Rózsa, Szádóczky and Furedi47].

State trait anxiety inventory (STAI)

The STAI is a 40-item self-report measure assessing current and trait-level anxiety using a Likert scale from 1 (not at all) to 4 (very much so) [Reference Spielberger48], with higher scores indicating greater anxiety symptoms. Given our interest in anxiety as a trait-level construct, we used the 20-item trait anxiety subscale. For example, participants rated the statement, “I worry too much over something that really does not matter.” We used the Hungarian version of the STAI trait subscale developed by Sipos (1983), which evidenced good reliability and validity [Reference Sipos and Sipos49].

Data analysis

Central tendency and internal consistency of study measures

Central tendency and internal consistency analyses were conducted in R Studio. To examine internal consistency, we used both Cronbach’s alpha and McDonald’s omega. McDonald’s omega employs a factor analytic approach, whereas Cronbach’s alpha is primarily based on item correlations. McDonald’s omega has demonstrated greater robustness to deviations from the aforementioned assumptions, making it generally a more appropriate measure of internal consistency [Reference Dunn, Baguley and Brunsden50].

Network analysis

Descriptive and network analyses were conducted in R Studio. As there were 3.5% missing values and missingness was at random per Little’s test of missing completely at random (MCAR; Χ 2(92) = 101.00, p = .25), missing data was addressed using the default option on the bootnet package’s estimate Network function [Reference Epskamp51]. We used a network analytic approach to examine the associations between demographics, clinical characteristics, stigma, and exposure to mental health. Graphical LASSO models were conducted using the qgraph package [Reference Epskamp, Cramer, Waldorp, Schmittmann and Borsboom52Reference Epskamp and Fried53] using the EBICglasso function [Reference Friedman, Hastie and Tibshirani54Reference Friedman, Hastie and Tibshirani55] to examine the regularized partial correlation (edges) between variables (nodes). A penalty is applied to correlations close to zero, such that likely only more meaningful edges are retained.

Centrality parameters (e.g., strength, closeness, and betweenness) for the network were calculated using qgraph [Reference Epskamp, Cramer, Waldorp, Schmittmann and Borsboom52] to determine the relative importance of each node. Correlation stability coefficients were calculated using bootnet [Reference Epskamp, Maris, Waldorp and Borsboom56] to determine the stability of centrality parameters (e.g., strength, closeness, and betweenness). Coefficients greater than 0.50 indicate adequate stability, with lower stability suggesting that the network is sensitive to sampling changes. As the correlation stability coefficient was poor for closeness (0.05) and betweenness (0.05) and are considered less stable [Reference Epskamp, Borsboom and Fried57], we omitted these indices and focused our interpretation on strength centrality (i.e., the sum of the absolute value of all a node’s edges) which exhibited a good correlation stability coefficient (Strength = 0.75; see Figure S1 in Supplemental Materials). Differences in strength centrality (calculated at p = 0.05 level) were estimated using the differenceTest function in the R package, bootnet [Reference Epskamp, Maris, Waldorp and Borsboom56]. Finally, confidence intervals around edge weights were calculated to examine the accuracy of edges in the network. To examine the stability of strength centrality, centrality indices were recalculated after dropping increasing percentages of participants. A detailed explanation of network stability is available elsewhere [Reference Epskamp, Borsboom and Fried57].

Results

Central tendency, dispersion, and internal consistency of study measures can be found in Table 2. The network is represented in Figure 1. As shown in Figure 2, EA and anxiety demonstrated the greatest strength centrality at 1.72 and 1.55, respectively, and exhibited significantly greater strength centrality than all other nodes in the network, though not from one another (see Supplemental Figure S2 for the difference in degree centrality among all nodes). After controlling for all other nodes in the network, the largest associations that remained were as follows: greater anxiety was associated greater depression (0.46), greater EA (.39), and having received psychological treatment in their lifetime (−0.12); greater EA was associated with having greater public stigma (0.16), having a family member or friend with a mental health condition (−0.11), having received psychological treatment in their lifetime (−0.10), and greater depression (0.22); more positive attitudes toward seeking help was associated with lower self-stigma (−0.27), lower public stigma (−0.11), and having received psychological treatment in their lifetime (−0.17); female sex was associated with lower income (−0.14), having received psychological treatment in their lifetime (−0.16), and higher education (0.12); having a close family member or friend with a mental condition was associated with having received psychological treatment in their lifetime (0.19) and greater public stigma (−0.11). The full list of edge weights is provided in Table 3. All nonregularized partial correlations are shown in Supplemental Table 1. Edge weight stability tests revealed small to moderate confidence intervals around edge weights (see Figure S3 in Supplemental Materials).

Table 2. Central tendency and dispersion of study measures

Abbreviations: M = mean; SD = standard deviation; ATSPPH = attitudes toward seeking professional psychological help; SS = self-stigma; PS = public stigma; EA = experiential avoidance; Anx = anxiety; Dep = depression.

Figure 1. Network consisting of relationships between stigma, clinical characteristics, demographics, and exposure to mental health. Negative correlations are represented in red, and positive correlations are represented in green, with thicker lines representing stronger partial correlations.

Figure 2. Strength Centrality Plot.

Note. Higher scores are indicative of greater centrality in the network. SS = Self-stigma; PS = Public Stigma; MH2 = Has a close family member/friend with a mental health condition; MH1 = Received psychological treatment in their lifetime; Ed = Education; EA = Experiential Avoidance; Dep = Depression; ATSPPH = Attitudes Toward Seeking Professional Psychological Help; Anx = Anxiety.

Table 3. Edge weights from partial correlation network

Abbreviations: ATSPPH = attitudes toward seeking professional psychological help; SS = self-stigma; PS = public stigma; EA = experiential avoidance; Anx = anxiety; Dep = depression; MH1 = received psychological treatment in their lifetime; MH2 = has a close family member/friend with a mental health condition.

Discussion

The present study used a network approach to examine the relationships between demographic variables, stigma, exposure to mental health, clinical symptoms, and EA in a sample of Hungarians visiting their primary care provider. Results indicated that EA and anxiety were the most central nodes in the network. Greater EA was associated with greater public stigma, anxiety, depression, and having a family member or friend with a mental health condition. More positive attitudes toward seeking help were associated with lower self-stigma, public stigma, and having received psychological treatment in their lifetime. Being female was associated with lower income, higher education, and having received psychological treatment in their lifetime. Finally, having a family member or friend with a mental health condition was associated with having received psychological treatment in their lifetime and greater public stigma. Findings highlight important targets (e.g., EA) that may play an important role in conceptualizations of stigma and help-seeking.

In accordance with research on the Internalized Stigma Model [Reference Brenner, Cornish, Heath, Lannin and Losby38], EA was the most central node in the network, indicating its high connectedness with other nodes in the network and thereby, its relevance as a potential target to reducing stigma and increasing help-seeking. Previous research suggests that EA moderates the mediation of self-stigma on public stigma and intentions to seek help [Reference Brenner, Cornish, Heath, Lannin and Losby38]. Extending this, our network suggests that EA may add explanatory value to previously researched associations between demographics and clinical variables with stigma. For example, prior research found associations between younger age and higher personal stigma [Reference Calear, Griffiths and Christensen26], and greater clinical symptoms with higher perceived and self-stigma [Reference Grant, Bruce and Batterham33]. In the present network, age, anxiety, and depression were all indirectly associated with public stigma through EA. These findings suggest that EA may drive the association between clinical and demographic characteristics and stigma found in other studies. Future research should employ longitudinal designs to test EA as a mediator of the associations between clinical symptoms and public stigma and demographic variables and public stigma.

The association between EA and public stigma suggests that EA may be a relevant target in stigma reduction interventions. Interventions targeting EA, such as Acceptance and Commitment Therapy (ACT), may be beneficial. Indeed, research has found that a brief ACT workshop was effective at reducing mental health stigma at 1-month follow up [Reference Masuda, Hayes, Fletcher, Seignourel, Bunting and Herbst58]. ACT has also been used to reduce self-stigma among individuals with substance use disorder [Reference Luoma, Kohlenberg, Hayes, Bunting and Rye59]. Despite the efficacy of these interventions, ACT-based treatment protocols are not commonplace in Hungary, with only one known study examining the efficacy of ACT among a small sample of Hungarian inmates [Reference Eisenbeck, Sheitz and Szekeres60].

Consistent with prior research, our findings suggest that stigma is an important factor in mental health help-seeking, even when accounting for covariates, evidenced through the retained associations between lower self-stigma and more positive attitudes toward seeking psychological help, lower public stigma and more positive attitudes toward seeking psychological help, and having received prior treatment and more positive attitudes toward seeking psychological help. These findings align with research suggesting that mental health stigma is a moderate barrier to help-seeking [Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko and Bezborodovs5], and calls for research on interventions to increase help-seeking by targeting stigma and its correlates (e.g., EA). Moreover, while associations between public stigma and self-stigma typically emerge in cross-sectional stigma models (e.g., [Reference Lannin, Vogel, Brenner and Tucker20, Reference Mackenzie, Heath, Vogel and Chekay27, Reference Brenner, Cornish, Heath, Lannin and Losby38], and longitudinal research finds that public stigma leads to the internalization of self-stigma [Reference Vogel, Bitman, Hammer and Wade21], only a very small association emerged between public stigma and self-stigma in the present study. This suggests that factors beyond societal attitudes play a significant role in shaping individual’s perceptions of themselves and their mental health. It may be due to the characteristics of the sample (patients of primary care providers), cultural differences in the Hungarian sample (i.e., public stigma may not be internalized as self-stigma in this population), and a more robust inclusion of covariates in the present study. To address this, future research should examine differences in the internalization of public stigma as self-stigma across diverse populations. Moreover, the greater strength centrality of self-stigma and its lack of association with public stigma suggests that it may be a more relevant target in stigma-reducing interventions. As such, future research may benefit from examining ways to target self-stigma directly. For example, interventions targeting self-stigma, such as “Coming Out Proud” [Reference Corrigan, Kosyluk and Rüsch61], may be of particular benefit for reducing self-stigma.

Greater public stigma was associated with having a close family member or friend with a mental health condition. This is consistent with research suggesting that family members may have increased public stigma as a result of experiencing the burden of having a family member with a mental health condition [Reference Corrigan and Nieweglowski34]. As noted by Corrigan & Nieweglowski (2019), research is needed to identify how burden contributes to public stigma within specific friend and familial roles (e.g., friends versus parents) and across cultures. As the present study did not operationalize having a close family member with a mental health condition as constituting only immediate family members, it is likely the association with public stigma encompasses relationships beyond immediate family members. Furthermore, having a family member or friend with a mental health condition was associated with greater EA. It is possible that having witnessed the negative effects of mental illness on one’s life, friends and family may be more inclined to avoid negative emotions and experiences that are typically associated with having a mental health condition. Additionally, friends and family members may experience greater shame, stress, and burnout, leading to greater efforts to avoid experiencing these negative feelings.

When controlling for other variables in the network, women were more likely to have higher education but lower income. This is consistent with prior research showing a gender pay gap in Hungary, with the average graduated woman being paid 16% less than the average graduated man [Reference Adamecz-Volgyi62]. Additionally, the network analysis revealed that women were more likely to receive treatment for their mental health than men, irrespective of clinical symptoms. This is consistent with research from several countries around the world, finding that women have more positive attitudes toward seeking psychological help [Reference Gender23, Reference Nam, Chu, Lee, Lee, Kim and Lee63, Reference Mackenzie, Gekoski and Knox64] and are more likely to seek psychological help than men (e.g., [Reference Oliver, Pearson, Coe and Gunnell65]). Taken together, these findings further support an established discrepancy and need for gender and income equality for women in Hungary. Findings also highlight the need for targeted approaches to increase help-seeking in men. Interventions such as the Man Up documentary, a film discussing the association between beliefs about masculinity, men’s mental health, and suicidal thoughts and behaviors, have been efficacious at increasing help-seeking behavior in men [Reference King, Schlichthorst, Spittal, Phelps and Pirkis66] and may warrant more attention among the Hungarian community.

The present study has a number of limitations. First, as a cross-sectional study, we cannot make causal inferences. Future research using longitudinal data to examine the directionality of the associations identified in the present study would be beneficial. Second, while all patients attending their primary care offices on the given study day were invited to participate in the study, it is likely that those with more positive attitudes toward mental health had a greater inclination to participate, potentially skewing stigma ratings. Social desirability bias may have also led to more favorable stigma ratings. Future research would benefit from a larger, randomly selected sample. Third, internal consistency measures were acceptable for all scales except SSOSH, which fell slightly below the acceptable range. For the Hungarian version of the SSOSH, a more thorough investigation of its psychometric properties using factor analysis is recommended for future research. Fourth, as mental health literacy varies considerably across Hungary and the practices selected do not encompass the entirety of this variability, we are limited in our ability to make generalizations about the Hungarian population. Moreover, though our case-dropping bootstrap and prior research on optimal sample sizes in networks with 20 nodes or less [Reference Constantin and Cramer67] suggest that our sample size was adequate, increasing the sample size would improve network estimates and detection of differences in centrality [Reference Epskamp, Borsboom and Fried57]. Lastly, as the sample consisted of those visiting their primary care provider, it is possible that rates of treatment utilization were higher than in the broader community, as those visiting their primary care providers may overrepresent those experiencing chronic mental or physical illnesses.

In summary, findings highlight a need for research on stigma and help-seeking outside of American and Western European countries. Findings suggest that while some aspects of existing stigma models may be consistent in countries like Hungary, other aspects may diverge. Future studies would benefit from path analysis of longitudinal data in order to examine the directionality of associations identified in the present study.

Supplementary material

The supplementary material for this article can be found at http://doi.org/10.1192/j.eurpsy.2024.1772.

Data availability statement

The data that support the findings of this study are available on request from the corresponding author, Dorottya Őri.

Acknowledgements

We would like to thank Nora Aschoff and Felicity Kospiah for their assistance with data collection and cleaning.

Financial support

Ms. Swisher gratefully acknowledges financial support for this research by the Fulbright U.S. Student Program (grant no. 232310), which is sponsored by the U.S. Department of State and Hungarian Fulbright Commission. Its contents are solely the responsibility of the author and do not necessarily represent the official views of the Fulbright Program, the Government of the United States, or the Hungarian Fulbright Commission.

Competing interest

The authors declare no competing interests exist.

Appendix A

Self-Stigma of Seeking Help (SSOSH; Vogel et al., 2006) – Hungarian Translation

Ebben a részben néhány állítást olvashat. Kérjük, jelölje meg azt, hogy mennyire ért egyet az adott állítással. Használja a következő skálát.

References

Thornicroft, G, Deb, T, Henderson, C. Community mental health care worldwide: current status and further developments. World Psychiatry. 2016;15(3):276–86.CrossRefGoogle ScholarPubMed
Investigators, EM, Alonso, J, Angermeyer, M, Bernert, S, Bruffaerts, R, Brugha, T, et al. Use of mental health services in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand. 2004;109:4754.CrossRefGoogle Scholar
Thornicroft, G. Most people with mental illness are not treated. Lancet. 2007;370(9590):807–8.CrossRefGoogle Scholar
Corrigan, PW, Watson, AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1(1):16.Google ScholarPubMed
Clement, S, Schauman, O, Graham, T, Maggioni, F, Evans-Lacko, S, Bezborodovs, N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psycholog Med. 2015;45(1):1127.CrossRefGoogle ScholarPubMed
Rihmer, Z, Gonda, X, Kapitany, B, Dome, P. Suicide in Hungary-epidemiological and clinical perspectives. Ann Gen Psychiatry. 2013;12:113.CrossRefGoogle ScholarPubMed
Rihmer, Z, Akiskal, H. Do antidepressants t (h) reat (en) depressives? Toward a clinically judicious formulation of the antidepressant–suicidality FDA advisory in light of declining national suicide statistics from many countries. J Affect Disord. 2006;94(1–3):313.CrossRefGoogle Scholar
Kohls, E, Coppens, E, Hug, J, Wittevrongel, E, Van Audenhove, C, Koburger, N, et al. Public attitudes toward depression and help-seeking: impact of the OSPI-Europe depression awareness campaign in four European regions. J Affect Disord. 2017;217:252–9.CrossRefGoogle ScholarPubMed
Coppens, E, Van Audenhove, C, Scheerder, G, Arensman, E, Coffey, C, Costa, S, et al. Public attitudes toward depression and help-seeking in four European countries baseline survey prior to the OSPI-Europe intervention. J Affect Disord. 2013;150(2):320–9.CrossRefGoogle Scholar
Harangozo, J, Reneses, B, Brohan, E, Sebes, J, Csukly, G, López-Ibor, J, et al. Stigma and discrimination against people with schizophrenia related to medical services. Int J Soc Psychiatry. 2014;60(4):359–66.CrossRefGoogle ScholarPubMed
Őri, D, Szocsics, P, Molnár, T, Motlova, LB, Kazakova, O, Mörkl, S, et al. Attitudes of psychiatrists towards people with mental illness: a cross-sectional, multicentre study of stigma in 32 European countries. EClinicalMedicine. 2023;66:102342.CrossRefGoogle ScholarPubMed
Székely, A, Konkolÿ Thege, B, Mergl, R, Birkás, E, Rózsa, S, Purebl, G, Hegerl, U. How to decrease suicide rates in both genders? An effectiveness study of a community-based intervention (EAAD). PLoS One. 2013;8(9):e75081.CrossRefGoogle ScholarPubMed
Kopp, M, Szekely, A, Bagi, M. The Hungarian alliance against depression: strengthening social capital in the intervention region. Inj Prev. 2010;16(Suppl 1):A232–A.CrossRefGoogle Scholar
Wernigg, R, Toth, M, Sumegi, A. Demonstrating the methodology of a pilot programme for establishing a system for mental health promotion in Hungary. European Psychiatry. 2017;41(S1):S741–S42.CrossRefGoogle Scholar
Szanto, K, Kalmar, S, Hendin, H, Rihmer, Z, Mann, JJ. A suicide prevention program in a region with a very high suicide rate. Arch Gen Psychiatry. 2007;64(8):914–20.CrossRefGoogle Scholar
Őri, D, Szocsics, P, Molnár, T, Ralovich, FV, Huszár, Z, Bene, Á, et al. Stigma towards mental illness and help-seeking behaviors among adult and child psychiatrists in Hungary: a cross-sectional study. PLoS One. 2022;17(6):e0269802.CrossRefGoogle ScholarPubMed
Vogel, DL, Wade, NG, Hackler, AH. Perceived public stigma and the willingness to seek counseling: the mediating roles of self-stigma and attitudes toward counseling. J Couns Psychol. 2007;54(1):40.CrossRefGoogle Scholar
Komiya, N, Good, GE, Sherrod, NB. Stigma scale for receiving psychological Help. J Couns Psychol. 2000;47(1):138143. doi: 10.1037/0022-0167.47.1.138CrossRefGoogle Scholar
Corrigan, PW, Watson, AC. The paradox of self-stigma and mental illness. Clin Psychol. 2002;9(1):35.Google Scholar
Lannin, DG, Vogel, DL, Brenner, RE, Tucker, JR Predicting self-esteem and intentions to seek counseling: the internalized stigma model. Couns Psychol. 2015;43(1):6493.CrossRefGoogle Scholar
Vogel, DL, Bitman, RL, Hammer, JH, Wade, NG. Is stigma internalized? The longitudinal impact of public stigma on self-stigma. J Couns Psychol. 2013;60(2):311.CrossRefGoogle ScholarPubMed
Gonzalez, JM, Alegria, M, Prihoda, TJ. How do attitudes toward mental health treatment vary by age, gender, and ethnicity/race in young adults? J Community Psychol. 2005;33(5):611–29.CrossRefGoogle Scholar
Gender, TN. Self-stigma, and public stigma in predicting attitudes toward psychological help-seeking. Educ Sci. 2014;14(2):480–7.Google Scholar
Griffiths, KM, Christensen, H, Jorm, AF. Predictors of depression stigma. BMC Psychiatry. 2008;8(1):112.CrossRefGoogle ScholarPubMed
Jorm, AF, Wright, A. Influences on young people’s stigmatising attitudes towards peers with mental disorders: national survey of young Australians and their parents. Br J Psychiatry. 2008;192(2):144–9.CrossRefGoogle Scholar
Calear, AL, Griffiths, KM, Christensen, H. Personal and perceived depression stigma in Australian adolescents: magnitude and predictors. J Affect Disord. 2011;129(1–3):104–8.CrossRefGoogle ScholarPubMed
Mackenzie, CS, Heath, PJ, Vogel, DL, Chekay, R. Age differences in public stigma, self-stigma, and attitudes toward seeking help: a moderated mediation model. J Clin Psychol. 2019;75(12):2259–72.CrossRefGoogle ScholarPubMed
Bradbury, A. Mental health stigma: the impact of age and gender on attitudes. Community Ment Health J. 2020;56(5):933–8.CrossRefGoogle ScholarPubMed
Ward, EC, Heidrich, SM. African American women’s beliefs about mental illness, stigma, and preferred coping behaviors. Res Nurs Health. 2009;32(5):480–92.CrossRefGoogle ScholarPubMed
Corrigan, PW, Watson, AC. The stigma of psychiatric disorders and the gender, ethnicity, and education of the perceiver. Community Ment Health J. 2007;43:439–58.CrossRefGoogle ScholarPubMed
Foster, S, O’Mealey, M. Socioeconomic status and mental illness stigma: the impact of mental illness controllability attributions and personal responsibility judgments. J Ment Health. 2022;31(1):5865.CrossRefGoogle ScholarPubMed
Corrigan, PW, Morris, SB, Michaels, PJ, Rafacz, JD, Rüsch, N. Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatr Serv. 2012;63(10):963–73.CrossRefGoogle ScholarPubMed
Grant, JB, Bruce, C, Batterham, PJ. Predictors of personal, perceived and self-stigma towards anxiety and depression. Epidemiol Psychiatr Sci. 2016;25(3):247–54.CrossRefGoogle Scholar
Corrigan, PW, Nieweglowski, K. How does familiarity impact the stigma of mental illness? Clin Psychol Rev. 2019;70:4050.CrossRefGoogle ScholarPubMed
Fox, AB, Smith, BN, Vogt, D. How and when does mental illness stigma impact treatment seeking? Longitudinal examination of relationships between anticipated and internalized stigma, symptom severity, and mental health service use. Psychiatry Res. 2018;268:1520.CrossRefGoogle ScholarPubMed
Spinhoven, P, Drost, J, de Rooij, M, van Hemert, AM, Penninx, BW. A longitudinal study of experiential avoidance in emotional disorders. Behav Ther. 2014;45(6):840–50.CrossRefGoogle ScholarPubMed
Donahue, ML, Levin, ME, Olson, K, Panza, E, Lillis, J. Examining the role of experiential avoidance and valued action in the negative effects of weight self-stigma. J Behav Med. 2023;46(3):517–24.CrossRefGoogle ScholarPubMed
Brenner, RE, Cornish, MA, Heath, PJ, Lannin, DG, Losby, MM. Seeking help despite the stigma: experiential avoidance as a moderated mediator. J Couns Psychol. 2020;67(1):132.CrossRefGoogle ScholarPubMed
Lannin, DG, Guyll, M, Vogel, DL, Madon, S. Reducing the stigma associated with seeking psychotherapy through self-affirmation. J Couns Psychol. 2013;60(4):508.CrossRefGoogle ScholarPubMed
Mittal, D, Sullivan, G, Chekuri, L, Allee, E, Corrigan, PW. Empirical studies of self-stigma reduction strategies: a critical review of the literature. Psychiatr Serv. 2012;63(10):974–81.CrossRefGoogle ScholarPubMed
Fischer, EH, Farina, A. Attitudes toward seeking professional psychologial help: a shortened form and considerations for research. J Coll Character. 1995;36:368–73.Google Scholar
Kiss, D, Csekõ-Szél, A, Gyarmathy, V, Rácz, J. Associations of time perspectives and attitudes towards seeking professional psychological help. Polish Psychol Bull. 2020;51:6270.Google Scholar
Bond, FW, Hayes, SC, Baer, RA, Carpenter, KM, Guenole, N, Orcutt, HK, et al. Preliminary psychometric properties of the Acceptance and Action Questionnaire–II: a revised measure of psychological inflexibility and experiential avoidance. Behav Ther. 2011;42(4):676–88.CrossRefGoogle ScholarPubMed
Eisenbeck, N, Szabó-Bartha, A. Validation of the Hungarian version of the Acceptance and Action Questionnaire-II (AAQ-II). J Contextual Behav Sci. 2018;9:80–7.CrossRefGoogle Scholar
Vogel, DL, Wade, NG, Haake, S. Measuring the self-stigma associated with seeking psychological help. J Couns Psychol. 2006;53(3):325.CrossRefGoogle Scholar
Beck, AT, Steer, RA, Brown, GK. Beck depression inventory (BDI-II). London, UK: Pearson; 1996.Google Scholar
Rózsa, S, Szádóczky, E, Furedi, J. Psychometric properties of the Hungarian version of the shortened Beck Depression Inventory. Psychiatr Hung. 2001;16(4):384402.Google Scholar
Spielberger, CD. Manual for the State-Trait Anxiety Inventory (self-evaluation questionnaire). 1970.Google Scholar
Sipos, K, Sipos, M. The development and validation of the Hungarian Form of the State-Trait Anxiety Inventory. Ser Clin Community Psychol. 1983;2:2739.Google Scholar
Dunn, TJ, Baguley, T, Brunsden, V. From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br J Psychol. 2014;105(3):399412.CrossRefGoogle Scholar
Epskamp, S, Cramer, AO, Waldorp, LJ, Schmittmann, VD, Borsboom, D. qgraph: network visualizations of relationships in psychometric data. J Stat Softw. 2012;48:118.CrossRefGoogle Scholar
Epskamp, S, Fried, EI. A tutorial on regularized partial correlation networks. Psychol Methods. 2018;23(4):617.CrossRefGoogle ScholarPubMed
Friedman, J, Hastie, T, Tibshirani, R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008;9(3):432–41.CrossRefGoogle ScholarPubMed
Friedman, J, Hastie, T, Tibshirani, R. glasso: graphical lasso-estimation of Gaussian graphical models. R package version 1.8. 2014.Google Scholar
Epskamp, S, Maris, G, Waldorp, LJ, Borsboom, D. Network psychometrics. In The Wiley handbook of psychometric testing: a multidisciplinary reference on survey, scale and test development. Chichester:: John Wiley & Sons, Ltd. 2018;953–86.CrossRefGoogle Scholar
Epskamp, S, Borsboom, D, Fried, EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. 2018;50:195212.CrossRefGoogle ScholarPubMed
Masuda, A, Hayes, SC, Fletcher, LB, Seignourel, PJ, Bunting, K, Herbst, SA, et al. Impact of acceptance and commitment therapy versus education on stigma toward people with psychological disorders. Behav Res Ther. 2007;45(11):2764–72.CrossRefGoogle ScholarPubMed
Luoma, JB, Kohlenberg, BS, Hayes, SC, Bunting, K, Rye, AK. Reducing self-stigma in substance abuse through acceptance and commitment therapy: model, manual development, and pilot outcomes. Addict Res Theory. 2008;16(2):149–65.CrossRefGoogle ScholarPubMed
Eisenbeck, N, Sheitz, K, Szekeres, B. A brief acceptance and commitment therapy-based intervention among violence-prone male inmates delivered by novice therapists. Psychol Soc Educ. 2016;8(3):187–99.CrossRefGoogle Scholar
Corrigan, PW, Kosyluk, KA, Rüsch, N. Reducing self-stigma by coming out proud. Am J Public Health. 2013;103(5):794800.CrossRefGoogle ScholarPubMed
Adamecz-Volgyi, A. Is there a glass ceiling in Hungary? Gender wage gap by educational attainment. Budapest, Hungary: Institute of Economics, Centre for Economic and Regional Studies, Hungarian Academy of Sciences; 2019.Google Scholar
Nam, SK, Chu, HJ, Lee, MK, Lee, JH, Kim, N, Lee, SM. A meta-analysis of gender differences in attitudes toward seeking professional psychological help. J Am Coll Health. 2010;59(2):110–6.CrossRefGoogle ScholarPubMed
Mackenzie, CS, Gekoski, WL, Knox, VJ. Age, gender, and the underutilization of mental health services: the influence of help-seeking attitudes. Aging Ment Health. 2006;10(6):574–82.CrossRefGoogle ScholarPubMed
Oliver, MI, Pearson, N, Coe, N, Gunnell, D. Help-seeking behaviour in men and women with common mental health problems: cross-sectional study. Br J Psychiatry. 2005;186(4):297301.CrossRefGoogle ScholarPubMed
King, KE, Schlichthorst, M, Spittal, MJ, Phelps, A, Pirkis, J. Can a documentary increase help-seeking intentions in men? A randomised controlled trial. J Epidemiol Community Health. 2018;72(1):92–8.CrossRefGoogle Scholar
Constantin, M. Cramer, AOJ Sample Size Recommendations for Estimating Cross-Sectional Network Models. [Dissertation]. Tilburg: Tilburg University (uvt.nl). Available online at: https://arno.uvt.nl/show.cgi?fid=149724. 2018.Google Scholar
Figure 0

Table 1. Sample demographics and use of psychological services

Figure 1

Table 2. Central tendency and dispersion of study measures

Figure 2

Figure 1. Network consisting of relationships between stigma, clinical characteristics, demographics, and exposure to mental health. Negative correlations are represented in red, and positive correlations are represented in green, with thicker lines representing stronger partial correlations.

Figure 3

Figure 2. Strength Centrality Plot.Note. Higher scores are indicative of greater centrality in the network. SS = Self-stigma; PS = Public Stigma; MH2 = Has a close family member/friend with a mental health condition; MH1 = Received psychological treatment in their lifetime; Ed = Education; EA = Experiential Avoidance; Dep = Depression; ATSPPH = Attitudes Toward Seeking Professional Psychological Help; Anx = Anxiety.

Figure 4

Table 3. Edge weights from partial correlation network

Supplementary material: File

Swisher et al. supplementary material

Swisher et al. supplementary material
Download Swisher et al. supplementary material(File)
File 341.2 KB
Submit a response

Comments

No Comments have been published for this article.