Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-21T22:57:27.011Z Has data issue: true hasContentIssue false

Mental health of Irish adolescents following the COVID-19 pandemic: results from a population-based cross-sectional survey

Published online by Cambridge University Press:  19 September 2024

Niamh Dooley*
Affiliation:
Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin, Ireland Faculty of Life Sciences & Medicine, King’s College London, London, UK
Emmet Power
Affiliation:
Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin, Ireland
Hazel Healy
Affiliation:
Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin, Ireland
David Cotter
Affiliation:
Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin, Ireland
Mary Cannon
Affiliation:
Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin, Ireland
*
Corresponding author: N. Dooley; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objectives:

This study provides data on the prevalence of mental health problems among adolescents in Ireland in 2021, toward the end of the COVID-19 pandemic. The importance of having recent, large-scale, mental health data for adolescents has been heightened by COVID-19, the increased demand for child and adolescent mental health services, and the rapidly changing adolescent environment.

Methods:

As part of the Planet Youth study, a cross-sectional survey of adolescents (N = 4,404), mostly aged 15–16, was conducted between September and December 2021. Participants were recruited from 40 schools and non-traditional educational centres across 3 regions in Ireland, one predominantly urban (North Dublin) and two predominantly rural (Cavan, Monaghan). A range of mental health outcomes were self-reported: a single-item question on mental health; the Strengths & Difficulties Questionnaire (SDQ); depressive and anxiety symptoms from the Symptom Check List 90; the Adolescent Psychotic-like Symptom Screener; and lifetime self-harm, suicidal ideation, and attempt.

Results:

Over a quarter of adolescents described their mental health as ‘bad’ or ‘very bad’ (29%), and had SDQ total problem scores over 20 (26%). Over a third (39%) reported self-harming, 42% reported suicidal ideation, and 11% reported attempting suicide, in their lifetime. Gender-diverse youth (non-binary, trans, and undisclosed) had higher rates of poor mental health outcomes compared to cis-gendered youth (male/female), and females had higher rates of most mental health outcomes compared to males.

Conclusions:

Many of these estimates suggest a deterioration from previous epidemiological studies. While our findings do not definitively prove youth mental health has worsened over time, these findings are highly concerning. We propose a close monitoring of mental health in future surveys of this population and encourage initiatives to improve the capacity and quality of youth mental health services.

Type
Original Research
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re- use, distribution and reproduction, provided the original article is properly cited.
Copyright
© Royal College of Surgeons in Ireland, 2024. Published by Cambridge University Press on behalf of College of Psychiatrists of Ireland

Introduction

Young people aged 10–24 years make up 27% of the world’s population, and their wellbeing is central to the functioning of society and the economy (United Nations 2009). However, a great threat to mortality and morbidity among young people today is mental disorder (Erskine et al., Reference Erskine, Moffitt, Copeland, Costello, Ferrari, Patton, Degenhardt, Vos, Whiteford and Scott2015, Liu et al., Reference Liu, Villavicencio, Yeung, Perin, Lopez, Strong and Black2022, Piao et al., Reference Piao, Huang, Han, Li, Xu, Liu and He2022).

There is international evidence that mental health among adolescents and young people has worsened over the past decade. This has been observed in repeated cross-sectional surveys and healthcare data from: the United Kingdom (NHS Digital 2022), Iceland (Thorisdottir et al., Reference Thorisdottir, Asgeirsdottir, Sigurvinsdottir, Allegrante and Sigfusdottir2017), Canada (Wiens et al., Reference Wiens, Bhattarai, Pedram, Dores, Williams, Bulloch and Patten2020), and the United States (CDC 2023, Weinberger et al., Reference Weinberger, Gbedemah, Martinez, Nash, Galea and Goodwin2018). Females between 16 and 19 years old have been identified as a growing high-risk group for anxiety, depression, and self-harm (NHS Digital 2022, Slee et al., Reference Slee, Nazareth, Freemantle and Horsfall2021, Thorisdottir et al., Reference Thorisdottir, Agustsson, Oskarsdottir, Kristjansson, Asgeirsdottir, Sigfusdottir, Valdimarsdottir, Allegrante and Halldorsdottir2023, Thorisdottir et al., Reference Thorisdottir, Asgeirsdottir, Sigurvinsdottir, Allegrante and Sigfusdottir2017).

Trends in mental health problems among young people in Ireland are less clear, because there is a lack of repeated survey data (Lynch et al., Reference Lynch, McDonnell, Leahy, Gavin and McNicholas2023). However, the following lines of evidence suggest rising mental health problems, both prior to, and during, the COVID-19 pandemic:

  1. 1. The MyWorld surveys investigated mental health problems in large samples of young people in Ireland in 2012 and 2018/2019. In that 6–7-year period, there was roughly a doubling in the proportion of adolescents aged 12–18 with severe depression (from 8 to 15%) and anxiety (11 to 22%). Further, the proportion of post-secondary school young people (aged 17–25) who had attempted suicide in their lifetime had increased from 7 to 10% (Dooley et al., Reference Dooley, Fitzgerald and Giollabhui2015, Reference Dooley, O’Connor, Fitzgerald and O’Reilly2019).

  2. 2. The Growing Up in Ireland study has tracked two cohorts of children, one born in 1998 and one born in 2008 (Ns > 8,000). At age 13, the 2008-born cohort had more mental health problems compared to the 1998-born cohort, as evidenced by a 2.5% increase on the parent-reported SDQ total difficulties scale (1 point on the 40-item scale; Growing Up in Ireland 2023, Williams et al., Reference Williams, Thornton, Morgan, Quail, Smyth, Murphy and O’Mahony2018).

  3. 3. Planet Youth West is a repeated cross-sectional survey of young people from Galway, Mayo, and Roscommon (N ∼5,000 at each wave). Average trends across its three waves (2018, 2020, 2022) suggest declining mental health and wellbeing, and increases in depressive/anxiety symptoms in this region (Silke et al., Reference Silke, Brady and Heary2024a). However, rates of self-harm, suicidal thoughts, and suicidal attempt appear to have dropped between 2020 and 2022 (Silke et al., Reference Silke, Heary, Bunting, Devaney, Groarke, Major, Durcan, O’Brien and Brady2024b).

  4. 4. The National Suicide Research Foundation in Ireland reports annual statistics on self-harm and suicide. The latest reports show that self-harm has been more common among young people (aged 15–30) than any other age groups for the past 19 years, and that the age of onset of self-harm is decreasing (Griffin et al., Reference Griffin, Dillon, Arensman, Corcoran, Williamson and Perry2017, Reference Griffin, McMahon, McNicholas, Corcoran, Perry and Arensman2018).

  5. 5. The number of crisis psychiatry assessments of adolescents in Irish hospitals rose significantly between 2019 and 2021 (McLoughlin et al., Reference McLoughlin, Abdalla, Gonzalez, Freyne, Asghar and Ferguson2022). Referrals to specialist CAMHS units in Dublin also showed an increase between 2019 and 2020 (McNicholas et al., Reference McNicholas, Kelleher, Hedderman, Lynch, Healy, Thornton, Barry, Kelly, McDonald, Holmes, Kavanagh and Migone2021).

The population data above (#1–3) suggest worsening mental health among young people nationally, and clinical data suggests this is translating to increased demand for services (#4–5). However there remains large gaps in knowledge. For instance, while hospital presentation data are useful, they represent the tip of the iceberg of population-level mental health problems. There is an urgent need to investigate mental health symptoms in the general population of young people using recently collected data. Further, the importance of collecting data since 2020 is highlighted by studies showing the disproportionate effect the COVID-19 pandemic had on the mental health of young people (Czeisler et al., Reference Czeisler, Lane, Petrosky, Wiley, Christensen, Njai, Weaver, Robbins, Facer-Childs, Barger, Czeisler, Howard and Rajaratnam2020; GOV.UK, 2022). Between 2020 and 2021, adolescents in Ireland had experienced two extended periods of school closures (Mar–Jun 2020; Dec 2020–Mar 2021), which was more than many other European countries (Fig. 1), but the mental health of this group has not been systematically investigated since.

This study assesses the prevalence of mental health problems in over 4,000 adolescents in Ireland, from youth-report surveys conducted between September and December 2021. The timing of this survey in relation to COVID-related school closures is illustrated in Fig. 1. This study reports the first wave of a survey series which will be repeated every 2 years.

Figure 1. Time of data collection (grey) in context of planned (black) and unplanned (red) school closures in Ireland (2020–2021).

The primary aim was to identify the prevalence of mental health problems, as measured by standardised scales of general mental health, depressive and anxiety symptoms, and self-reported rates of self-harm, suicidal ideation, and suicidal attempt. The secondary aim was to explore variation in mental health across several demographic factors (gender, geographic location, family socioeconomics). Finally, given the timing of this survey, we explore whether the effects of COVID-19 lockdowns on various aspects of life was associated with mental health.

Methods

Study design, participants & setting

The current study follows a wider study model known as Planet Youth, based on the Icelandic Prevention Model. The model includes a research and an intervention phase, to ultimately reduce substance use and mental health problems among adolescents (Kristjansson et al., Reference Kristjansson, Mann, Sigfusson, Thorisdottir, Allegrante and Sigfusdottir2020; Sigfusdottir et al., Reference Sigfusdottir, Soriano, Mann and Kristjansson2019). In Ireland, the Planet Youth model was first adopted in 2018 with youth surveys across Galway, Mayo, and Roscommon (https://planetyouth.ie) and was subsequently adopted in North County Dublin, Cavan, and Monaghan in 2021 (https://planetyouthpartner.ie). Surveys are repeated in these communities biannually. The study is designed to understand risk and protective factors for substance use and mental health problems among adolescents.

The data used in this study was collected from young people between September and December 2021 in North Dublin, Cavan, and Monaghan. All schools & YouthReach centres (non-traditional secondary educational settings) in these areas were invited to participate in the survey by local partner organisations (see acknowledgments). The survey was primarily aimed at students in 4th (‘Transition Year’) and 5th year at school, and comparable groups in YouthReach centres. Figure 1 illustrates the timing of data collection in the context of COVID-19 related school closures.

Survey completion took approximately 60 minutes, during school time. Teachers delivered standardised instructions on administering the survey, and members of the study team assisted in the delivery. Young people watched a short instructional video on how to complete the survey, in which they were informed they did not have to answer questions they were uncomfortable with.

Of the invited schools and institutions, 75% in the urban area and 100% in the rural area took part (40 in total). Of invited students, 75% in the urban area and 86% in the rural area participated (4,404 in total). Average participation rate among young people was 79%.

Consent & ethics

Informed consent was achieved through an opt-out consent form, sent home to parents via young people. Informed assent (opt-out) was also sought from adolescents. Prior to circulating consent forms, parents received information about the survey via community events and digital communication. A recording of this information was also made available on the study website. Opt-out consent is in line with best practice in anonymous low-risk youth risk behaviour surveys (Cheng et al., Reference Cheng, Savageau, Sattler and DeWitt1993; Mathews et al., Reference Mathews, MacMillan, Meinck, Finkelhor, Haslam, Tonmyr, Gonzalez, Afifi, Scott, Pacella, Higgins, Thomas, Collin-Vézina and Walsh2022; Petersen and Leffert Reference Petersen and Leffert1995; Santelli et al., Reference Santelli, Rosenfeld, DuRant, Dubler, Morreale, English and Rogers1995). Alternative activities were arranged for students not participating in the survey.

After survey completion, participants were provided information on mental health, social care, and wellbeing services in their community. Mandated child protection reporters and a consultant child & adolescent psychiatrist were available during survey collection. The Research Ethics Committee of the Royal College of Physicians in Ireland (RECSAF 144) granted ethical approval.

Measures

Subjectively bad mental health

Participants were asked ‘How would you rate your mental health?’ and responded on a 5-point Likert scale. For simplicity, responses were dichotomised into ‘Bad’/‘Very Bad’, and ‘Okay’/‘Good’/‘Very good’.

Strengths and Difficulties Questionnaire (SDQ)

The Strengths and Difficulties Questionnaire (SDQ) is widely used screening tool designed to assess emotional and behavioural problems in young people. The total problems scale combines information from 20 items and ranges from 0 to 40. Response options are ‘not true’, ‘somewhat true’, and ‘certainly true’. The total problems scale from the self-report version of the SDQ is a valid measure of mental health in adolescents aged 14–18 (Goodman et al., Reference Goodman, Meltzer and Bailey2003, Lundh et al., Reference Lundh, Wångby-Lundh and Bjärehed2008, Muris et al., Reference Muris, Meesters and van den Berg2003, Vugteveen et al., Reference Vugteveen, de Bildt, Theunissen, Reijneveld and Timmerman2021). Scores of 20 or above are considered ‘very high’, while scores of 18 or above are considered ‘high’, with respect to population norms (https://www.sdqinfo.org/py/sdqinfo/c0.py).

Depressive & anxiety symptoms

Twelve items from the depressive and anxiety dimensions of the Symptom Check List 90 were included (SCL-90; Derogatis Reference Derogatis1973, Derogatis et al., Reference Derogatis, Lipman, Covi and Rickels1972). These 12 items were selected by the Planet Youth study coordination team in Iceland, and are included in many other Planet Youth surveys internationally. For each item, participants indicated how often they experienced the symptom in the past week (almost never, rarely, sometimes, often; scored as 0,1,2,3). Depressive symptoms included low appetite, loneliness, tearfulness, and hopelessness, while anxiety symptoms included nervousness, sudden fear and tension (Table S3). Symptom scales are reported separately for depression (0–27) and anxiety (0–9), and on a combined scale (range: 0-36). Thorisdottir et al. (Reference Thorisdottir, Asgeirsdottir, Sigurvinsdottir, Allegrante and Sigfusdottir2017) found good internal consistency for the 9-item depressive subscale (Cronbach’s α = .91) and 3-item anxiety subscale (Cronbach’s α = 0.78) across 43,482 adolescents in Iceland. We also found good internal consistency for these subscales (Depressive α = .91; Anxiety α = .87) and for the combined total in our sample (α = .93; McDonald’s hierarchical ω = .84).

Psychotic-like experiences (PLEs)

The 7-item Adolescent Psychotic-like Symptom Screener (APSS) was used to capture hallucinations and delusions, and has been specifically validated for use among adolescents (Kelleher et al., Reference Kelleher, Harley, Murtagh and Cannon2011). Each item was scored with 0, 0.5, and 1 reflecting ‘not true’, ‘somewhat true’, and ‘certainly true’. A total score was calculated (0–7). Those with a score of 2 or more were considered an ‘at-risk’ group for clinically significant PLEs, in line with Kelleher et al. (Reference Kelleher, Harley, Murtagh and Cannon2011).

Lifetime suicidality and self-harm

Lifetime self-harm was captured by the question: ‘During your lifetime, how often have you harmed yourself on purpose (e.g. scratching, burning, cutting…)’. Response options included ‘Never’, ‘Once’, ‘Twice’, ‘3-4 times’ and ‘5 times or more’ but were dichotomised into ‘Never’ and ‘At least once’. Lifetime suicidal ideation was captured by the question ‘Have you ever had suicidal thoughts?’ and lifetime suicidal attempt was captured by ‘Have you ever attempted suicide?’. Response options for both suicidality questions were yes/no.

Predictors

Gender identity. Participants were asked ‘How would you describe your gender’ and had four response options: male, female, non-binary and/or trans, or prefer not to say. The latter two options were combined into an ‘other’ group representing non-cis genders and questioning youth.

Geographical area. Counties involved in this study were classed as urban (North Dublin), and rural (Cavan and Monaghan) based on population density and geographic location.

Family socioeconomics. Three variables were chosen to control for the child’s socioeconomic background: maternal education level below third level (i.e. primary or secondary education only); participant ethnicity other than ‘White Irish’; and relative financial difficulty. The latter was assessed by the question ‘How well off financially do you think your family is in comparison to other families’ with those responding ‘worse off’ considered to be experiencing relative financial difficulty.

Negative impact of COVID-19 lockdown. Participants were asked ‘How did the COVID-19 lockdown effect the following areas of your life?’ with areas including family relationships, friend relationships, physical health, mental health, and school experience. Responses were provided on a 5-point scale (‘A lot worse’, ‘A bit worse’, ‘No change’, ‘A bit better’, and ‘A lot better’). These responses were dichotomised such that those responding ‘A lot worse’ or ‘A bit worse’ were considered to have experienced negative effects on the area in question.

Statistical analysis

We provide tables of means, standard deviations and prevalence’s across all mental health measures for the full sample and selected sub-groups (split by gender, age-group, and geographical area), to allow comparison with other studies.

Using logistic mixed models, we included demographic factors (gender, age, geographic location), socioeconomic factors (maternal education, relative household poverty, ethnicity), and perceived impacts of the COVID-19 pandemic, as predictors of each outcome. Variation in mental health across participating schools (n = 40) was captured using a random intercept. Given the multiple outcomes, a Bonferroni-corrected p-threshold was used to highlight significant predictors (0.05/7 = 0.007).

Results

Seventy-five percent of participants were aged 15–16 years, 95% identified as cis-gendered (male/female), 83.5% were born in Ireland, and 70% identified their ethnicity as White Irish. The majority (57.8%) of this sample felt their mental health had worsened throughout the COVID-19 pandemic (Table 1). Across all mental health measures, there was a gender gradient such that adolescents with non-cis gender identities had the highest symptom scores, or highest rates of poor outcomes, followed by females, and then males (Fig. 2).

Table 1. Descriptive statistics of sample characteristics

a Non-binary, trans, or preferred not to say.

b Chi-square test.

*p < .05 **p < .01 ***p < .001.

Figure 2. A common gender-based pattern across various mental health outcomes (unadjusted group differences)[endif].

General mental health

Over a quarter of adolescents described their mental health as ‘bad’ or ‘very bad’ (28.58%). A similar proportion scored in the ‘very high’ range of the SDQ total problems scale (25.53%; Table 2). Significant risk factors for subjectively bad mental health included having a non-cis gender identity (OR = 9.44, 95% CI = 6.26–14.24), being female (OR = 2.80, 95% CI = 2.35–3.34), relative household poverty (OR = 2.23, 95% CI = 1.75–2.85), having experienced negative effects of COVID-19 on family relationships (OR = 1.86, 95% CI = 1.54–2.23), friend relationships (OR = 1.46, 95% CI = 1.22–1.74), physical health (OR = 1.76, 95% CI = 1.48–2.09) and on school experience (OR = 1.43, 95% CI = 1.18–1.72; Table 3). Most of these factors also predicted scoring in the very high range of the SDQ (Table 3).

Table 2. Descriptive statistics (prevalence/mean score) for various mental health outcomes

Table 3. Multivariate model predicting six binary mental health outcomes. Estimates are adjusted odds ratios (and their 95% confidence interval)

a Urban = North County Dublin; reference ‘rural’ group = Monaghan and Cavan.

b Participant considers their family worse off than others.

c Mother completed primary or secondary school, but no further education.

d SDQ total problems score of 20 or more.

e APSS score of 2 or more.

§ p < .05 (not significant at Bonferroni-corrected threshold).

*p < .007 (Bonferroni-corrected threshold).

**p < .001.

Depression & anxiety symptoms

Mean score on the SCL-90 scale of depression and anxiety was 16 (range: 0–36; Table 2). Significant predictors of higher SCL-90 scores were: having a non-cis gender (B = 9.99, SE = 0.72, p < .001), being female (B = 7.60, SE = 0.30, p < .001), relative household poverty (B = 3.26, SE = 0.45, p < .001), living in an urban area (B = 2.49, SE = 0.52, p < .001), and negative impacts of COVID-19 on each included area of life: family relationships (B = 2.56, SE = 0.33, p < .001); friend relationships (B = 2.05, SE = 0.31, p < .001); physical health (B = 2.68, SE = 0.30, p < .001); and school experience (B = 1.60, SE = 0.30, p < .001).

PLEs

Mean score on the APSS scale of PLEs was 1.32 (range: 0–7), and just over 29% of the sample scored 2+ (clinically significant PLEs; Table 2). Risk factors for clinically significant PLEs included non-cis gender (OR = 2.46, 95% CI = 1.69–3.58), urban geographical location (OR = 1.63, 95% CI = 1.30–2.03), relative household poverty (OR = 1.73, 95% CI = 1.37–2.19), minority ethnicity (OR = 1.50, 95% CI = 1.26–1.80), and having experienced negative effects of COVID-19 on relationships with family (OR = 1.60, 95% CI = 1.33–1.91) and friends (OR = 1.46, 95% CI = 1.23–1.73; Table 3).

Self-harm & suicidality

The rate of lifetime self-harm was 38.75% in this adolescent sample (Table 2). Odds of self-harm were elevated for females (OR = 2.74, 95% CI = 2.34–3.21) and non-cis genders (OR = 6.37, 95% CI = 4.21–9.67) compared to males. The odds of self-harm were also higher in urban geographical settings (OR = 1.57, 95% CI = 1.26–1.95), homes experiencing relative poverty (OR = 1.75, 95% CI = 1.38–2.23), and ethnic minorities (OR = 1.52, 95% CI = 1.28–1.81). Negative experiences of COVID-19 on physical health, and relationships with family and friends, were also associated with increased odds of self-harm (ORs between 1.42 and 1.61; Table 3).

The prevalence of lifetime suicidal ideation and attempt was 42 and 11% respectively (Table 2). Common predictors of both ideation and attempt were: female gender (ORs: 2.11–2.15), non-cis gender (ORs: 5.62–6.70), relative household poverty (ORs: 2.06–2.29), minority ethnicity (ORs: 1.63–1.76), and having experienced negative impact of COVID-19 on physical health (ORs: 1.47-1.51) and family relationships (ORs: 1.75–1.77). Factors associated with an increased risk of suicidal ideation, but not attempt, included urban geographical location (OR = 1.30, 95% CI = 1.07–1.58) and negative impact of COVID-19 on friend relationships (OR = 1.45, 95% CI = 1.23–1.70). Low maternal education was significantly associated with an increased risk of suicidal attempt, but no other outcome (OR = 1.57, 95% CI = 1.23–2.00; Table 3).

Supplementary Table S1 shows the unadjusted prevalence of all mental health outcomes, split by gender, age, and geographical area. A correlation heatmap in supplementary Figure S1 shows that there was significant overlap between all mental health measures in this study. Of note, more negative responses on the single-item measure of general mental health ‘how would you rate your mental health?’ (very bad, bad, okay, etc.) were significantly correlated with higher total problem scores on the SDQ (r(3871) = 0.58, p < .001), the anxiety and depressive total from the SCL-90 (r(4170) = 0.70, p < .001) and the APSS total score (r(3879) = 0.26, p < .001).

Discussion

This study provides an important update on adolescent mental health in Ireland, following the COVID-19 pandemic. Our findings suggest that the mental health of this cohort is considerably poorer than noted in previous epidemiological studies in Ireland.

Prevalence of mental health issues in context

The rates of many mental health problems were higher than other studies of young people in Ireland. In Table S2 we compare our findings to Irish studies which were comparable in terms of sample age and mental health measures used, some of which are summarised below.

Approximately 29% of adolescents in this 2021 survey said their mental health was ‘bad’ or ‘very bad’ compared to 21% of adolescents answering the same question in 2020 from the West of Ireland (Table S2). Similarly, over 25% of participants in this study scored ‘very high’ on the SDQ (>20), indicating high risk for a diagnosable mental disorder (Goodman et al., Reference Goodman, Meltzer and Bailey2003, Lundh et al., Reference Lundh, Wångby-Lundh and Bjärehed2008, Muris et al., Reference Muris, Meesters and van den Berg2003, Vugteveen et al., Reference Vugteveen, de Bildt, Theunissen, Reijneveld and Timmerman2021). These values are higher than the range provided by a recent systematic review on the prevalence of mental disorders in Irish children (Lynch et al., Reference Lynch, McDonnell, Leahy, Gavin and McNicholas2023), which suggested 4.8–17.8% of children and adolescents in Ireland score above the clinical cut-offs on screening questionnaires indicative of mental disorder.

The average ‘total problems’ score from the SDQ (15.0) in this study is also higher than the sample average from the Northern Ireland Youth Wellbeing Study (11–16-year-olds) conducted in 2019–2020 (10.1; Bunting et al., Reference Bunting, McCartan, Davidson, Grant, Mulholland, Schubotz, McBride, Murphy and Shevlin2022) and approximately double the parent-reported average from the Growing Up in Ireland study cohorts (6.5–8.0; Table S2).

Average anxiety and depression scores in this sample were 4.5 and 11.5 respectively, as measured by the 12-item version of the SCL-90. In comparison, a repeated youth survey in Iceland (2006–2016) also used a 12-item version of the SCL-90, and found average anxiety scores ranged from 1.9 to 2.5, and depression scores ranged from 6.2 to 7.3, depending on the year (Thorisdottir et al., Reference Thorisdottir, Asgeirsdottir, Sigurvinsdottir, Allegrante and Sigfusdottir2017). That study also showed that the rise in depressive and anxiety symptoms over time (2006–2016) was accelerated in females, compared to males. Further waves of these Icelandic and Irish surveys will clarify whether these results represent an effect of country (symptoms in Ireland > Iceland), chronological time (symptoms in 2021 > 2016), or both.

While PLEs are relatively common in childhood and can be harmless, individuals reporting PLEs in childhood/adolescence have a 3-fold increased risk for developing a mental disorder, compared to those without PLEs (Healy et al., Reference Healy, Brannigan, Dooley, Coughlan, Clarke, Kelleher and Cannon2019). We found that 29% of this sample reported clinically relevant PLEs (scores of 2+ on the APSS) in the past 6 months. This value is more than double the prevalence rates suggested by previous studies in Ireland (Table S2) and is triple the prevalence rates suggested by international meta-analyses (9.8% among 11–18-year-olds [Healy et al., Reference Healy, Brannigan, Dooley, Coughlan, Clarke, Kelleher and Cannon2019]; 7.5% among 13–18-year-olds [Kelleher et al., Reference Kelleher, Connor, Clarke, Devlin, Harley and Cannon2012]). The reason for this large difference is currently unclear, but we recommend close surveillance of PLEs in future surveys of this population. In future waves of this survey (2023, 2025), we plan to include more detailed questions around the PLEs (e.g. distress experienced).

The average rate of lifetime deliberate self-harm was 39% in this sample (and 50% among females). This is higher than the average for adolescents aged 12–19 in the MyWorld2 survey (23%) and more similar to the that observed among young people aged 18–25 in MyWorld2 (38%; Dooley et al., Reference Dooley, O’Connor, Fitzgerald and O’Reilly2019). This cross-study comparison supports recent findings from the National Self-harm Registry, that the age of onset of self-harm is decreasing in Ireland (Griffin et al., Reference Griffin, Dillon, Arensman, Corcoran, Williamson and Perry2017, Joyce et al., Reference Joyce, Chakraborty, O’Sullivan, Daly, McTiernan, Nicholson, Arensman, Williamson and Corcoran2020), and is consistent with reports that more adolescents are presenting to acute hospital services with self-harm since COVID-19 (The Irish Times 2023, Wong et al., Reference Wong, Cross, Zavaleta-Ramírez, Bauda, Hoffman and Ibeziako2023). These worrying trends highlight the need for preventative interventions in youth settings in Ireland which are effective in preventing self-harm.

Rates of lifetime suicidal ideation (42%) were similar to those found by the MyWorld2 survey, conducted several years prior (2018-9). In that survey, 41% of adolescents between 12 and 19 years responded ‘yes’ to the question ‘Have you ever thought about taking your life, even though you would not do it?’ (Dooley et al., Reference Dooley, O’Connor, Fitzgerald and O’Reilly2019). Other youth mental health surveys have phrased the question on suicidal ideation with a stronger focus on intent (e.g. ‘Did you ever seriously consider attempting suicide?’) and these studies have observed lower rates of endorsement (∼20%; Centers for Disease Control and Prevention 2023; Planet Youth West https://planetyouth.ie). This emphasises the importance of question wording when comparing rates of suicidal ideation across studies. We have included additional questions on suicidal ideation in our 2023 survey, to improve comparability with other studies.

Rates of lifetime suicidal attempt observed in this study (11%) were higher than all previous Irish adolescent estimates, including the MyWorld2 survey (6%; Dooley et al., Reference Dooley, O’Connor, Fitzgerald and O’Reilly2019), Planet Youth West (8–9%; Table S2) and the Saving and Empowering Young Lives in Europe study (4%; McMahon et al., Reference McMahon, O’Regan, Corcoran, Arensman, Cannon, Williamson and Keeley2017). It may be that differences in the sample age and calendar year in which data was collected explain differences in rates of suicidal attempt across studies (Table S2). However, there is also international evidence that youth suicide attempts are increasing since the early 2010s, particularly in the United States (Centers for Disease Control and Prevention 2023, Van Meter et al., Reference Van Meter, Knowles and Mintz2023). The potential rising trend of suicidal attempt among Irish adolescents is of grave concern and requires close monitoring, particularly as Ireland already has the 4th highest teenage suicide rate among EU/OECD countries (Brazier Reference Brazier2017).

Gender differences

Across all mental health outcomes included in this study, the strongest predictor of each was having “other” or non-cis gender identity (trans, non-binary, undisclosed). There is therefore a significant mental health risk associated with gender-diverse identities, even after controlling for other well-known risk factors such as household financial deprivation, and the effects of COVID-19 (Table 3). Males had the lowest rates of all poor mental health outcomes, those identifying as non-binary/trans had the highest, and females had intermediate rates (Fig. 2).

Particularly concerning among the non-binary/trans group were the high prevalence of lifetime self-harm (73%) and suicidal attempt (36%). International evidence strongly supports the association between trans or non-conforming gender identity and mental health difficulties in youth (Becerra-Culqui et al., Reference Becerra-Culqui, Liu, Nash, Cromwell, Flanders, Getahun, Giammattei, Hunkeler, Lash, Millman, Quinn, Robinson, Roblin, Sandberg, Silverberg, Tangpricha and Goodman2018; Anderssen et al., Reference Anderssen, Sivertsen, Lønning and Malterud2020) as does the limited data from Ireland (Cullinan et al., Reference Cullinan, Walsh, Flannery and Kennelly2022; Kearns et al., Reference Kearns, O’Shea and Neff2022). As increasing numbers of young people are identifying as trans and non-binary in contemporary Ireland (Arcelus et al., Reference Arcelus, Bouman, Van Den Noortgate, Claes, Witcomb and Fernandez-Aranda2015, Judge et al., Reference Judge, O’Donovan, Callaghan, Gaoatswe and O’Shea2014), this should be a key group of concern for mental health policy and community interventions.

COVID-19 as a potential explanation

The proximity of this survey to the COVID-19 pandemic may partially explain why we found relatively high rates of many mental health outcomes in this sample (Fig. 1). Future waves of this survey (2023, 2025) will determine the extent to which these results were specific to teenagers in 2021.

Over half of participants reported that COVID-19 had detrimental effects on their mental health (Table 1). Of all investigated areas of mental health, a worsening of family relationships was the COVID-19-related effect most strongly related to poor mental health outcomes (Table 3). This is consistent with previous literature on the strong impact of child-parental conflict on adolescent psychopathology, generally (Healy et al., Reference Healy, Eaton, Cotter, Carter, Dhondt and Cannon2022) and in the context of COVID-19 (Sinko et al., Reference Sinko, He, Kishton, Ortiz, Jacobs and Fingerman2022). In the event of another pandemic, national social services should consider additional supports for children and adolescents in households with a history of parent-child conflict and parent mental health problems.

Strengths & Limitations

The strengths of this study include (1) the inclusive recruitment of seldom-heard voices of young people from non-traditional school settings (i.e. Youthreach); (2) use of the SDQ, which is well-validated and highly utilised in international youth mental health research; (3) control for potential confounds such as effects of the COVID-19 pandemic and socioeconomic factors; and (4) conservative acknowledgement of multiple testing with correlated outcomes (Bonferroni).

The limitations of the study are that: (1) the sample was not random selected from all youth in Ireland and 21% of invited young people did not consent to take part, limiting national generalisability; (2) our list of mental health outcomes was not exhaustive, for instance not capturing eating or neurodevelopmental disorders; and (3) some children with reading or attentional problems may have been less likely to complete the survey accurately or fully, which may bias results. Future waves of this survey will screen for special education needs, learning disabilities and neurodevelopmental conditions.

Conclusion

Our results suggest higher rates of mental health problems among adolescents in Ireland than previously estimated. The consequences of rising emotional problems, self-harm, and suicidality among young people in Ireland may be disastrous, both in terms of human and economic costs. Our results point to a need for careful monitoring of these trends, and improved community-level youth mental health services.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/ipm.2024.16.

Acknowledgements

We wish to thank all young people who participated in the Planet Youth survey, as well as the school staff and study administrators that facilitated it. Many thanks also the Planet Youth Implementation Team for North Dublin, Cavan and Monaghan (https://planetyouthpartner.ie), including those from the Cavan and Monaghan Education and Training Board (Maureen McIntyre), the North Dublin Regional Drug and Alcohol Task Force (Bríd Walsh, David Creed), the North Eastern Regional Drug & Alcohol Task Force (Andy Ogle), and TUSLA (Ste Corrigan, Collette Deeney).

Financial support

This study was funded by the Health Research Board, via an Investigator-Led Project grant to MC and ND (ILP-PHR-2019-009); a Collaborative Doctoral Award to EP (‘YouLead’; 18210A01 to EP) and Investigator-Led Project grants to DC (ILP-POR-2017-039; ILP-POR 2019-0005). DC was also funded by Science Foundation Ireland (16/RC/3948) and co-funded under the European Regional Development Fund and by FutureNeuro industry partners. This study was also funded by the Royal College of Surgeons in Ireland via a Research Summer Studentship to HH.

Competing interests

The authors declare none.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committee on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. The authors assert that ethical approval for publication of this study has been provided by their local Ethics Committee.

Footnotes

*

Niamh Dooley and Emmet Power were joint first authors.

References

Anderssen, N, Sivertsen, B, Lønning, KJ, Malterud, K (2020). Life satisfaction and mental health among transgender students in Norway. BMC Public Health 20, 138.Google Scholar
Arcelus, J, Bouman, WP, Van Den Noortgate, W, Claes, L, Witcomb, G, Fernandez-Aranda, F (2015). Systematic review and meta-analysis of prevalence studies in transsexualism. European Psychiatry 30, 807815.Google Scholar
Becerra-Culqui, TA, Liu, Y, Nash, R, Cromwell, L, Flanders, WD, Getahun, D, Giammattei, SV, Hunkeler, EM, Lash, TL, Millman, A, Quinn, VP, Robinson, B, Roblin, D, Sandberg, DE, Silverberg, MJ, Tangpricha, V, Goodman, M (2018). Mental health of transgender and gender nonconforming youth compared with their peers. Pediatrics 141, e20173845.Google Scholar
Brazier, C (2017). Building the Future: Children and the Sustainable Development Goals in Rich Countries. Innocenti Report Card 14. ERIC.Google Scholar
Bunting, L, McCartan, C, Davidson, G, Grant, A, Mulholland, C, Schubotz, D, McBride, O, Murphy, J, Shevlin, M (2022). Rationale and methods of the ‘Northern Ireland Youth Wellbeing Survey’ and initial findings from the Strengths and Difficulties Questionnaire. Clinical Child Psychology and Psychiatry 27, 670685. doi:10.1177/13591045221075525.Google Scholar
Centers for Disease Control & Prevention (2023). Youth Risk Behavior Survey: Data Summary & Trends Report (2011-2021). Centers for Disease Control and Prevention: US.Google Scholar
Cheng, TL, Savageau, JA, Sattler, AL, DeWitt, TG (1993). Confidentiality in health care: a survey of knowledge, perceptions, and attitudes among high school students. JAMA 269, 14041407.Google Scholar
Cullinan, J, Walsh, S, Flannery, D, Kennelly, B (2022). A cross-sectional analysis of psychological distress among higher education students in Ireland. Irish Journal of Psychological Medicine, 19. doi:10.1017/ipm.2022.2.Google Scholar
Czeisler, M, Lane, RI, Petrosky, E, Wiley, JF, Christensen, A, Njai, R, Weaver, MD, Robbins, R, Facer-Childs, ER, Barger, LK, Czeisler, CA, Howard, ME, Rajaratnam, SMW (2020). Mental health, substance use, and suicidal ideation during the COVID-19 pandemic - United States, June 24-30, 2020, MMWR Morbidity and Mortality Weekly Report 69, 10491057.Google Scholar
Derogatis, LR (1973). SCL-90: an outpatient psychiatric rating scale-preliminary report. Psychopharmacology Bulletin 9, 1328.Google Scholar
Derogatis, LR, Lipman, RS, Covi, L, Rickels, K (1972). Factorial invariance of symptom dimensions in anxious and depressive neuroses. Archives of General Psychiatry 27, 659665.Google Scholar
Dooley, B, Fitzgerald, A, Giollabhui, NM (2015). The risk and protective factors associated with depression and anxiety in a national sample of Irish adolescents. Irish Journal of Psychological Medicine 32, 93105.Google Scholar
Dooley, B, O’Connor, C, Fitzgerald, A, O’Reilly, A (2019). My World Survey 2: The National Study of Youth Mental Health in Ireland. University College Dublin & Jigsaw: Dublin, Irelaand.Google Scholar
Erskine, HE, Moffitt, TE, Copeland, WE, Costello, EJ, Ferrari, AJ, Patton, G, Degenhardt, L, Vos, T, Whiteford, HA, Scott, JG (2015). A heavy burden on young minds: the global burden of mental and substance use disorders in children and youth. Psychological Medicine 45, 15511563.Google Scholar
Goodman, R, Meltzer, H, Bailey, V (2003). The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. International review of psychiatry 15, 173177.Google Scholar
GOVUK (2022). COVID-19 Mental Health and Wellbeing Surveillance: Report. Chapter 4: Children and Young People. Office for Health Improvement and Disparities: London.Google Scholar
Griffin, E, Dillon, C, Arensman, E, Corcoran, P, Williamson, E, Perry, IJ (2017). National Self-Harm Registry Ireland Annual Report 2016. National Suicide Research Foundation: Cork.Google Scholar
Griffin, E, McMahon, E, McNicholas, F, Corcoran, P, Perry, IJ, Arensman, E (2018). Increasing rates of self-harm among children, adolescents and young adults: a 10-year national registry study 2007-2016. Social Psychiatry and Psychiatric Epidemiology 53, 663671.Google Scholar
Growing Up in Ireland (2023). Key Findings: Cohort ’08 at 13 Years. Department of Children, Equality, Disability, Integration and Youth (Government of Ireland): Dublin.Google Scholar
Healy, C, Brannigan, R, Dooley, N, Coughlan, H, Clarke, M, Kelleher, I, Cannon, M (2019). Childhood and adolescent psychotic experiences and risk of mental disorder: a systematic review and meta-analysis. Psychological Medicine 49, 15891599.Google Scholar
Healy, C, Eaton, A, Cotter, I, Carter, E, Dhondt, N, Cannon, M (2022). Mediators of the longitudinal relationship between childhood adversity and late adolescent psychopathology. Psychological Medicine 52, 36893697.Google Scholar
Joyce, M, Chakraborty, S, O’Sullivan, G, Daly, C, McTiernan, N, Nicholson, S, Arensman, E, Williamson, E, Corcoran, P (2020). National Self-harm Registry Ireland: Annual Report 2020. National Suicide Research Foundation: Cork.Google Scholar
Judge, C, O’Donovan, C, Callaghan, G, Gaoatswe, G, O’Shea, D (2014). Gender dysphoria-prevalence and co-morbidities in an Irish adult population. Frontiers in Endocrinology 5, 87.Google Scholar
Kearns, S, O’Shea, D, Neff, K (2022). Transgender and non-binary demographics, referrals, and comorbidities among young Irish adults (2014-2020. Irish Journal of Medical Science 192, 16791685.Google Scholar
Kelleher, I, Connor, D, Clarke, MC, Devlin, N, Harley, M, Cannon, M (2012). Prevalence of psychotic symptoms in childhood and adolescence: a systematic review and meta-analysis of population-based studies. Psychological Medicine 42, 18571863.Google Scholar
Kelleher, I, Harley, M, Murtagh, A, Cannon, M (2011). Are screening instruments valid for psychotic-like experiences? A validation study of screening questions for psychotic-like experiences using in-depth clinical interview. Schizophrenia Bulletin 37, 362369.Google Scholar
Kristjansson, AL, Mann, MJ, Sigfusson, J, Thorisdottir, IE, Allegrante, JP, Sigfusdottir, ID (2020). Development and guiding principles of the Icelandic model for preventing adolescent substance use. Health Promotion Practice 21, 6269.Google Scholar
Liu, L, Villavicencio, F, Yeung, D, Perin, J, Lopez, G, Strong, KL, Black, RE (2022). National, regional, and global causes of mortality in 5-19-year-olds from 2000 to 2019: a systematic analysis. The Lancet Global Health 10, e337e347.Google Scholar
Lundh, L-G, Wångby-Lundh, M, Bjärehed, J (2008). Self-reported emotional and behavioral problems in swedish 14 to 15-year-old adolescents: a study with the self-report version of the strengths and difficulties questionnaire. Scandinavian Journal of Psychology 49, 523532.Google Scholar
Lynch, S, McDonnell, T, Leahy, D, Gavin, B, McNicholas, F (2023). Prevalence of mental health disorders in children and adolescents in the Republic of Ireland: a systematic review. Irish Journal of Psychological Medicine 40, 5162.Google Scholar
Mathews, B, MacMillan, HL, Meinck, F, Finkelhor, D, Haslam, D, Tonmyr, L, Gonzalez, A, Afifi, TO, Scott, JG, Pacella, RE, Higgins, DJ, Thomas, H, Collin-Vézina, D, Walsh, K (2022). The ethics of child maltreatment surveys in relation to participant distress: implications of social science evidence, ethical guidelines, and law. Child Abuse & Neglect 123, 105424.Google Scholar
McLoughlin, A, Abdalla, A, Gonzalez, J, Freyne, A, Asghar, M, Ferguson, Y (2022). Locked in and locked out: sequelae of a pandemic for distressed and vulnerable teenagers in Ireland: post-COVID rise in psychiatry assessments of teenagers presenting to the emergency department out-of-hours at an adult Irish tertiary hospital. Irish Journal of Medical Science, 18.Google Scholar
McMahon, EM, O’Regan, G, Corcoran, P, Arensman, E, Cannon, M, Williamson, E, Keeley, H (2017). Young Lives in Ireland: a school-based study of mental health and suicide prevention.Google Scholar
McNicholas, F, Kelleher, I, Hedderman, E, Lynch, F, Healy, E, Thornton, T, Barry, E, Kelly, L, McDonald, J, Holmes, K, Kavanagh, G, Migone, M (2021). Referral patterns for specialist child and adolescent mental health services in the Republic of Ireland during the COVID-19 pandemic compared with 2019 and 2018. BJPsych Open 7, e91.Google Scholar
Muris, P, Meesters, C, van den Berg, F (2003). The Strengths and Difficulties Questionnaire (SDQ): further evidence for its reliability in a community sample of Dutch children and adolescents. European Child & Adolescent Psychiatry 12, 18.Google Scholar
NHS Digital (2022). Mental Health of Children and Young People in England 2022 - Wave 3 Follow up to the 2017 Survey. NHS Digital: London.Google Scholar
Petersen, AC, Leffert, N (1995). Developmental issues influencing guidelines for adolescent health research: a review. Journal of Adolescent Health 17, 298305.Google Scholar
Piao, J, Huang, Y, Han, C, Li, Y, Xu, Y, Liu, Y, He, X (2022). Alarming changes in the global burden of mental disorders in children and adolescents from 1990 to 2019: a systematic analysis for the Global Burden of Disease study. European Child & Adolescent Psychiatry 31, 18271845.Google Scholar
Santelli, JS, Rosenfeld, WD, DuRant, RH, Dubler, N, Morreale, M, English, A, Rogers, AS (1995). Guidelines for adolescent health research: a position paper of the society for adolescent medicine. Journal of Adolescent Health 17, 270276.Google Scholar
Sigfusdottir, ID, Soriano, HE, Mann, MJ, Kristjansson, AL (2019). Prevention is possible: a brief history of the origin and dissemination of the Icelandic prevention model. Health Promotion Practice 21, 5861.Google Scholar
Silke, C, Brady, B, Heary, C (2024a). Adolescent Mental Health & Adversity: Profiles & Trends in the West of Ireland from 2018-2022. UNESCO Child & Family Research Centre: Galway, Ireland.Google Scholar
Silke, C, Heary, C, Bunting, B, Devaney, C, Groarke, A, Major, E, Durcan, M, O’Brien, C, Brady, B (2024b). Examining the relationship between adversity and suicidality and self-harm in Irish adolescents from 2020 to 2022. Journal of Affective Disorders 349, 234243.Google Scholar
Sinko, L, He, Y, Kishton, R, Ortiz, R, Jacobs, L, Fingerman, M (2022). The stay at home order is causing things to get heated up: family conflict dynamics during COVID-19 from the perspectives of youth calling a national child abuse hotline. Journal of Family Violence 37, 837846.Google Scholar
Slee, A, Nazareth, I, Freemantle, N, Horsfall, L (2021). Trends in generalised anxiety disorders and symptoms in primary care: UK population-based cohort study. The British Journal of Psychiatry 218, 158164.Google Scholar
The Irish Times (2 January 2023). Children’s hospitals seeing ‘astronomical’ number of young people self-harming. The Irish Times (Online).Google Scholar
Thorisdottir, IE, Agustsson, G, Oskarsdottir, SY, Kristjansson, AL, Asgeirsdottir, BB, Sigfusdottir, ID, Valdimarsdottir, HB, Allegrante, JP, Halldorsdottir, T (2023). Effect of the COVID-19 pandemic on adolescent mental health and substance use up to March, 2022, in Iceland: a repeated, cross-sectional, population-based study. The Lancet Child & Adolescent Health 7, 347357.Google Scholar
Thorisdottir, IE, Asgeirsdottir, BB, Sigurvinsdottir, R, Allegrante, JP, Sigfusdottir, ID (2017). The increase in symptoms of anxiety and depressed mood among Icelandic adolescents: time trend between 2006 and 2016. European Journal of Public Health 27, 856861.Google Scholar
United Nations. (2009). World Population Prospects: The 2008 Revision. United Nations: New York.Google Scholar
Van Meter, AR, Knowles, EA, Mintz, EH (2023). Systematic review and meta-analysis: international prevalence of suicidal ideation and attempt in youth. Journal of the American Academy of Child & Adolescent Psychiatry 62, 973986.Google Scholar
Vugteveen, J, de Bildt, A, Theunissen, M, Reijneveld, SA, Timmerman, M (2021). Validity aspects of the strengths and difficulties questionnaire (SDQ) adolescent self-report and parent-report versions among Dutch adolescents. Assessment 28, 601616.Google Scholar
Weinberger, AH, Gbedemah, M, Martinez, AM, Nash, D, Galea, S, Goodwin, RD (2018). Trends in depression prevalence in the USA from 2005 to 2015: widening disparities in vulnerable groups. Psychological Medicine 48, 13081315.Google Scholar
Wiens, K, Bhattarai, A, Pedram, P, Dores, A, Williams, J, Bulloch, A, Patten, S (2020). A growing need for youth mental health services in Canada: examining trends in youth mental health from 2011 to 2018. Epidemiology and Psychiatric Sciences 29, e115.Google Scholar
Williams, J, Thornton, M, Morgan, M, Quail, A, Smyth, E, Murphy, D, O’Mahony, D (2018). Growing Up in Ireland: The Lives of 13-Year-Olds. Department for Children and Youth Affairs: Dublin, Ireland.Google Scholar
Wong, BH, Cross, S, Zavaleta-Ramírez, P, Bauda, I, Hoffman, P, Ibeziako, P, et al. (2023). Self-harm in children and adolescents who presented at emergency units during the COVID-19 pandemic: an international retrospective cohort study. Journal of the American Academy of Child and Adolescent Psychiatry 62, 9981009.Google Scholar
Figure 0

Figure 1. Time of data collection (grey) in context of planned (black) and unplanned (red) school closures in Ireland (2020–2021).

Figure 1

Table 1. Descriptive statistics of sample characteristics

Figure 2

Figure 2. A common gender-based pattern across various mental health outcomes (unadjusted group differences)[endif].

Figure 3

Table 2. Descriptive statistics (prevalence/mean score) for various mental health outcomes

Figure 4

Table 3. Multivariate model predicting six binary mental health outcomes. Estimates are adjusted odds ratios (and their 95% confidence interval)

Supplementary material: File

Dooley et al. supplementary material

Dooley et al. supplementary material
Download Dooley et al. supplementary material(File)
File 89.9 KB