Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-22T13:19:46.278Z Has data issue: false hasContentIssue false

Environmental context predicts state fluctuations in negative symptoms in youth at clinical high risk for psychosis

Published online by Cambridge University Press:  29 May 2023

Lauren Luther*
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
Ian M. Raugh
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
Delaney E. Collins
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
Alysia Berglund
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
Anna R. Knippenberg
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
Vijay A. Mittal
Affiliation:
Department of Psychology, Northwestern University, Evanston, IL, USA
Elaine F. Walker
Affiliation:
Department of Psychology, Emory University, Atlanta, GA, USA
Gregory P. Strauss*
Affiliation:
Department of Psychology, University of Georgia, Athens, GA, USA
*
Corresponding authors: Gregory P. Strauss, Lauren Luther; Email: [email protected], [email protected]
Corresponding authors: Gregory P. Strauss, Lauren Luther; Email: [email protected], [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Negative symptoms (avolition, anhedonia, asociality) are a prevalent symptom in those across the psychosis-spectrum and also occur at subclinical levels in the general population. Recent work has begun to examine how environmental contexts (e.g. locations) influence negative symptoms. However, limited work has evaluated how environments may contribute to negative symptoms among youth at clinical high risk for psychosis (CHR). The current study uses Ecological Momentary Assessment to assess how four environmental contexts (locations, activities, social interactions, social interaction method) impact state fluctuations in negative symptoms in CHR and healthy control (CN) participants.

Methods

CHR youth (n = 116) and CN (n = 61) completed 8 daily surveys for 6 days assessing negative symptoms and contexts.

Results

Mixed-effects modeling demonstrated that negative symptoms largely varied across contexts in both groups. CHR participants had higher negative symptoms than CN participants in most contexts, but groups had similar symptom reductions during recreational activities and phone call interactions. Among CHR participants, negative symptoms were elevated in several contexts, including studying/working, commuting, eating, running errands, and being at home.

Conclusions

Results demonstrate that negative symptoms dynamically change across some contexts in CHR participants. Negative symptoms were more intact in some contexts, while other contexts, notably some used to promote functional recovery, may exacerbate negative symptoms in CHR. Findings suggest that environmental factors should be considered when understanding state fluctuations in negative symptoms among those at CHR participants.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

Introduction

Negative symptoms, including avolition, anhedonia, and asociality, are commonly observed in psychotic disorders and are also present at subclinical levels in healthy controls (Bobes, Arango, Garcia-Garcia, & Rejas, Reference Bobes, Arango, Garcia-Garcia and Rejas2010; Stefanis et al., Reference Stefanis, Hanssen, Smirnis, Avramopoulos, Evdokimidis, Stefanis and Van Os2002). Recently, there has been increased interest in understanding processes contributing to negative symptoms in youth at clinical high-risk for psychosis (CHR) due to their clinical and prognostic significance. Negative symptoms are highly prevalent among CHR youth, with 82% of participants in the North American Prodrome Longitudinal Study reporting one or more negative symptom (Piskulic et al., Reference Piskulic, Addington, Cadenhead, Cannon, Cornblatt, Heinssen and McGlashan2012). Further, negative symptoms are associated with social and role functioning impairments (Glenthøj, Kristensen, Wenneberg, Hjorthøj, & Nordentoft, Reference Glenthøj, Kristensen, Wenneberg, Hjorthøj and Nordentoft2020; Schlosser et al., Reference Schlosser, Campellone, Biagianti, Delucchi, Gard, Fulford and Vinogradov2015), are one of the earliest markers of psychosis risk that lead to first contact with the treatment system (Yung & McGorry, Reference Yung and McGorry1996), and are significant predictors of transition to a full psychotic disorder (Healey et al., Reference Healey, Penn, Perkins, Woods, Keefe and Addington2018; Zhang et al., Reference Zhang, Xu, Chen, Wei, Tang, Hu and Wang2020). Thus, determining processes contributing to negative symptoms in CHR youth may allow early identification and prevention efforts to shift to the earliest phase of the prodrome when treatments may have maximum potential to prevent or delay illness onset.

Prior mechanistic research has largely focused on determining whether negative symptom models developed in psychosis-spectrum disorders apply to CHR youth. These studies have examined the integrity of reward-processing components that rely on cortico-striatal circuitry and whether associated behavioral or neural abnormalities predict negative symptom severity (Kring & Barch, Reference Kring and Barch2014; Strauss, Waltz, & Gold, Reference Strauss, Waltz and Gold2014). Much like psychotic disorder samples, CHR youth demonstrate an association between negative symptoms and abnormalities in effort-cost computation (Strauss, Bartolomeo, & Luther, Reference Strauss, Bartolomeo and Luther2021), reinforcement learning (Karcher, Hua, & Kerns, Reference Karcher, Hua and Kerns2019; Strauss et al., Reference Strauss, Bartolomeo and Luther2021; Waltz et al., Reference Waltz, Demro, Schiffman, Thompson, Kline, Reeves and Gold2015), value representation (Bartolomeo, Chapman, Raugh, & Strauss, Reference Bartolomeo, Chapman, Raugh and Strauss2021), and reward anticipation (Millman et al., Reference Millman, Gallagher, Demro, Schiffman, Reeves, Gold and Waltz2020). However, reward-processing differences have also been observed between psychotic disorder and CHR youth samples. For example, hedonic reactivity (i.e. self-reported or neurophysiological response to pleasant stimuli or rewards) is generally thought to be intact in psychotic disorders (Cohen & Minor, Reference Cohen and Minor2010; Strauss et al., Reference Strauss, Waltz and Gold2014). However, several laboratory-based studies have demonstrated that hedonic capacity (or consummatory pleasure) is reduced in CHR youth (Gruber, Strauss, Dombrecht, & Mittal, Reference Gruber, Strauss, Dombrecht and Mittal2018; Schlosser et al., Reference Schlosser, Fisher, Gard, Fulford, Loewy and Vinogradov2014; Strauss, Ruiz, Visser, Crespo, & Dickinson, Reference Strauss, Ruiz, Visser, Crespo and Dickinson2018; Yee et al., Reference Yee, Strauss, Allen, Haase, Kimhy and Mittal2019), suggesting CHR youth may have more of a true hedonic deficit than those with psychotic disorders.

In addition to person-level processes like reward-processing, there are likely other mechanisms underlying negative symptoms. The Bioecosystem Theory of Negative Symptoms (Strauss, Reference Strauss2021) proposes that environmental factors interact with person-level, biological, cognitive, and psychological factors to play an important role in the onset and maintenance of negative symptoms across phases of psychotic illness. This theory proposes that direct and indirect environmental contexts have a significant influence on negative symptoms. The immediate environment, or the microsystem (e.g. locations including work or people one interacts with), is theorized to directly influence negative symptoms levels. In support of this theory, we recently found that negative symptoms levels varied across different activities (e.g. resting v. recreational, school/work activities), locations (e.g. home v. school/work), social partners (e.g. alone v. family, friends), and methods of social interactions (i.e. social modality; alone v. electronic communication) in schizophrenia (SZ) (Luther, Raugh, Collins, Knippenberg, & Strauss, Reference Luther, Raugh, Collins, Knippenberg and Strauss2023). Indirect environmental factors that reduce access to resources for recreational, goal-directed, and social activities (e.g. street walkability) have also been associated with greater negative symptoms in SZ (Zhang, James, & Strauss, Reference Zhang, James and Strauss2022). Collectively, these studies suggest that the environment plays a critical, yet previously underestimated role in negative symptoms in those with a psychotic disorder.

To our knowledge, no studies have examined how environmental contexts influence negative symptoms in CHR youth. Examining how context may influence negative symptoms in this population could identify contexts that may be critical for optimizing negative symptom prevention efforts or early interventions. Indeed, environments likely differ between CHR youth and SZ, with CHR youth engaging in a wider range of contexts and activities. For example, CHR youth spend a greater amount of time online, including interacting with others electronically, than healthy controls (CN) (Mittal, Tessner, & Walker, Reference Mittal, Tessner and Walker2007; Pelletier-Baldelli, Strauss, Visser, & Mittal, Reference Pelletier-Baldelli, Strauss, Visser and Mittal2017). In addition, CHR youth may be more connected to their microsystems, including living with family, attending secondary education, and connecting with a wider range of social contacts than SZ. Thus, research is needed to evaluate how these environments may uniquely impact negative symptoms in CHR youth. However, clinical ratings scales, the most frequently used method to assess negative symptoms, were largely designed for adults with SZ, often have a singular rating that conflates symptom levels across contexts, and do not capture the range of activities youth engage in.

This study leveraged Ecological Momentary Assessment (EMA) to examine the impact of dynamic contexts on temporally specific negative symptoms in CHR youth. EMA offers a sensitive, naturalistic approach for examining the wide range of activities that youth are engaged in throughout daily life. Although a few studies have successfully used EMA in CHR youth, almost all have focused on positive symptoms and emotional experience (e.g. positive affect) (Michel et al., Reference Michel, Lerch, Büetiger, Flückiger, Cavelti, Koenig and Kindler2022; Paetzold et al., Reference Paetzold, Myin-Germeys, Schick, Nelson, Velthorst, Schirmbeck and Reininghaus2021; Palmier-Claus, Taylor, Gooding, Dunn, & Lewis, Reference Palmier-Claus, Taylor, Gooding, Dunn and Lewis2012; van der Steen et al., Reference van der Steen, Gimpel-Drees, Lataster, Viechtbauer, Simons, Lardinois and Myin-Germeys2017). Thus, we used EMA to examine the role that activity (e.g. recreation, computer use), location (e.g. home, public), social partner (e.g. friend), and social modality (e.g. electronically, in-person) had on temporally related negative symptoms of avolition, anhedonia, and asociality in CHR youth and CN. In line with our prior findings in SZ (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023), we hypothesized that negative symptoms in CHR youth would change dynamically across different contexts. Given that CHR youth may be characterized by a true hedonic deficit more so than SZ (i.e. based on laboratory-based studies showing that CHR but not SZ show reductions in hedonic capacity; Cohen & Minor, Reference Cohen and Minor2010; Gruber et al., Reference Gruber, Strauss, Dombrecht and Mittal2018; Strauss et al., Reference Strauss, Ruiz, Visser, Crespo and Dickinson2018), we also hypothesized that anhedonia would demonstrate the fewest changes across contexts compared to avolition and asociality and would be more consistently reduced in CHR youth compared to CN.

Methods

Participants

Participants were 61 CN (2080 EMA samples) and 116 CHR youth (3658 EMA samples). CHR participants were recruited from programs at the University of Georgia, Northwestern University, and Emory University that are designed to perform evaluations for youth displaying psychotic experiences. CN were recruited from the local community using printed and online advertisements. Study procedures were approved by the local institutional review board.

CHR participants met criteria for a psychosis-risk syndrome on the Structured Interview for Psychosis-Risk Syndromes (SIPS; Miller et al., Reference Miller, McGlashan, Rosen, Cadenhead, Cannon, Ventura and Woods2003) and did not meet Structured Clinical Interview for DSM-5 (SCID-5; First, Williams, Karg, & Spitzer, Reference First, Williams, Karg and Spitzer2015) lifetime psychotic disorder criteria. CN did not meet SCID-5 criteria for any current psychiatric disorder. See the supplement for CHR syndrome types and additional recruitment and eligibility criteria. CHR and CN did not significantly differ in personal education, parental education, sex, or race; however, CHR were trending toward being older than CN (p = 0.05). CHR also completed fewer EMA surveys than CN (see Table 1); 3.28% (n = 2) of CN and 16.5% (n = 20) of CHR participants completed fewer than 25% of surveys. To maximize available data, we did not exclude any participants based on adherence, consistent with more recent recommendations and the robustness of mixed-effects models for missing data (Hoffman & Rovine, Reference Hoffman and Rovine2007; Schielzeth et al., Reference Schielzeth, Dingemanse, Nakagawa, Westneat, Allegue, Teplitsky and Araya-Ajoy2020).

Table 1. Demographic and clinical characteristics

CHR, Clinical high-risk group; CN, healthy control group.

Note. Means and standard deviations (in parentheses) presented unless otherwise noted.

Procedures

Study procedures were completed across one week. Procedures were similar to past SZ studies (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023; Raugh et al., Reference Raugh, James, Gonzalez, Chapman, Cohen, Kirkpatrick and Strauss2021).

Initial Laboratory Visit. After written informed consent, all participants completed the SCID-5. CHR also completed the SIPS. After diagnostic consensus, participants downloaded the mEMA smartphone app (ilumivu.com), received training on using the app, and completed a practice EMA survey to ensure they understood the response formats.

EMA Surveys. EMA surveys were delivered via the mEMA app for 6 days. From 9AM to 9PM, participants were randomly notified within 90-minute epochs about surveys 8 times per day. This survey amount was chosen to capture changes in context and negative symptoms. Once notified, participants had 15 min to complete surveys. Surveys took less than five minutes and utilized skip logic to minimize time burden. Negative symptom items measured the internal experience components of anhedonia, avolition, and asociality via questions about enjoyment, interest, and motivation for their concurrently endorsed activity and social context (see supplement for items). Context items assessed current activity, location, social partner, and social modality. Contexts were not mutually exclusive; participants selected as many contexts that they engaged in within a 15-min window prior to the survey.

Return to Laboratory. Following EMA, participants were compensated $30 per hour of interviews and $1 per EMA survey completed, with a bonus of up to $60 for completing ⩾5 surveys per day and >80% of surveys.

Data analysis

Following prior analytic methods (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023), all models presented used mixed-effects modeling with random intercepts within person and day in order to account for nesting and repeated measures in the data. All effects evaluated used categorical variables; therefore, no random slopes were used. Models were conducted separately for each negative symptom domain (anhedonia, avolition, asociality) and context (activity, location, social partner, social modality). Contexts observed less than 200 times out of 3212 total surveys were excluded from analyses. Of the remaining contexts, eight activity contexts were evaluated (resting, working/studying, watching TV, eating, computer use, errands, recreation/hobbies, commuting). In addition, four location contexts (home, school/work, public, friend/family residence), six social partner contexts (no one/alone, family, significant other, coworkers/classmates, friends, strangers) and four social modality contexts [no one/alone, in-person, electronic (text, social media, etc.), phone/video call] were examined.

Primary models for each negative symptom domain measured the effect of Group (CN v. CHR), Context (see list above), and Group × Context interaction (see supplement for a post-hoc power analysis). Context was treated as a repeated measure within each survey instance. To isolate the relative effects of each context (i.e. does context B reduce symptoms compared to context A), only instances where activities were endorsed were included in the primary models. Model omnibus effects were evaluated using Wald χ2 tests, and significant main effects of Context were followed by post-hoc contrasts to assess differences between Contexts. Significant Group × Context interactions indicate that the difference in negative symptoms among the groups varies by context. Thus, for significant Group × Context interactions, both between-group and within-group effects were decomposed. Specifically, post-hoc tests evaluated how the two groups differed from each other at each context (e.g. when at work, how did CHR differ from CN on negative symptoms) and how contexts differed from each other within the two groups (e.g. how were negative symptoms different when engaging with strangers compared to being alone in CN and CHR). A False Discovery Rate correction (Benjamini & Hochberg, Reference Benjamini and Hochberg1995) was also applied to each term (Group, Context, Group × Context) across models to control for multiple comparisons. Cohen's d accounting for unequal group sizes (Cohen, Reference Cohen1988) was used to determine group difference effect sizes within each context. To determine effect sizes for differences between contexts within each group, Cohen's d average (Cohen, Reference Cohen1988) was used to account for the repeated-measure nature of the effects.

Several exploratory models were planned and presented in online Supplementary materials to better contextualize the primary model results, including: (1) group differences and COVID differences (before v. during) in Context endorsement (e.g. likelihood each group endorses a Context), (2) effects in overall negative symptoms (i.e. sum of anhedonia, avolition, and asociality), (3) differences in anticipatory and consummatory pleasure anhedonia based on the effect of Group, Context, and Group × Context interactions, and (4) the influence of hedonic and goal-directed activity composite contexts on negative symptoms. Finally, given the high rate of mood disorders in CHR (Kline et al., Reference Kline, Seidman, Cornblatt, Woodberry, Bryant, Bearden and Addington2018), we examined the association between the presence of a mood disorder and negative symptoms to see if mood disorder status should be controlled for in analyses. Analyses were conducted using R version 4.2.2, and analytic code can be downloaded through a link in the online Supplementary materials.

Results

Broadly, groups did not significantly differ in their probability of endorsing different contexts. However, CHR were more likely to be resting or having phone call interactions than CN (online Supplementary Table S1). Mood disorder status was not significantly related to negative symptoms (online Supplementary Table S2) and thus was not controlled for in remaining analyses.

Table 2 contains omnibus effects for models examining the effects of context on anhedonia, avolition, and asociality. When significant, two-way interactions between Group and Context are shown in Figs 1–3.

Figure 1. Anhedonia by group and activity or location contexts. (a) activity. (b) Location.

Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (e.g. resting or being at home). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), while family location also includes friends. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Figure 2. Avolition by group based on activity and location contexts. (a) activity. (b) Location.

Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (resting or at home). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), while family location also includes friends. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Figure 3. Asociality by group for activity, location, social partner, and social modality. (a) activity. (b) Location. (c) social modality. (d) social partner.

Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (resting, being at home, or being alone). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), family location also includes friends, and coworker social partners also included classmates. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Table 2. Omnibus model effects

Note. Effects in bold remained after a False Discovery Rate Correction. The Fixed-effect R 2 is the variance accounted for by the fixed effects, while the Total R 2 includes the variance accounted for by both the fixed effects and the random effects.

Anhedonia

Activity

For activity, the Group, Context, and Group × Context effects were all significant. CHR displayed greater anhedonia than CN while resting, watching TV, eating, using the computer, and during recreation, while no group differences were found for studying/working, errands, or commuting. In both CHR and CN, compared to when resting, anhedonia was greater when studying/working, eating, using the computer, running errands, or commuting; however, compared to resting, anhedonia was significantly lower during recreational activities only in CHR. Anhedonia was lowest during recreation compared to other activities in CHR (ts > 3.35, ps < 0.001, ds > 0.13).

Location

For location, the Group, Context, and Group × Context effects were all significant. CHR had higher anhedonia than CN in all locations except school/work. Within both groups, compared to being at home, anhedonia was higher while at school/work and lower when at a friend or family member's home. Compared to being at home, CN but not CHR reported lower anhedonia when in public. For both groups, anhedonia was highest while at school/work (ts > 7.5, ps < 0.001, ds > 0.23).

Social partner

For social partner, Group and Context effects were significant, while the Group × Context was nonsignificant. Across all social partners, CHR endorsed greater anhedonia than CN (d = 0.08). In the combined sample, compared to being alone, anhedonia was lower when with family (t = 10.33, p < 0.001, d = 0.18), significant other(s) (t = 12.57, p < 0.001, d = 0.26), and friends (t = 14.91, p < 0.001, d = 0.27), but higher when with classmates or coworkers (t = 3.3, p = 0.001, d = 0.07).

Social modality

For social modality, the main effect of Context was significant, while the Group and Group × Context effects were nonsignificant. In the combined sample, relative to being alone, anhedonia was lower during in person (t = 11.25, p ⩽ 0.001, d = 0.15), electronic (t = 5.06, p ⩽ 0.001, d = 0.14), and phone call (t = 2.56, p = 0.011, d = 0.08) interactions.

Anticipatory and consummatory anhedonia

Both anticipatory and consummatory effects were broadly consistent with the overall anhedonia analyses (online Supplementary Table S4 and Figures S2–S4).

Avolition

Activity

For activity, the Group, Context, and Group × Context effects were all significant. Compared to CN, avolition was greater in CHR while resting, watching TV, eating, and running errands; groups did not differ on avolition during studying/working, computer, recreation, or commuting activities. Within each group, compared to being at rest, avolition was higher during studying/working, running errands, and commuting but lower during recreational activities. Within CHR but not CN, compared to being at rest, avolition was lower when watching TV. When compared to being at rest, CN but not CHR also showed greater avolition when on the computer. Within CHR, avolition was lowest during recreation compared to other contexts (ts > 4, ps < 0.001, ds > 0.17).

Location

For location, the Group, Context, and Group × Context effects were all significant. Compared to CN, CHR demonstrated greater avolition at home, in public, and at a friend or family member's home; no group differences emerged for school/work. Compared to being at home, both groups reported greater avolition when at school/work and lower avolition when at a friend/family member's home. In CN but not CHR, compared to being at home, avolition was lower when in public than when at home. In both groups, avolition was greatest while at school/work (ts > 2.8, ps < 0.005, ds > 0.1).

Social partner

For social partner, Group and Context effects were significant, while Group × Context was nonsignificant. Across all social partners, CHR endorsed greater avolition than CN (d = 0.06). In the combined sample, relative to being alone, avolition was greater when around classmates/coworkers (t = 2.5, p = 0.012, d = 0.05) but lower in all other contexts (ts > 2.7, ps < 0.006, ds > 0.07).

Social modality

For social modality, Group and Context effects were significant, while Group × Context was nonsignificant. Across all social modalities, avolition was greater among CHR compared to CN (d = 0.08). In the combined sample, compared to being alone, avolition was significantly lower for in person (t = 6.35, p < 0.001, d = 0.08), electronic (t = 1.96, p = 0.05, d = 0.05), and phone call interactions (t = 2.18, p = 0.029, d = 0.06).

Asociality

Activity

For activity context, Context and Group × Context effects were significant, while Group was nonsignificant. However, post-hoc comparisons revealed groups did not significantly differ on asociality in any activity context. Among CN, asociality was significantly higher when at rest compared to all other activity contexts except errands. Among CHR, compared to being at rest, asociality was lower when watching TV, eating, or engaging in recreation but did not significantly differ from rest for school/work, errands, computer, or commuting activities.

Location

For location context, Context and Group × Context effects were significant, while Group was nonsignificant. CHR displayed higher asociality than CN while at a friend/family home; groups did not differ on asociality in other locations. In both groups, compared to being at home, asociality was lower when in public or at a friend/family member's house.

Social partner

For social partner, Context and Group × Context effects were significant, while Group was nonsignificant. Compared to CN, asociality was greater among CHR when interacting with family, a significant other, or friends. In both groups, relative to being alone, asociality was lower in all social partner contexts.

Social modality

For social modality, Context and Group × Context effects were significant, while Group was nonsignificant. CHR showed greater asociality than CN during in person and electronic but not phone call interactions. In both groups, compared to being alone, asociality was lower during in person, electronic, and phone call interactions, and no significant differences in asociality levels were present in either group between in-person, electronic, and phone call interactions (ts < −1.29, ps < 0.20, ds < 0.04).

Discussion

Given the prognostic significance of negative symptoms in CHR youth (Piskulic et al., Reference Piskulic, Addington, Cadenhead, Cannon, Cornblatt, Heinssen and McGlashan2012), there is a critical need to identify potentially modifiable mechanisms such as one's immediate environmental context that contribute to negative symptoms. This study used EMA to provide a more naturalistic assessment of whether environmental contexts lead to changes in state negative symptoms among CHR youth. Building on the limited work that has used EMA to examine negative symptoms in CHR youth, our results suggest that across both CHR and CN, anhedonia, avolition, and asociality levels largely varied across activity, location, social partner, and social modality contexts in daily life. These results align with the Bioecosystem Model of Negative symptoms (Strauss, Reference Strauss2021) and indicate that the immediate environment or microsystem can lead to dynamic changes in negative symptoms. These results also build on other models of psychosis risk and symptom development such as the Stress Diathesis Model of Schizophrenia (Nuechterlein & Dawson, Reference Nuechterlein and Dawson1984; Walker & Diforio, Reference Walker and Diforio1997) and the Cognitive Model of Negative Symptoms (Beck, Rector, Stolar, & Grant, Reference Beck, Rector, Stolar and Grant2009) which implicate early and later life environmental factors such as social adversity and urbanization in the development of psychosis and associated symptoms in vulnerable individuals (Dean & Murray, Reference Dean and Murray2005).

Fluctuations in negative symptoms across contexts were especially evident for avolition and asociality. For avolition, we found significant within-group differences in CHR youth, indicating that compared to being at rest, being at school/work, running errands, and commuting were associated with greater avolition, while engaging in recreation and watching TV were linked to lower avolition. Thus, much like SZ (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023), activities more commonly associated with being ‘productive’ were associated with increases in avolition, while more pleasure-based activities were linked to reduced avolition. Given evidence of a hedonic deficit in CHR youth (e.g. Gruber et al., Reference Gruber, Strauss, Dombrecht and Mittal2018), this may suggest that increasing engagement in more pleasure-based activities to improve the experience of pleasure could overtime lead to improved avolition and engagement in productive activities. Higher-stakes performance-based activities (e.g. school, work) may also activate defeatist beliefs about performance (Clay, Raugh, Bartolomeo, & Strauss, Reference Clay, Raugh, Bartolomeo and Strauss2021), resulting in greater avolition. In line with this, recreational activities led to similar avolition reductions for both groups (i.e. non-significant group differences). This aligns with our prior results in SZ (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023), suggesting that recreation and community engagement may be especially critical for inclusion in avolition interventions across the psychosis-spectrum. Finally, there was some evidence that locations differentially impacted avolition in CHR youth. Among CHR, compared to being at home, being at a family/friend's house was associated with avolition reductions, while being at school/work was associated with greater avolition. Somewhat surprisingly, being at home and being in public led to similar avolition levels in CHR participants, while being in public (v. home) led to lower avolition in CN. This may be due to positive symptom exacerbations (e.g. paranoia) that may occur when CHR youth are in novel or busy public places; future work is needed to identify which types of public locations are most linked with symptom exacerbations as well as the impact of more personalized and meaningful locations on concurrent and prospective negative symptoms.

As expected, asociality fluctuated mostly between social and non-social contexts in both groups. Although no group differences were observed in asociality or interest in interactions across different activity types, significant group differences emerged between social partner, social modality, and location contexts. Notably, among social partner types, CHR participants reported less social interest in close relationships (family, significant others, friends) than CN, while no group differences emerged for more distal relationships (coworkers/classmates, strangers). This aligns with prior work showing that being with friends was associated with increased psychosis-proneness scores and anxiety (Husky, Grondin, & Swendsen, Reference Husky, Grondin and Swendsen2004). Close relationships may be more challenging for CHR youth, potentially as a result of subthreshold symptoms (e.g. paranoia, social cognition reductions) that could exacerbate developmentally normative conversational challenges that can arise during youth. However, despite these group differences, engaging in these close relationships was still associated with asociality reductions when compared to being alone in CHR youth. Asociality was also the only domain where groups differed on symptom levels across the different interaction methods. This was driven by the increased asociality observed in CHR compared to CN participants when interacting in person and electronically. However, there were no group differences for phone calls, and all interaction methods were associated with lower asociality in CHR compared to being alone. Groups also did not differ on anhedonia or avolition levels across the different interaction methods. Thus, despite spending more time interacting with others online than CN (Mittal et al., Reference Mittal, Tessner and Walker2007; Pelletier-Baldelli et al., Reference Pelletier-Baldelli, Strauss, Visser and Mittal2017), CHR youth appear to benefit from a similar reduction in negative symptoms during both electronic-based and in person interactions. Taken together, this work suggests that online or social media interventions (e.g. Alvarez-Jimenez et al., Reference Alvarez-Jimenez, Koval, Schmaal, Bendall, O'Sullivan, Cagliarini and Gleeson2021) could be useful for targeting negative symptoms in CHR youth.

While anhedonia also appeared to change across different contexts within both groups, in accordance with hypotheses, there was also evidence for greater anhedonia elevations in the CHR group. Compared to CN, CHR participants reported less pleasure (i.e. greater anhedonia) when engaging in most activities (except school/work, errands, commuting) and across all social partners and most locations (except school/work). This contrasts our prior work showing that SZ and CN reported similar anhedonia levels across most contexts (Luther et al., Reference Luther, Raugh, Collins, Knippenberg and Strauss2023). However, these results in CHR youth further support prior work with self-report measures and laboratory paradigms demonstrating that CHR youth experience more of a true hedonic deficit than SZ (e.g. Gruber et al., Reference Gruber, Strauss, Dombrecht and Mittal2018). This finding was further supported when we examined consummatory and anticipatory anhedonia; CHR participants reported greater reductions in both in-the-moment and anticipatory pleasure compared to CN across most contexts and negative symptom domains. However, there were a few contexts where anhedonia was significantly reduced in CHR participants compared to other contexts. This included recreational activities and being at a family/friend's home. Thus, there may still be a few areas where anhedonia is more preserved in CHR youth, which could be bolstered in early intervention and prevention efforts.

Several limitations should be considered. First, although a study strength was the large CHR sample, we could not evaluate effects based on transition to a psychotic disorder due to lack of a longitudinal follow-up. Second, additional work is needed to clarify the direction of the observed effects and examine how context at a preceding point influences subsequent negative symptoms (and vice versa). This study also focused only on contexts that are part of the immediate environment (e.g. the microsystem); future studies could examine how indirect environmental factors (e.g. street walkability) dynamically interact with immediate environmental contexts to impact symptoms. Further, CHR participants had lower EMA adherence than CN; although there was no apparent systematic effect of this difference on results, this possibility cannot be definitively ruled out. Relatedly, although steps were taken to increase survey accessibility (e.g. surveys were available for 15 min), participants may have missed the survey completion window due to engagement in an activity or social interaction. Additionally, we could not examine how expressive negative symptoms (e.g. blunted affect) are impacted by environmental contexts or how socioeconomic status may influence the role of context on negative symptoms. Although the naturalistic assessment of activities in daily life is a study strength, some youth (in both groups) may engage in more prescribed activities (e.g. attending high school, greater family engagement), which could impact results. Finally, although supplemental analyses did not indicate significant differences in the interpretation of the effects of context on negative symptoms for those who completed the study prior v. after COVID, we cannot rule out the possibility that restrictions imposed during the pandemic impacted other aspects of negative symptoms.

Despite these limitations, several clinical implications can be drawn from these findings. Among CHR for psychosis youth, environmental context may directly influence symptom levels of anhedonia, avolition, and asociality. Further, there are some contexts where negative symptoms may be more preserved among CHR youth. These results can guide prevention and early intervention efforts by identifying specific contexts clinicians can guide participants to engage in (e.g. recreation, being with friends or family), reduce time in (e.g. being at home), or modify (e.g. work, commuting, running errands, being in public) to improve and potentially prevent the onset of clinically significant negative symptoms. These results may also guide novel mobile health interventions by identifying specific contexts where negative symptom exacerbations may occur and therefore where in-the-moment intervention content may be most needed and impactful.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291723001393.

Financial support

This work was supported by R21-MH119438 to G.P.S. and R01-MH116039 to G.P.S., V.A.M., and E.F.W. from the National Institute of Mental Health. Study sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Conflict of interests

Dr Gregory Strauss is one of the original developers of the Brief Negative Symptom Scale (BNSS) and receives royalties and consultation fees from Medavante-ProPhase LLC in connection with commercial use of the BNSS and other professional activities; these fees are donated to the Brain and Behavior Research Foundation. Dr Strauss has received honoraria and travel support from Medavante-ProPhase LLC for training pharmaceutical company raters on the BNSS. In the past 2 years, Dr Strauss has consulted for and/or been on the speaker bureau for Minerva Neurosciences, Acadia, Lundbeck, Sunovion, Boehringer Ingelheim, and Otsuka pharmaceutical companies. All other authors have no relevant disclosures to report.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Footnotes

*

Equal Contribution.

References

Alvarez-Jimenez, M., Koval, P., Schmaal, L., Bendall, S., O'Sullivan, S., Cagliarini, D., … Gleeson, J. F. M. (2021). The Horyzons project: A randomized controlled trial of a novel online social therapy to maintain treatment effects from specialist first-episode psychosis services. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 20(2), 233243. doi:10.1002/wps.20858CrossRefGoogle Scholar
Bartolomeo, L. A., Chapman, H. C., Raugh, I. M., & Strauss, G. P. (2021). Delay discounting in youth at clinical high-risk for psychosis and adults with schizophrenia. Psychological Medicine, 51(11), 18981905. doi:10.1017/S0033291720000677CrossRefGoogle ScholarPubMed
Beck, A. T., Rector, N. A., Stolar, N., & Grant, P. (2009). Schizophrenia: Cognitive theory, research, and therapy. New York, NY: Guilford Press.Google Scholar
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289300. doi: 10.1111/j.2517-6161.1995.tb02031.xCrossRefGoogle Scholar
Bobes, J., Arango, C., Garcia-Garcia, M., Rejas, J., & CLAMORS Study Collaborative Group. (2010). Prevalence of negative symptoms in outpatients with schizophrenia spectrum disorders treated with antipsychotics in routine clinical practice: Findings from the CLAMORS study. The Journal of Clinical Psychiatry, 71(3), 280286. doi: 10.4088/JCP.08m04250yelCrossRefGoogle ScholarPubMed
Clay, K. B., Raugh, I. M., Bartolomeo, L. A., & Strauss, G. P. (2021). Defeatist performance beliefs in individuals at clinical high-risk for psychosis and outpatients with chronic schizophrenia. Early Intervention in Psychiatry, 15(4), 865873. doi:10.1111/eip.13024CrossRefGoogle ScholarPubMed
Cohen, A. S., & Minor, K. S. (2010). Emotional experience in patients with schizophrenia revisited: Meta-analysis of laboratory studies. Schizophrenia Bulletin, 36(1), 143150.10.1093/schbul/sbn061CrossRefGoogle ScholarPubMed
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Routledge Academic.Google Scholar
Dean, K., & Murray, R. M. (2005). Environmental risk factors for psychosis. Dialogues in Clinical Neuroscience, 7(1), 6980.10.31887/DCNS.2005.7.1/kdeanCrossRefGoogle ScholarPubMed
First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV). Arlington, VA: American Psychiatric Association.Google Scholar
Glenthøj, L. B., Kristensen, T. D., Wenneberg, C., Hjorthøj, C., & Nordentoft, M. (2020). Experiential negative symptoms are more predictive of real-life functional outcome than expressive negative symptoms in clinical high-risk states. Schizophrenia Research, 218, 151156. doi:10.1016/j.schres.2020.01.012CrossRefGoogle ScholarPubMed
Gruber, J., Strauss, G. P., Dombrecht, L., & Mittal, V. A. (2018). Neuroleptic-free youth at ultrahigh risk for psychosis evidence diminished emotion reactivity that is predicted by depression and anxiety. Schizophrenia Research, 193, 428434. doi:10.1016/j.schres.2017.08.013CrossRefGoogle ScholarPubMed
Healey, K. M., Penn, D. L., Perkins, D., Woods, S. W., Keefe, R. S. E., & Addington, J. (2018). Latent profile analysis and conversion to psychosis: Characterizing subgroups to enhance risk prediction. Schizophrenia Bulletin, 44(2), 286296. doi:10.1093/schbul/sbx080CrossRefGoogle ScholarPubMed
Hoffman, L., & Rovine, M. J. (2007). Multilevel models for the experimental psychologist: Foundations and illustrative examples. Behavior Research Methods, 39(1), 101117.10.3758/BF03192848CrossRefGoogle ScholarPubMed
Husky, M. M., Grondin, O. S., & Swendsen, J. D. (2004). The relation between social behavior and negative affect in psychosis-prone individuals: An experience sampling investigation. European Psychiatry, 19(1), 17. doi:10.1016/j.eurpsy.2003.09.006CrossRefGoogle ScholarPubMed
Karcher, N. R., Hua, J. P. Y., & Kerns, J. G. (2019). Probabilistic category learning and striatal functional activation in psychosis risk. Schizophrenia Bulletin, 45(2), 396404. doi:10.1093/schbul/sby033CrossRefGoogle ScholarPubMed
Kline, E. R., Seidman, L. J., Cornblatt, B. A., Woodberry, K. A., Bryant, C., Bearden, C. E., … Addington, J. (2018). Depression and clinical high-risk states: Baseline presentation of depressed vs. non-depressed participants in the NAPLS-2 cohort. Schizophrenia Research, 192, 357363. doi:10.1016/j.schres.2017.05.032CrossRefGoogle ScholarPubMed
Kring, A. M., & Barch, D. M. (2014). The motivation and pleasure dimension of negative symptoms: Neural substrates and behavioral outputs. European Neuropsychopharmacology, 24(5), 725736. doi:10.1016/j.euroneuro.2013.06.007CrossRefGoogle ScholarPubMed
Luther, L., Raugh, I. M., Collins, D. E., Knippenberg, A. R., & Strauss, G. P. (2023). Negative symptoms in schizophrenia differ across environmental contexts in daily life. Journal of Psychiatric Research, 161, 1018.10.1016/j.jpsychires.2023.02.037CrossRefGoogle ScholarPubMed
Michel, C., Lerch, S., Büetiger, J. R., Flückiger, R., Cavelti, M., Koenig, J., … Kindler, J. (2022). An ecological momentary assessment study of age effects on perceptive and non-perceptive clinical high-risk symptoms of psychosis. European Child & Adolescent Psychiatry, 112. doi:10.1007/s00787-022-02003-9Google ScholarPubMed
Miller, T. J., McGlashan, T. H., Rosen, J. L., Cadenhead, K., Cannon, T., Ventura, J., … Woods, S. W. (2003). Prodromal assessment with the structured interview for prodromal syndromes and the scale of prodromal symptoms: Predictive validity, interrater reliability, and training to reliability. Schizophrenia Bulletin, 29(4), 703715. doi:10.1093/oxfordjournals.schbul.a007040CrossRefGoogle ScholarPubMed
Millman, Z. B., Gallagher, K., Demro, C., Schiffman, J., Reeves, G. M., Gold, J. M., … Waltz, J. A. (2020). Evidence of reward system dysfunction in youth at clinical high-risk for psychosis from two event-related fMRI paradigms. Schizophrenia Research, 226, 111119. doi:10.1016/j.schres.2019.03.017CrossRefGoogle ScholarPubMed
Mittal, V. A., Tessner, K. D., & Walker, E. F. (2007). Elevated social internet use and schizotypal personality disorder in adolescents. Schizophrenia Research, 94(1–3), 5057. doi:10.1016/j.schres.2007.04.009CrossRefGoogle ScholarPubMed
Nuechterlein, K. H., & Dawson, M. E. (1984). A heuristic vulnerability/stress model of schizophrenic episodes. Schizophrenia Bulletin, 10(2), 300312.10.1093/schbul/10.2.300CrossRefGoogle ScholarPubMed
Paetzold, I., Myin-Germeys, I., Schick, A., Nelson, B., Velthorst, E., Schirmbeck, F., … Reininghaus, U. (2021). Stress reactivity as a putative mechanism linking childhood trauma with clinical outcomes in individuals at ultra-high-risk for psychosis: Findings from the EU-GEI high risk study. Epidemiology and Psychiatric Sciences, 30, e40. doi:10.1017/S2045796021000251CrossRefGoogle ScholarPubMed
Palmier-Claus, J. E., Taylor, P. J., Gooding, P., Dunn, G., & Lewis, S. W. (2012). Affective variability predicts suicidal ideation in individuals at ultra-high risk of developing psychosis: An experience sampling study. The British Journal of Clinical Psychology, 51(1), 7283. doi:10.1111/j.2044-8260.2011.02013.xCrossRefGoogle ScholarPubMed
Pelletier-Baldelli, A., Strauss, G. P., Visser, K. H., & Mittal, V. A. (2017). Initial development and preliminary psychometric properties of the prodromal inventory of negative symptoms (PINS). Schizophrenia Research, 189, 4349. doi:10.1016/j.schres.2017.01.055CrossRefGoogle ScholarPubMed
Piskulic, D., Addington, J., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Heinssen, R., … McGlashan, T. H. (2012). Negative symptoms in individuals at clinical high risk of psychosis. Psychiatry Research, 196(2–3), 220224. doi:10.1016/j.psychres.2012.02.018CrossRefGoogle ScholarPubMed
Raugh, I. M., James, S. H., Gonzalez, C. M., Chapman, H. C., Cohen, A. S., Kirkpatrick, B., & Strauss, G. P. (2021). Digital phenotyping adherence, feasibility, and tolerability in outpatients with schizophrenia. Journal of Psychiatric Research, 138, 436443. doi:10.1016/j.jpsychires.2021.04.022CrossRefGoogle ScholarPubMed
Schielzeth, H., Dingemanse, N. J., Nakagawa, S., Westneat, D. F., Allegue, H., Teplitsky, C., … Araya-Ajoy, Y. G. (2020). Robustness of linear mixed-effects models to violations of distributional assumptions. Methods in Ecology and Evolution, 11(9), 11411152.10.1111/2041-210X.13434CrossRefGoogle Scholar
Schlosser, D. A., Campellone, T. R., Biagianti, B., Delucchi, K. L., Gard, D. E., Fulford, D., … Vinogradov, S. (2015). Modeling the role of negative symptoms in determining social functioning in individuals at clinical high risk of psychosis. Schizophrenia Research, 169(1–3), 204208. doi:10.1016/j.schres.2015.10.036CrossRefGoogle ScholarPubMed
Schlosser, D. A., Fisher, M., Gard, D., Fulford, D., Loewy, R. L., & Vinogradov, S. (2014). Motivational deficits in individuals at-risk for psychosis and across the course of schizophrenia. Schizophrenia Research, 158(1–3), 5257. doi:10.1016/j.schres.2014.06.024CrossRefGoogle ScholarPubMed
Stefanis, N. C., Hanssen, M., Smirnis, N. K., Avramopoulos, D. A., Evdokimidis, I. K., Stefanis, C. N., … Van Os, J. (2002). Evidence that three dimensions of psychosis have a distribution in the general population. Psychological Medicine, 32(2), 347358. doi:10.1017/s0033291701005141CrossRefGoogle ScholarPubMed
Strauss, G. P. (2021). A bioecosystem theory of negative symptoms in schizophrenia. Frontiers in Psychiatry, 12, 655471. doi:10.3389/fpsyt.2021.655471CrossRefGoogle ScholarPubMed
Strauss, G. P., Bartolomeo, L. A., & Luther, L. (2021). Reduced willingness to expend effort for rewards is associated with risk for conversion and negative symptom severity in youth at clinical high-risk for psychosis. Psychological Medicine, 53(3), 18. doi:10.1017/S003329172100204XGoogle ScholarPubMed
Strauss, G. P., Ruiz, I., Visser, K. H., Crespo, L. P., & Dickinson, E. K. (2018). Diminished hedonic response in neuroleptic-free youth at ultra high-risk for psychosis. Schizophrenia Research. Cognition, 12, 17. doi:10.1016/j.scog.2017.12.001CrossRefGoogle ScholarPubMed
Strauss, G. P., Waltz, J. A., & Gold, J. M. (2014). A review of reward processing and motivational impairment in schizophrenia. Schizophrenia Bulletin, 40(Suppl 2), S107S116. doi: 10.1093/schbul/sbt197CrossRefGoogle ScholarPubMed
van der Steen, Y., Gimpel-Drees, J., Lataster, T., Viechtbauer, W., Simons, C. J. P., Lardinois, M., … Myin-Germeys, I. (2017). Clinical high risk for psychosis: The association between momentary stress, affective and psychotic symptoms. Acta Psychiatrica Scandinavica, 136(1), 6373. doi:10.1111/acps.12714CrossRefGoogle ScholarPubMed
Walker, E. F., & Diforio, D. (1997). Schizophrenia: A neural diathesis-stress model. Psychological Review, 104(4), 667685.10.1037/0033-295X.104.4.667CrossRefGoogle ScholarPubMed
Waltz, J. A., Demro, C., Schiffman, J., Thompson, E., Kline, E., Reeves, G., … Gold, J. (2015). Reinforcement learning performance and risk for psychosis in youth. The Journal of Nervous and Mental Disease, 203(12), 919926. doi:10.1097/NMD.0000000000000420CrossRefGoogle ScholarPubMed
Yee, C. I., Strauss, G. P., Allen, D. N., Haase, C. M., Kimhy, D., & Mittal, V. A. (2019). Trait emotional experience in individuals with schizophrenia and youth at clinical high risk for psychosis. BJPsych Open, 5(5), e78. doi:10.1192/bjo.2019.64CrossRefGoogle ScholarPubMed
Yung, A. R., & McGorry, P. D. (1996). The initial prodrome in psychosis: Descriptive and qualitative aspects. The Australian and New Zealand Journal of Psychiatry, 30(5), 587599. doi:10.3109/00048679609062654CrossRefGoogle ScholarPubMed
Zhang, L., James, S. H., & Strauss, G. P. (2022). Environmental Resource Reductions Predict Greater Severity of Negative Symptoms in Schizophrenia. Under review.Google Scholar
Zhang, T., Xu, L., Chen, Y., Wei, Y., Tang, X., Hu, Y., … Wang, J. (2020). Conversion to psychosis in adolescents and adults: Similar proportions, different predictors. Psychological Medicine, 19. doi:10.1017/S0033291720000756Google ScholarPubMed
Figure 0

Table 1. Demographic and clinical characteristics

Figure 1

Figure 1. Anhedonia by group and activity or location contexts. (a) activity. (b) Location.Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (e.g. resting or being at home). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), while family location also includes friends. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Figure 2

Figure 2. Avolition by group based on activity and location contexts. (a) activity. (b) Location.Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (resting or at home). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), while family location also includes friends. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Figure 3

Figure 3. Asociality by group for activity, location, social partner, and social modality. (a) activity. (b) Location. (c) social modality. (d) social partner.Note. Between groups, within context labels reflect contrast between groups within each context while between context, within group labels reflect contrast within group relative to reference context (resting, being at home, or being alone). Figures use estimated marginal means and error bars reflect standard error. Work contexts also included school (e.g. item was school/work), family location also includes friends, and coworker social partners also included classmates. * = p < 0.05, ** = p < 0.01, ** = p < 0.001.

Figure 4

Table 2. Omnibus model effects

Supplementary material: File

Luther et al. supplementary material

Luther et al. supplementary material
Download Luther et al. supplementary material(File)
File 1.5 MB