Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-10-28T00:24:11.439Z Has data issue: false hasContentIssue false

Dissociation of basolateral and central amygdala effective connectivity predicts the stability of emotion-related impulsivity in adolescents and emerging adults with borderline personality symptoms: a resting-state fMRI study

Published online by Cambridge University Press:  28 February 2022

Nathan T. Hall*
Affiliation:
Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
Michael N. Hallquist*
Affiliation:
Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
*
Author for correspondence: Michael N. Hallquist, E-mail: [email protected]
Author for correspondence: Michael N. Hallquist, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Borderline personality disorder (BPD) is associated with altered activity in the prefrontal cortex (PFC) and amygdala, yet no studies have examined fronto-limbic circuitry in borderline adolescents and emerging adults. Here, we examined the contribution of fronto-limbic effective connectivity (EC) to the longitudinal stability of emotion-related impulsivity, a key feature of BPD, in symptomatic adolescents and young adults.

Methods

We compared resting-state EC in 82 adolescents and emerging adults with and without clinically significant borderline symptoms (n BPD = 40, ages 13–30). Group-specific directed networks were estimated amongst fronto-limbic nodes including PFC, ventral striatum (VS), central amygdala (CeN), and basolateral amygdala (BLA). We examined the association of directed centrality metrics with initial levels and rates of change in emotion-related impulsivity symptoms over a one-year follow-up using latent growth curve models (LGCMs).

Results

In controls, ventromedial prefrontal cortex (vmPFC) and dorsal ACC had a directed influence on CeN and VS, respectively. In the BPD group, bilateral BLA had a directed influence on CeN, whereas in the healthy group CeN influenced BLA. LGCMs indicated that emotion-related impulsivity was stable across a one-year follow-up in the BPD group. Further, higher EC of R CeN to other regions in controls was associated with stronger within-person decreases in emotion-related impulsivity.

Conclusions

Functional inputs from BLA and vmPFC appear to play competing roles in influencing CeN activity. In borderline adolescents and young adults, BLA may predominate over CeN activity, while in controls the ability of CeN to influence BLA activity predicted more rapid reductions in emotion-related impulsivity.

Type
Original Article
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Borderline personality disorder (BPD) is characterized by affective instability, interpersonal dysfunction, suicidality, and self-harming behaviors (American Psychiatric Association, 2013). Although BPD is most often diagnosed in emerging adults, there is mounting evidence that symptoms often begin in adolescence and show continuity into adulthood (Cohen, Reference Cohen2008; Crowell, Beauchaine, & Linehan, Reference Crowell, Beauchaine and Linehan2009; Zanarini, Temes, Frankenburg, Reich, & Fitzmaurice, Reference Zanarini, Temes, Frankenburg, Reich and Fitzmaurice2018; Zelkowitz et al., Reference Zelkowitz, Paris, Guzder, Feldman, Roy and Rosval2007). This developmental course aligns with broader research on impulsivity and emotion regulation in adolescence (Steinberg et al., Reference Steinberg, Icenogle, Shulman, Breiner, Chein, Bacchini and Takash2018). In BPD, impulsive and self-destructive behaviors tend to occur in response to momentary emotional arousal and constitute a core symptom of the disorder (Brereton & McGlinchey, Reference Brereton and McGlinchey2020; Crowell et al., Reference Crowell, Beauchaine and Linehan2009; Linehan, Reference Linehan1993).

Difficulty controlling impulses in the face of negative emotions (e.g. self-injury after a break-up with a romantic partner) is referred to as negative urgency (Settles et al., Reference Settles, Fischer, Cyders, Combs, Gunn and Smith2012; Whiteside & Lynam, Reference Whiteside and Lynam2001). Positive urgency is a related construct (Cyders et al., Reference Cyders, Smith, Spillane, Fischer, Annus and Peterson2007; Cyders & Smith, Reference Cyders and Smith2008) that describes a tendency to act impulsively in order to enhance positive mood (e.g. engaging in risky sexual behavior with a stranger while intoxicated). Collectively, negative and positive urgency are referred to as emotion-related impulsivity and reflect a crucial intersection of emotion regulation capacities and impulsivity that is robustly associated with psychopathology (Johnson, Elliott, & Carver, Reference Johnson, Elliott and Carver2020). At the level of neural circuits, emotion-related impulsivity may reflect an imbalance between the inhibitory control functions of the ventromedial prefrontal and orbitofrontal cortex (vmPFC, OFC) and emotion-congruent response tendencies in the amygdala and ventral striatum (VS; Johnson et al. Reference Johnson, Elliott and Carver2020; Zorrilla & Koob, Reference Zorrilla and Koob2019). For example, even mild uncontrollable stressors can profoundly disrupt PFC functioning (Arnsten, Reference Arnsten2009), leading to a reliance on short-sighted, emotion-congruent behaviors that are immediately reinforcing, to the detriment of long-term wellbeing and safety.

Neuroimaging studies of emotion in adults with BPD consistently identify abnormalities in similar fronto-limbic circuits, including the amygdala, VS, medial PFC, and dorsal anterior cingulate cortex (dACC; Enzi et al. Reference Enzi, Doering, Faber, Hinrichs, Bahmer and Northoff2011; Herpertz et al. Reference Herpertz, Dietrich, Wenning, Krings, Erberich, Willmes and Sass2001; Minzenberg, Fan, New, Tang, & Siever, Reference Minzenberg, Fan, New, Tang and Siever2007; Salvador et al. Reference Salvador, Vega, Pascual, Marco, Canales-Rodríguez, Aguilar, Anguera and Pomarol-Clotet2016; Schulze, Schmahl, & Niedtfeld, Reference Schulze, Schmahl and Niedtfeld2016; Silbersweig et al. Reference Silbersweig, Clarkin, Goldstein, Kernberg, Tuescher, Levy and Stern2007). More specifically, several studies have noted a fronto-limbic imbalance in BPD: in response to a range of emotional stimuli, limbic regions are often more active whereas activity in prefrontal regions involved in emotion regulation (esp. mPFC and ACC) is blunted (Donegan et al., Reference Donegan, Sanislow, Blumberg, Fulbright, Lacadie, Skudlarski and Wexler2003; Herpertz et al., Reference Herpertz, Dietrich, Wenning, Krings, Erberich, Willmes and Sass2001; Kamphausen et al., Reference Kamphausen, Schröder, Maier, Bader, Feige, Kaller and Tüscher2013; Minzenberg et al., Reference Minzenberg, Fan, New, Tang and Siever2007; Soloff, White, Omari, Ramaseshan, & Diwadkar, Reference Soloff, White, Omari, Ramaseshan and Diwadkar2015). Fronto-limbic accounts of emotion dysregulation center on the amygdala, which is involved in detecting a threat, representing the emotional significance of stimuli (LeDoux, Reference LeDoux2007), and encoding and retrieving fear memories. Furthermore, emotional experience depends on interactions between the amygdala and mPFC and dACC, which are involved in emotional appraisal and regulation (Etkin, Egner, & Kalisch, Reference Etkin, Egner and Kalisch2011). Altogether, neuroimaging studies of BPD suggest a model of emotion dysregulation in which blunted activity in PFC and ACC and heightened activity in the amygdala and VS contribute to failures in inhibiting emotion-congruent responses (Schulze et al., Reference Schulze, Schmahl and Niedtfeld2016; Silbersweig et al., Reference Silbersweig, Clarkin, Goldstein, Kernberg, Tuescher, Levy and Stern2007). While these studies imply that effective connectivity (EC) of mPFC with amygdala and VS may play a key role in BPD, prior research has not tested this idea directly.

Preclinical research casts the amygdala within a larger circuit that includes the cortex, striatum, and midbrain. Together, this circuit is fundamental to the experience and expression of emotional behaviors (Cardinal, Parkinson, Hall, & Everitt, Reference Cardinal, Parkinson, Hall and Everitt2002). Further, nonhuman animal studies demonstrate that the central nucleus of the amygdala (CeN) and the basolateral amygdala (BLA) play dissociable roles in the generation of Pavlovian associations and retrieval of relevant unconditioned responses during instrumental learning (Cardinal et al., Reference Cardinal, Parkinson, Hall and Everitt2002; Cartoni, Balleine, & Baldassarre, Reference Cartoni, Balleine and Baldassarre2016). Broadly speaking, the phylogenetically old CeN is a major controller of the autonomic nervous system, having strong projections to the hypothalamus, periaqueductal gray (PAG), basal forebrain, and brainstem – brain regions contributing to autonomic arousal (Zahm, Jensen, Williams, & Martin, Reference Zahm, Jensen, Williams and Martin1999). In contrast, the phylogenetically newer BLA receives direct inputs from the sensory cortex and uses this information to construct an emotional representation of specific conditioned stimuli; it uses this information to influence the output of CeN (Cardinal et al., Reference Cardinal, Parkinson, Hall and Everitt2002; Zhang, Zhang, Holmes, & Pan, Reference Zhang, Zhang, Holmes and Pan2021). This body of research suggests that the expression of emotion-congruent behaviors depends on BLA's capacity to convey the emotional significance of specific conditioned stimuli to CeN, which projects to regions that affect arousal and initiate approach and avoidance behaviors (Cardinal et al., Reference Cardinal, Parkinson, Hall and Everitt2002).

Further, the amygdala and PFC functionally couple with the VS, forming fronto-striatal-limbic loops that support reward learning and motivation (Floresco, Reference Floresco2015). Studies of reward learning consistently find activity in VS in anticipation of reward (de la Fuente-Fernández et al., Reference de la Fuente-Fernández, Phillips, Zamburlini, Sossi, Calne, Ruth and Stoessl2002; Schott et al., Reference Schott, Minuzzi, Krebs, Elmenhorst, Lang, Winz and Bauer2008) and after the receipt of reward (Floresco, Reference Floresco2015; Pagnoni, Zink, Montague, & Berns, Reference Pagnoni, Zink, Montague and Berns2002). In studies of impulsivity, impaired dopaminergic functioning in VS discounts the value of future rewards, tilting choices toward more immediate rewards (Berridge, Reference Berridge2007; Gregorios-Pippas, Tobler, & Schultz, Reference Gregorios-Pippas, Tobler and Schultz2009; Martinez et al., Reference Martinez, Pasquereau, Drui, Saga, Météreau and Tremblay2020). Extant research suggests that VS function is impaired in individuals with BPD (Enzi et al., Reference Enzi, Doering, Faber, Hinrichs, Bahmer and Northoff2011; Sarkheil, Ibrahim, Schneider, Mathiak, & Klasen, Reference Sarkheil, Ibrahim, Schneider, Mathiak and Klasen2019; Silbersweig et al., Reference Silbersweig, Clarkin, Goldstein, Kernberg, Tuescher, Levy and Stern2007), though a fine-grained analysis of VS contributions to fronto-limbic abnormalities has not been a focus of the BPD neuroimaging literature.

Connectivity of both amygdala and VS show pronounced developmental changes in adolescence that are susceptible to stress (Fareri et al., Reference Fareri, Gabard-Durnam, Goff, Flannery, Gee and Tottenham2015; Gee et al., Reference Gee, Fetcho, Jing, Li, Glatt and Drysdale2016; Tottenham & Galván, Reference Tottenham and Galván2016), yet these connections have not been investigated in adolescents with borderline symptoms. This is surprising given that the emergence of BPD symptoms is associated with trauma, interpersonal discord, and chronic stress (Zanarini & Frankenburg, Reference Zanarini and Frankenburg1997; Zanarini, Gunderson, Marino, Schwartz, & Frankenburg, Reference Zanarini, Gunderson, Marino, Schwartz and Frankenburg1989). Importantly, during the transition from mid-adolescence to early adulthood, self-reported impulsivity shows marked mean-level decreases in the general populationFootnote Footnote 1 (Harden & Tucker-Drob, Reference Harden and Tucker-Drob2011; Quinn & Harden, Reference Quinn and Harden2013). However, within-person changes in impulsive symptoms are heterogeneous. Some highly impulsive adolescents show relative stability in impulsivity or decrease only slightly during this period, potentially leaving these individuals vulnerable to persistent negative outcomes into their 20's (Burt, Sweeten, & Simons, Reference Burt, Sweeten and Simons2014; Quinn & Harden, Reference Quinn and Harden2013).

Altogether, while the fronto-limbic account has received attention in adults with BPD, little is known about fronto-limbic disturbances in adolescence, when the development of emotion-related impulsivity may crucially impact the onset and maintenance of BPD symptoms. In this resting-state fMRI study of adolescents and emerging adults with BPD symptoms, we examined fronto-limbic circuitry using EC analyses within a network neuroscience framework (Bassett & Sporns, Reference Bassett and Sporns2017). Furthermore, we tested how fronto-limbic connectivity related to within-person stability and change in emotion-related impulsivity over six- and twelve-month follow-up assessments. Motivated by evidence in a preliminary analysis that EC of R CeN differed substantially between groups, we tested whether R CeN connectivity underlies the relationship between clinical group membership (healthy control v. BPD) and within-person change in emotion-related impulsivity symptoms.

Methods and materials

Participants

Participants were 46 adolescents and emerging adults with BPD symptoms recruited from community and outpatient settings, as well as 44 sex- and age-matched healthy controls. All participants were screened using the Personality Assessment Inventory-Borderline scale (Morey, Reference Morey1991) with BPD participants screening ⩾ 30 and controls screening ⩽ 17. The average age was 20.53 years (range 13–30 years); 59 participants were female and 31 were male. Eight participants (n BPD = 6) were excluded from our analyses for having poor fMRI data quality due to excessive motion during the scan or failure to pass residual correlation checks (see online Supplementary Methods). See online Supplementary Table S1 for a complete demographic characterization of the final sample.

Procedure

Participants underwent two semi-structured diagnostic interviews to assess for psychopathology and personality disorder symptoms (First, Spitzer, Gibbon, & Williams, Reference First, Spitzer, Gibbon and Williams2002; Pfohl, Blum, & Zimmermann, Reference Pfohl, Blum and Zimmermann1997). Interviews were administered by two trained research assistants who were supervised by the senior author. Participants in the BPD group met diagnostic criteria for three or more of the DSM-IV-TR BPD symptoms, an empirically derived threshold for identifying clinically significant symptoms (Clifton & Pilkonis, Reference Clifton and Pilkonis2007). Exclusionary criteria for both groups included having a first-degree relative diagnosed with Bipolar I disorder or any psychotic disorder and a history of serious head injury or neurological disease. Control participants additionally had no history of psychiatric or substance abuse disorders.

In a separate session preceding the RS-fMRI scan and at six- and twelve-month follow-up visits, participants completed a battery of self-report questionnaires. We focus here on the UPPS-P Impulsive Behavior Scale (UPPS-P; Cyders et al. Reference Cyders, Smith, Spillane, Fischer, Annus and Peterson2007; Lynam, Smith, Whiteside, & Cyders, Reference Lynam, Smith, Whiteside and Cyders2006; Whiteside & Lynam, Reference Whiteside and Lynam2001), whose subscales measure (positive and negative) urgency, (lack of) premeditation, (lack of) perseverance, and sensation seeking. Internal consistency was excellent at baseline and follow-up assessments (α total = 0.95, α mean−subscales = 0.88). We were particularly interested in the negative and positive urgency subscales of the UPPS-P, given their relevance in psychopathology (Johnson et al., Reference Johnson, Elliott and Carver2020), though we compared our results with all UPPS-P scales to test specificity (online Supplementary Methods and Results). All study procedures were approved by the Institutional Review Boards of the University of Pittsburgh (PRO13010486).

MR data acquisition

Data were acquired using a Siemens 3T Tim Trio scanner with a 32-channel head coil at the University of Pittsburgh Medical Center. We collected five minutes of resting-state fMRI data at the end of a broader MRI protocol; subjects were asked to keep their eyes open and relax, but not fall asleep. We used a simultaneous multi-slice echo-planar sequence sensitive to BOLD contrast with scanning parameters: TR = 1.0 s, TE = 30 ms, flip angle = 55°, voxel size = 2.3 mm isotropic, 5× multiband acceleration. Participants completed a self-report questionnaire at the end of the protocol to determine if they fell asleep during the scan. No subjects were excluded for sleepiness.

RS-fMRI preprocessing

RS-fMRI preprocessing was conducted within FSL, NiPy, and AFNI (Cox, Reference Cox1996; Millman & Brett, Reference Millman and Brett2007; Smith et al., Reference Smith, Jenkinson, Woolrich, Beckmann, Behrens, Johansen-Berg and Matthews2004). Structural scans were registered to the MNI152 template (Fonov, Evans, McKinstry, Almli, & Collins, Reference Fonov, Evans, McKinstry, Almli and Collins2009) using affine and nonlinear transformations conducted in FSL. Functional image preprocessing included simultaneous 4-D motion and slice-timing correction (Roche, Reference Roche2011), brain extraction, alignment of subject's functional images to their anatomical scan using a boundary-based registration algorithm (Greve & Fischl, Reference Greve and Fischl2009), and a one-step nonlinear warp to MNI152 space that concatenated functional-to structural, structural-to-MNI152, and fieldmap unwarping transformations. To mitigate motion-related artifacts we used ICA-AROMA (Pruim et al., Reference Pruim, Mennes, van Rooij, Llera, Buitelaar and Beckmann2015), a data-driven classification algorithm that identifies and removes spatiotemporal components likely to reflect head movement. We note that ICA-AROMA is an empirically validated alternative to censoring (aka ‘scrubbing’) strategies that remove some volumes based on an a priori motion threshold (Ciric et al., Reference Ciric, Wolf, Power, Roalf, Baum, Ruparel, Satterthwaite and D2017). RS-fMRI data was not spatially smoothed for analysis (see online Supplementary Methods; Alakörkkö, Saarimäki, Glerean, Saramäki, and Korhonen, Reference Alakörkkö, Saarimäki, Glerean, Saramäki and Korhonen2017).

Analytic approach

Nodal parcellation and functional connectivity matrix generation

To define our regions of interest, we parceled voxels into functional regions (nodes) by combining leading cortical and subcortical parcellations (online Supplementary Methods) (Choi, Yeo, & Buckner, Reference Choi, Yeo and Buckner2012; Schaefer et al., Reference Schaefer, Kong, Gordon, Laumann, Zuo, Holmes and Yeo2018). We selected 19 fronto-striatal-limbic nodes, including portions of mPFC, OFC, and ACC as prefrontal nodes, and bilateral BLA, CeN, and VS as limbic nodes (Fig. 1, Table S2). Prior to computing connectivity between nodes, we averaged the time series for voxels with reliable signal in each node to obtain a single nodal time series. For each subject and node, we prewhitened time series with an Auto-Regressive Moving Average (4,2) model, retaining the residual time series for FC estimation (online Supplementary Methods).

Fig. 1. Nodes without labels were not fit with CS-GIMME but depict medial prefrontal and ACC nodes that were dropped from our initial consideration set. Arrows reflect the directed influence of one node on another at the group and subgroup (BPD vs control) level. Solid lines denote edges that were estimated at the group (entire sample) level with the solid green edge denoting a significantly higher edge values amongst subjects in the control group. Dashed lines denote edges estimated at the subgroup (BPD vs HC) level, with red and green dashed lines denoting edges that were only estimated for subjects in the BPD and control group, respectively.

Finally, we computed Pearson correlations among the pre-whitened time series to yield a 19 × 19 adjacency matrix for each subject representing undirected functional connectivity amongst fronto-limbic regions. In order to remove unreliable edges from these matrices, we applied a minimal consensus thresholding procedure (de Reus & van den Heuvel, Reference de Reus and van den Heuvel2013). Specifically, we removed edges from all subjects that did not have a weight of r = 0.1 or higher in 25% or more of subjects. This resulted in the removal of 17 edges (10%) that were concentrated in OFC-subcortical and subcortical-subcortical connections.

Node selection: undirected analysis

The primary goal of our analyses was to examine EC using the Confirmatory Subgrouping Group Iterative Model Multiple Estimation algorithm (CS-GIMME; Gates & Molenaar, Reference Gates and Molenaar2012; Henry et al. Reference Henry, Feczko, Cordova, Earl, Williams, Nigg and Gates2019). However, given that GIMME conjointly estimates conditional relationships among all nodes, the number of free parameters increases exponentially as the number of nodes increases and parameter reliability decreases (Cassidy, Bowman, Rae, & Solo, Reference Cassidy, Bowman, Rae and Solo2017). To promote model convergence and reliable EC estimation, we performed a node selection analysis by fitting a single logistic ridge regression model predicting group status by all undirected edges, retaining nodes with edges that jointly predicted group status at the p < 0.01 level and were thus most likely to be implicated in EC (online Supplementary Methods and Results; Cule & De Iorio, Reference Cule and De Iorio2012; Moritz & Cule, Reference Moritz and Cule2018).

Effective connectivity network estimation and relations to group status and age

We retained the preprocessed time series of twelveFootnote 2 fronto-limbic nodes based on our node selection analysis (online Supplementary Table S3; online Supplementary Methods and Results). We estimated EC between these nodes using the CS-GIMME algorithm, a recent extension of the GIMME algorithm that reliably detects the presence and direction of edges in fMRI data at the individual, group, and sample levels.

After obtaining directed graphs from CS-GIMME, we investigated group differences in the role of individual nodes (nodal centrality) in fronto-limbic circuits. We calculated in- and out-degree centrality for each node that showed evidence of incoming or outgoing edges in the best-fitting CS-GIMME model (denoting the summed score of incoming and outgoing edges for each node; online Supplementary Methods). In order to identify which nodal centrality estimates best-differentiated groups, we entered all of these into a single logistic regressionFootnote 3 predicting group status:

$${\rm logit}( {BPD} ) = \beta _0 + \beta _1Age + \beta _2k_1^{in} + \beta _3k_1^{in} x\;Age + \beta _4k_1^{out} + \beta _5k_1^{out} x\;Age + \ldots + \beta _{41}k_{12}^{in} + \beta _{42}k_{12}^{in} x\;Age + \beta _{43}k_{12}^{out} + \beta _{44}k_{12}^{out} x\;Age + e$$

where $k_1^{in}$ is in-degree for node 1 (Table 1).

Predicting stability and change in impulsivity

We tested for group differences in baseline levels of emotion-related impulsivity and within-person changes in emotion-related impulsivity symptoms over 6- and 12-month follow-up. We first fit a latent growth curve model (LGCM; Bollen and Curran, Reference Bollen and Curran2005), modeling latent intercept and slope terms for both negative and positive urgencyFootnote 4, which describe the baseline level and rate of within-person change, respectively, in negative and positive urgency scales. In this model, group, age, and their interaction were included as predictors of LGCM variables (Fig. 2).

Fig. 2. (a) Conceptual diagram of latent growth curve model reported in Table 2. Solid green lines denote positive parameter estimates, demonstrating that group main effects are higher for both intercept terms (overall levels of ERI) in the BPD group. Solid red lines denote negative parameter estimates, demonstrating that age main effects on both intercept terms indicate decreasing levels of ERI in the total sample. Faded red lines denote “marginally” significant parameter estimates (0.05 < p < 0.10). Paths from age that intersect with paths from BPD to LGCM terms represent interactive effects (moderation) of age and group to predict LGCM terms. (b) Visual depiction of age × group interaction for each LGCM term, demonstrating significant group × age interactions for both NU and PU intercept terms and a marginally significant group × age interaction for NU slope.

We then tested if the group and group-by-age differences in the longitudinal model of emotion-related impulsivity were mediated by EC estimates of the R CeN (Fig. 3). As detailed below, the results from the joint logistic model indicated that R CeN played a particularly important role in differentiating BPD from HC participants (Table 1). Thus, we fit a combined dual-mediator LGCM, which tested the hypothesis that directed functional input and/or output of the R CeN mediated the relationship between group status and latent intercept and slope variables. In our final combined model, both in- and out-degree of the R CeN were mediators of LGCM variables for both negative and positive urgency. We allowed age to predict levels of directed centrality of R CeN, and to moderate the relationship between centrality estimates and LGCM variables (Hayes, Reference Hayes2015). As our final LGCMs only consisted of two models (one modeling the overall pattern of emotion-related impulsivity stability and change, and the second adding mediating roles of R CeN EC) a correction for multiple comparisons was not applied.

Fig. 3. (a) Conceptual diagram of final latent growth curve model reported in Table 3. Solid green lines denote positive parameter estimates, demonstrating that main effects are higher for both baseline ERI variables and R CeNin in the BPD group. Solid red lines denote negative parameter estimates, demonstrating that R CeNin decreased with age, and that BPD was associated with lower R CeNout, which was in turn associated with lower (e.g. “more negative”) within-person change in PU. Faded red lines denote “marginally” significant parameter estimates (0.05 < p < 0.10). Paths from age that intersect with paths from R CeNin and R CeNout to LGCM terms represent interactive effects (moderation) of age on the second-stage mediation (i.e. from R CeN connectivity to LGCM terms). (b) Significant moderated mediation of from BPD to NU baseline levels through R CeNout, which was moderated by age. (c) Significant moderated mediation of from BPD to NU within-person change through R CeNout, which was moderated by age. (d) Visual split of moderated mediation into young participants (under 20 years old) and older participants (over 20 years old). Note most importantly the lower left panel, showing that amongst adolescents, participants with higher R CeNout had more negative levels of within-person change in NU over one year, demonstrating more rapid reductions in NU symptoms over the one-year follow-up.

Table 1. Joint model: group differences in in- and -out-degree centrality

Note. Rows with missing values indicate that there was no group- or subgroup-level edge entering/exiting the node, and thus we elected to not compute estimates of centrality based only on individual-level edges. Results represent coefficients in a single model that were allowed to compete to explain variation in-group status. Note that positive coefficients represent that degree centrality estimates were higher in the BPD group. We also ran a supplementary set of analyses that fit separate models to each effect (online Supplementary Methods and Results, Table S5), which provides an intuition of the marginal group effects, whereas the joint model account the complex correlational structure of these connectivity scores (online Supplementary Fig. S3).

Results

Directed network estimation

A graphical depiction of the best-fitting CS-GIMME network is provided in Fig. 1; directed edge values are listed in online Supplementary Table S4. Effective connectivity estimates from CS-GIMME generated positive directed edges at both the group level (nine total) and the subgroup level (five total, two in the BPD group). We found a range of directed edges from the dmPFC to several mPFC nodes at the group level including left dACC, rmPFC, and vmPFC, as well as right dmPFC. We also found evidence at the group-level for EC between bilateral CeN, VS, and BLA nodes. In healthy controls, but not BPD participants, CS-GIMME detected edges from dACC to VS, vmPFC to the CeN, and CeN to BLA. Conversely in BPD subjects, the CS-GIMME algorithm found BPD-specific edges from bilateral BLA to CeN.

Group and age-related differences in fronto-limbic connectivity

In a joint model predicting group status from directed centrality estimates, we found a dissociation between in- and out-degree centrality in R CeN by group (Table 1). Subjects in the BPD group had significantly higher in-degree (t = 2.47, p = 0.02) and significantly lower out-degree (t = −3.82, p < 0.001) of R CeN. This effect did not differ by age: all age-related terms in the joint model were nonsignificant.

Associations with emotion-related impulsivity scales

As expected, negative and positive urgency subscale scores were significantly higher in the BPD group at baseline compared to controls (β NU = 0.88, p < 0.001; β PU = 0.53, p < 0.001; Table 2, Fig. 2). We also found group x age interactions in baseline emotion-related impulsivity scores: older controls had lower baseline negative and positive urgency scores than younger controls, whereas baseline negative and positive urgency scores in the BPD group did not differ substantially by age (β NU = 0.10, p = 0.01; β PU = 0.086, p = 0.01).

Table 2. Parameter table: latent growth curve model of ERI scales and relations to BPD, Age, and their interaction

Note. Parameter table reflects parameter estimates estimated in and extracted from the lavaan R package (Rosseel, Reference Rosseel2012). Confidence intervals and corresponding p values were estimated based on standard errors derived from 1000 bootstrapped samples.

In a final combined LGCM, we tested if group differences in emotion-related impulsivity scores over the one-year follow-up period were accounted for by EC of R CeN at baseline. Results are detailed in Table 3 and visually depicted in Fig. 3. R CeN out-degree statistically mediated the association of group status with within-person changes in positive urgency (Indirect Effect = 0.08; p = 0.04), such that CeN out-degree was lower in the BPD group (β = −0.20 p < 0.001) and was related to sharper within-person declines in positive urgency (β = −0.35, p = 0.03). For negative urgency, we found that the influence of R CeN out-degree on baseline level and within-person change in negative urgency depended on age: Hayes' index = 0.06 (p = 0.01) and −0.02 (p = 0.01), respectively. In younger participants, higher R CeN out-degree was associated with higher baseline negative urgency and greater within-person decreases in negative urgency over the one-year follow-up whereas in older participants the opposite pattern was observed (Fig. 3b–d). We note that all effects held when participant-wise mean framewise displacement was included as a nuisance covariate in the analysis (see online Supplementary Results for details).

Table 3. Parameter table: dual-mediator latent growth curve model includes mediation by R CeN in- and out-degree

Note. Parameter table reflects parameter estimates estimated in and extracted from the lavaan R package (Rosseel, Reference Rosseel2012). Confidence intervals and corresponding p values were estimated based on standard errors derived from 1000 bootstrapped samples. Moderated mediation estimates are based on the index described in (Hayes, Reference Hayes2015).

Although our emphasis on emotion-related impulsivity was informed by clinical theory and prior BPD research, we also note that in preliminary mixed-effects models, we found a significant group by age interactions in levels of negative and positive urgency but not other facets of impulsivity (online Supplemental Methods and Results; Table S6).

Discussion

In a sample of adolescents and emerging adults with BPD symptoms and matched healthy controls, we found that resting-state EC of amygdala subnuclei at study baseline accounted for group differences in initial levels and within-person change in emotion-related impulsivity over a one-year follow-up period. Specifically, input to R CeN (in-degree) was significantly higher in the BPD group, which largely reflected a heightened influence of BLA on CeN. Conversely, in the control group, higher levels of output of R CeN (out-degree) were primarily attributable to R CeN's directed input to BLA (Fig. 1, online Supplementary Fig. S3). Crucially, the output of R CeN statistically mediated the association between BPD symptoms and baseline emotion-related impulsivity, as well as within-person stability of emotion-related impulsivity in borderline adolescents. Our results indicate that CeN plays an important role in impulsive behaviors in response to intense emotions. Importantly, whereas we found evidence of directed connectivity from vmPFC to CeN in controls, this functional connection was not reliably observed in BPD participants. This suggests an altered integration of cortico-limbic signals in the CeN, which has important clinical implications regarding the developmental course of BPD from adolescence to emerging adulthood.

Fronto-limbic disturbances are frequently reported in fMRI studies of adults with BPD, with the strongest evidence for amygdala hyperactivity in the processing of emotions. Further, prior evidence suggests that the functional interaction between vmPFC and amygdala is suppressed in individuals with BPD when presented with emotional stimuli (Kamphausen et al., Reference Kamphausen, Schröder, Maier, Bader, Feige, Kaller and Tüscher2013; Silbersweig et al., Reference Silbersweig, Clarkin, Goldstein, Kernberg, Tuescher, Levy and Stern2007). We found that EC from vmPFC to CeN was positive in controls, but absent in the borderline group. This positive connection in our data is in line with other BOLD EC studies showing positive EC from vmPFC to amygdala (Nawa & Ando, Reference Nawa and Ando2019; Stein et al., Reference Stein, Wiedholz, Bassett, Weinberger, Zink, Mattay and Meyer-Lindenberg2007; Watanabe, Bhanji, Tanabe, & Delgado, Reference Watanabe, Bhanji, Tanabe and Delgado2019), though we note that animal studies of fear conditioning find that mPFC/infralimbic projections to the amygdala are primarily inhibitory (Quirk & Gehlert, Reference Quirk and Gehlert2006; Quirk, Likhtik, Pelletier, & Paré, Reference Quirk, Likhtik, Pelletier and Paré2003; Rosenkranz & Grace, Reference Rosenkranz and Grace2001, Reference Rosenkranz and Grace2002). One possibility is that at rest, positive EC between these regions reflects an increased capacity of vmPFC to control affective responding in CeN (Watanabe et al., Reference Watanabe, Bhanji, Tanabe and Delgado2019). This interpretation aligns well with evidence that humans with vmPFC lesions show potentiated amygdala responsivity (Motzkin, Philippi, Wolf, Baskaya, & Koenigs, Reference Motzkin, Philippi, Wolf, Baskaya and Koenigs2015). Additionally, preclinical research indicates that electrical stimulation of mPFC neurons suppress the activity of output neurons in CeN that control autonomic/emotional arousal (Quirk et al., Reference Quirk, Likhtik, Pelletier and Paré2003). If functional connections between vmPFC and CeN are absent or significantly weakened in young people with BPD, excitatory connections from BLA to CeN (Tye et al., Reference Tye, Prakash, Kim, Fenno, Grosenick, Zarabi and Deisseroth2011; Zhang et al., Reference Zhang, Zhang, Holmes and Pan2021) could exert heightened influence over CeN efferents that control arousal.

While CeN encodes the general affective and motivational significance of emotional events (Balleine & Killcross, Reference Balleine and Killcross2006; Corbit & Balleine, Reference Corbit and Balleine2005), BLA is involved in assigning emotional significance to sensory stimuli (Janak & Tye, Reference Janak and Tye2015; Namburi et al., Reference Namburi, Beyeler, Yorozu, Calhoon, Halbert, Wichmann and Tye2015). Importantly, BLA projections to CeN control fear acquisition in the presence of environmental stressors and the expression of anxious behavior (Ciocchi et al., Reference Ciocchi, Herry, Grenier, Wolff, Letzkus, Vlachos and Lüthi2010; Namburi et al., Reference Namburi, Beyeler, Yorozu, Calhoon, Halbert, Wichmann and Tye2015; Tye et al., Reference Tye, Prakash, Kim, Fenno, Grosenick, Zarabi and Deisseroth2011), while BLA projections to VS are preferentially activated during reward learning (Namburi et al., Reference Namburi, Beyeler, Yorozu, Calhoon, Halbert, Wichmann and Tye2015). This is consistent with the interpretation that heightened BLA-to-CeN EC in BPD adolescents could support a tendency to initiate impulsive behaviors in response to threatening environmental conditions. Alternatively, BLA-to-CeN EC in BPD may reflect a tendency to translate sensory signals with greater emotional significance (BLA; Jovanovic & Ressler, Reference Jovanovic and Ressler2010; Kaye, Reference Kaye2021) to a state of enhanced physiological arousal (CeN). Ultimately, such high arousal states could predispose adolescents toward making impulsive choices, either to enhance positive affect or to escape negative affect.

Crucially, differential EC between the R CeN and BLA was associated with self-reported emotion-related impulsivity levels at baseline and within-person change in emotion-related impulsivity over 12-month follow-up (Fig. 3). Adolescence is associated with increased levels of impulsivity, which decrease in the general population, yet adolescents in the BPD group demonstrated greater stability in emotion-related impulsivity symptoms. Within-person decreases in negative urgency in healthy adolescents (Fig. 3b, lower left) were associated with stronger EC from R CeN to R BLA at baseline. Most studies find that functional interactions between BLA and CeN reflect the influence of BLA activity on CeN, rather than the other way around (Cardinal et al., Reference Cardinal, Parkinson, Hall and Everitt2002; Tye et al., Reference Tye, Prakash, Kim, Fenno, Grosenick, Zarabi and Deisseroth2011). Thus, our finding that R CeN output mediates within-person decreases in negative urgency may reflect an increased capacity to resist BLA modulation in controls (a capacity that may be supported by signaling from vmPFC). Given that EC from CeN to BLA was not observed in the BPD group, we propose that BLA control of the CeN is one candidate mechanism for explaining the stability of emotion-related impulsivity in BPD. This proposal extends earlier findings of fronto-limbic abnormalities in BPD by illustrating a more anatomically nuanced account of intra-amygdala information flow than previously described in this population. Most importantly, we demonstrate that intra-amygdala EC in our data predicted the clinical course of emotion-related impulsivity symptoms up to one-year post-scan.

To our knowledge, this is the first study in humans to demonstrate tradeoffs in EC between BLA and CeN in any psychiatric population. Furthermore, we leveraged recent developments in EC estimation (Henry et al., Reference Henry, Feczko, Cordova, Earl, Williams, Nigg and Gates2019) that are well-suited for detecting group-specific connectivity patterns. Our findings have clear implications for future study in other disorders with heightened levels of emotion-related impulsivity including addiction (Zorrilla & Koob, Reference Zorrilla and Koob2019), anxiety disorders (Pawluk & Koerner, Reference Pawluk and Koerner2016), eating disorders (Wenzel, Weinstock, Vander Wal, & Weaver, Reference Wenzel, Weinstock, Vander Wal and Weaver2014), and PTSD (Weiss, Tull, Sullivan, Dixon-Gordon, & Gratz, Reference Weiss, Tull, Sullivan, Dixon-Gordon and Gratz2015). As such, it is worth noting that dissociations in functional (undirected) connectivity of BLA and CeN have been previously documented in human subjects with these disorders (Brown et al., Reference Brown, LaBar, Haswell, Gold, Beall and Morey2014; Frank, Shott, Riederer, & Pryor, Reference Frank, Shott, Riederer and Pryor2016; Shackman & Fox, Reference Shackman and Fox2016; Zorrilla & Koob, Reference Zorrilla and Koob2019).

A few limitations are worth noting. First, our RS-fMRI acquisition was cross-sectional. Though we demonstrated the ability of a cross-sectional measure of brain connectivity to explain within-person changes in emotion-related impulsivity over 12 months, longitudinal neuroimaging studies offer the opportunity to study developmental changes in EC between BLA and CeN. Second, while relating self-reported emotion-related impulsivity levels to measures of intrinsic EC is an important descriptive step in identifying candidate neural circuits implicated in personality pathology, highly stable levels of emotion-related impulsivity in the BPD group may be due to selection criteria for our study. That is, emotion-related impulsivity stability in the BPD group may reflect a byproduct of selecting participants with heightened BPD symptoms (including impulsivity). Third, our study collected five minutes of resting-state fMRI data, which is on the low end of acceptable acquisition length (Birn et al., Reference Birn, Molloy, Patriat, Parker, Meier, Kirk and Prabhakaran2013). That said, our fast TR (1 s) provided us with 300 time points per subject, allowing for reliable estimates of EC using GIMME, which has been validated with as few as 200 time points (Gates & Molenaar, Reference Gates and Molenaar2012). Finally, future studies should include clinical comparison groups to clarify this specificity/generality of our findings, as differences in fronto-limbic connectivity have been documented across many disorders.

We present evidence that EC between vmPFC, CeN, and BLA is altered in adolescents and emerging adults with BPD symptoms. One speculative interpretation is that vmPFC and BLA compete in modulating CeN activity, and differential contributions of these regions to CeN activity underlie stability and change in emotion-related impulsivity symptoms from adolescence through emerging adulthood. Further, our findings demonstrate altered fronto-limbic connectivity in adolescents with BPD symptoms, including a functional disconnection between vmPFC and CeN and tradeoffs in control between functionally distinct subnuclei of the amygdala, which may underlie impulsive behaviors in the face of strong emotions. We hope that future studies build on our results by examining biomarkers that can inform treatments for adolescents at high risk for negative BPD-related outcomes in early adulthood and beyond.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291722000101

Acknowledgements

This work was funded by the National Institutes of Mental Health (K01 MH097091 and R01 MH119399 to MNH). The funding agency had no role in the design and conduct of the study; the collection, management, analysis, and interpretation of the data; the preparation, review, and approval of the manuscript; or the decision to submit the manuscript for publication.

Conflict of interest

The authors have no financial or other conflict of interest to disclose.

Footnotes

The notes appear after the main text.

1 While no studies have specifically examined stability and change in emotion-related impulsivity during the transition from adolescence to early adulthood, impulsivity in these studies is contrasted to sensation seeking, which shows clear differences in developmental course and relevance to psychopathology (Harden & Tucker-Drob, Reference Harden and Tucker-Drob2011; Quinn & Harden, Reference Quinn and Harden2013).

2 We noted previously, that GIMME may struggle with parameter identifiability with a large number of nodes (approximately 20 nodes) (Beltz & Gates, Reference Beltz and Gates2017). To ensure the robustness of our results we re-estimated directed edges with CS-GIMME on the original a priori 19-node set. and retained nearly identical results, with the exception of a small number of intra-mPFC edges estimated with the inclusion of additional right mPFC nodes. Fronto-limbic connectivity was preserved across analyses, indicating that our choice to trim the number of nodes used in CS-GIMME estimation did not bias results.

3 In order to get a broad sense of group and age-related associations, preliminary analyses that were not jointly fit are described in online Supplementary Methods and Results and summarized in Table S5. However, the joint approach is preferred as a straightforward correction for multiple comparisons and addresses the conditional associations amongst centrality metrics (online Supplementary Fig. S2).

4 Simultaneously modeling the growth of two separate variables is considered an instantiation of a parallel process growth curve model (Olino, Stepp, Keenan, Loeber, & Hipwell, Reference Olino, Stepp, Keenan, Loeber and Hipwell2014), where correlations within measurement waves help to further reduce unexplained variation in the model. These models also allow for latent intercepts and slopes to predict one another, though in our analysis, we elected to leave growth parameters simply correlated with one another, as there is no strong evidence in the literature that would predict that levels of negative or positive urgency to have a direct influence on the other.

References

Alakörkkö, T., Saarimäki, H., Glerean, E., Saramäki, J., & Korhonen, O. (2017). Effects of spatial smoothing on functional brain networks. European Journal of Neuroscience, 46(9), 24712480. https://doi.org/10.1111/ejn.13717.CrossRefGoogle ScholarPubMed
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). Arlington, VA: American Psychiatric Pub.Google Scholar
Arnsten, A. F. T. (2009). Stress signalling pathways that impair prefrontal cortex structure and function. Nature Reviews Neuroscience, 10(6), 410422. https://doi.org/10.1038/nrn2648.CrossRefGoogle ScholarPubMed
Balleine, B. W., & Killcross, S. (2006). Parallel incentive processing: An integrated view of amygdala function. Trends in Neurosciences, 29(5), 272279. https://doi.org/10.1016/j.tins.2006.03.002.CrossRefGoogle ScholarPubMed
Bassett, D. S., & Sporns, O. (2017). Network neuroscience. Nature Neuroscience, 20(3), 353364. https://doi.org/10.1038/nn.4502.CrossRefGoogle ScholarPubMed
Beltz, A. M., & Gates, K. M. (2017). Network mapping with GIMME. Multivariate Behavioral Research, 52(6), 789804. https://doi.org/10.1080/00273171.2017.1373014.CrossRefGoogle ScholarPubMed
Berridge, K. C. (2007). The debate over dopamine's role in reward: The case for incentive salience. Psychopharmacology, 191(3), 391431. https://doi.org/10.1007/s00213-006-0578-x.CrossRefGoogle ScholarPubMed
Birn, R. M., Molloy, E. K., Patriat, R., Parker, T., Meier, T. B., Kirk, G. R., … Prabhakaran, V. (2013). The effect of scan length on the reliability of resting-state fMRI connectivity estimates. NeuroImage, 83, 550558. https://doi.org/10.1016/j.neuroimage.2013.05.099.CrossRefGoogle ScholarPubMed
Bollen, K. A., & Curran, P. J. (2005). Latent curve models: A structural equation perspective (1 ed). Hoboken, NJ: Wiley-Interscience.CrossRefGoogle Scholar
Brereton, A., & McGlinchey, E. (2020). Self-harm, emotion regulation, and experiential avoidance: A systematic review. Archives of Suicide Research, 24(sup1), 124. https://doi.org/10.1080/13811118.2018.1563575.CrossRefGoogle ScholarPubMed
Brown, V. M., LaBar, K. S., Haswell, C. C., Gold, A. L., Mid-Atlantic MIRECC Workgroup, Beall, S. K., … Morey, R. A. (2014). Altered resting-state functional connectivity of basolateral and centromedial amygdala complexes in posttraumatic stress disorder. Neuropsychopharmacology, 39(2), 361369. https://doi.org/10.1038/npp.2013.197.CrossRefGoogle ScholarPubMed
Burt, C. H., Sweeten, G., & Simons, R. L. (2014). Self-control through emerging adulthood: Instability, multidimensionality, and criminological significance. Criminology; An Interdisciplinary Journal, 52(3), 450487. https://doi.org/10.1111/1745-9125.12045.Google Scholar
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002). Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience & Biobehavioral Reviews, 26(3), 321352. https://doi.org/10.1016/S0149-7634(02)00007-6.CrossRefGoogle ScholarPubMed
Cartoni, E., Balleine, B., & Baldassarre, G. (2016). Appetitive pavlovian-instrumental transfer: A review. Neuroscience & Biobehavioral Reviews, 71, 829848. https://doi.org/10.1016/j.neubiorev.2016.09.020.CrossRefGoogle ScholarPubMed
Cassidy, B., Bowman, D. B., Rae, C., & Solo, V. (2017). On the reliability of individual brain activity networks. IEEE Transactions on Medical Imaging, PP(99), 11. https://doi.org/10.1109/TMI.2017.2774364.Google Scholar
Choi, E. Y., Yeo, B. T. T., & Buckner, R. L. (2012). The organization of the human striatum estimated by intrinsic functional connectivity. Journal of Neurophysiology, 108(8), 22422263. https://doi.org/10.1152/jn.00270.2012.CrossRefGoogle ScholarPubMed
Ciocchi, S., Herry, C., Grenier, F., Wolff, S. B. E., Letzkus, J. J., Vlachos, I., … Lüthi, , A. (2010). Encoding of conditioned fear in central amygdala inhibitory circuits. Nature, 468(7321), 277282. https://doi.org/10.1038/nature09559.CrossRefGoogle ScholarPubMed
Ciric, R., Wolf, D. H., Power, J. D., Roalf, D. R., Baum, G. L., Ruparel, K., … Satterthwaite, T. D, . (2017). Benchmarking of participant-level confound regression strategies for the control of motion artifact in studies of functional connectivity. NeuroImage, 154, 174187. https://doi.org/10.1016/j.neuroimage.2017.03.020.CrossRefGoogle ScholarPubMed
Clifton, A., & Pilkonis, P. A. (2007). Evidence for a single latent class of diagnostic and statistical manual of mental disorders borderline personality pathology. Comprehensive Psychiatry, 48(1), 7078. https://doi.org/10.1016/j.comppsych.2006.07.002.CrossRefGoogle ScholarPubMed
Cohen, P. (2008). Child development and personality disorder. Psychiatric Clinics of North America, 31(3), 477493. https://doi.org/10.1016/j.psc.2008.03.005.CrossRefGoogle ScholarPubMed
Corbit, L. H., & Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. Journal of Neuroscience, 25(4), 962970. https://doi.org/10.1523/JNEUROSCI.4507-04.2005.CrossRefGoogle ScholarPubMed
Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 3(29), 162173. https://doi.org/10.1006/cbmr.1996.0014.CrossRefGoogle Scholar
Crowell, S. E., Beauchaine, T. P., & Linehan, M. M. (2009). A biosocial developmental model of borderline personality: Elaborating and extending Linehan's theory. Psychological Bulletin, 135(3), 495510. https://doi.org/10.1037/a0015616.CrossRefGoogle ScholarPubMed
Cule, E., & De Iorio, M. (2012). A semi-automatic method to guide the choice of ridge parameter in ridge regression. ArXiv:1205.0686 [q-Bio, Stat]. http://arxiv.org/abs/1205.0686.Google Scholar
Cyders, M. A., & Smith, G. T. (2008). Emotion-based dispositions to rash action: Positive and negative urgency. Psychological Bulletin, 134(6), 807828. https://doi.org/10.1037/a0013341.CrossRefGoogle ScholarPubMed
Cyders, M. A., Smith, G. T., Spillane, N. S., Fischer, S., Annus, A. M., & Peterson, C. (2007). Integration of impulsivity and positive mood to predict risky behavior: Development and validation of a measure of positive urgency. Psychological Assessment, 19(1), 107118. https://doi.org/10.1037/1040-3590.19.1.107.CrossRefGoogle ScholarPubMed
de la Fuente-Fernández, R., Phillips, A. G., Zamburlini, M., Sossi, V., Calne, D. B., Ruth, T. J., & Stoessl, A. J. (2002). Dopamine release in human ventral striatum and expectation of reward. Behavioural Brain Research, 136(2), 359363. https://doi.org/10.1016/S0166-4328(02)00130-4.CrossRefGoogle Scholar
de Reus, M. A., & van den Heuvel, M. P. (2013). Estimating false positives and negatives in brain networks. NeuroImage, 70, 402409. https://doi.org/10.1016/j.neuroimage.2012.12.066.CrossRefGoogle ScholarPubMed
Donegan, N. H., Sanislow, C. A., Blumberg, H. P., Fulbright, R. K., Lacadie, C., Skudlarski, P., … Wexler, B. E. (2003). Amygdala hyperreactivity in borderline personality disorder: Implications for emotional dysregulation. Biological Psychiatry, 54(11), 12841293. https://doi.org/10.1016/S0006-3223(03)00636-X.CrossRefGoogle ScholarPubMed
Enzi, B., Doering, S., Faber, C., Hinrichs, J., Bahmer, J., & Northoff, G. (2011). Reduced deactivation in reward circuitry and midline structures during emotion processing in borderline personality disorder. The World Journal of Biological Psychiatry, 14(1), 4556. https://doi.org/10.3109/15622975.2011.579162.CrossRefGoogle ScholarPubMed
Etkin, A., Egner, T., & Kalisch, R. (2011). Emotional processing in anterior cingulate and medial prefrontal cortex. Trends in Cognitive Sciences, 15(2), 8593. https://doi.org/10.1016/j.tics.2010.11.004.CrossRefGoogle ScholarPubMed
Fareri, D. S., Gabard-Durnam, L., Goff, B., Flannery, J., Gee, D. G., … Tottenham, N. (2015). Normative development of ventral striatal resting-state connectivity in humans. NeuroImage, 118, 422437. https://doi.org/10.1016/j.neuroimage.2015.06.022.CrossRefGoogle ScholarPubMed
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002). Structured clinical interview for DSM-IV-TR axis I disorders. New York: Biometrics Research, New York State Psychiatric Institute.Google Scholar
Floresco, S. B. (2015). The nucleus accumbens: An interface between cognition, emotion, and action. Annual Review of Psychology, 66(1), 2552. https://doi.org/10.1146/annurev-psych-010213-115159.CrossRefGoogle ScholarPubMed
Fonov, V. S., Evans, A. C., McKinstry, R. C., Almli, C. R., & Collins, D. L. (2009). Unbiased nonlinear average age-appropriate brain templates from birth to adulthood. NeuroImage, Supplement 1(47), S102. https://doi.org/10.1016/S1053-8119(09)70884-5.CrossRefGoogle Scholar
Frank, G. K. W., Shott, M. E., Riederer, J., & Pryor, T. L. (2016). Altered structural and effective connectivity in anorexia and bulimia nervosa in circuits that regulate energy and reward homeostasis. Translational Psychiatry, 6(11), e932e932. https://doi.org/10.1038/tp.2016.199.CrossRefGoogle ScholarPubMed
Gates, K. M., & Molenaar, P. C. M. (2012). Group search algorithm recovers effective connectivity maps for individuals in homogeneous and heterogeneous samples. NeuroImage, 63(1), 310319. https://doi.org/10.1016/j.neuroimage.2012.06.026.CrossRefGoogle ScholarPubMed
Gee, D. G., Fetcho, R. N., Jing, D., Li, A., Glatt, C. E., & Drysdale, A. T., … The PING Consortium. (2016). Individual differences in frontolimbic circuitry and anxiety emerge with adolescent changes in endocannabinoid signaling across species. Proceedings of the National Academy of Sciences, 113(16), 45004505. https://doi.org/10.1073/pnas.1600013113.CrossRefGoogle ScholarPubMed
Gregorios-Pippas, L., Tobler, P. N., & Schultz, W. (2009). Short-term temporal discounting of reward value in human ventral Striatum. Journal of Neurophysiology, 101(3), 15071523. https://doi.org/10.1152/jn.90730.2008.CrossRefGoogle ScholarPubMed
Greve, D. N., & Fischl, B. (2009). Accurate and robust brain image alignment using boundary-based registration., accurate and robust brain image alignment using boundary-based registration. NeuroImage, NeuroImage, 48(1, 1), 6372. https://doi.org/10.1016/j.neuroimage.2009.06.060.CrossRefGoogle ScholarPubMed
Harden, K. P., & Tucker-Drob, E. M. (2011). Individual differences in the development of sensation seeking and impulsivity during adolescence: Further evidence for a dual systems model. Developmental Psychology, 47(3), 739746. http://dx.doi.org.ezaccess.libraries.psu.edu/10.1037/a0023279.CrossRefGoogle ScholarPubMed
Hayes, A. F. (2015). An Index and test of linear moderated mediation. Multivariate Behavioral Research, 50(1), 122. https://doi.org/10.1080/00273171.2014.962683.CrossRefGoogle ScholarPubMed
Henry, T. R., Feczko, E., Cordova, M., Earl, E., Williams, S., Nigg, J. T., … Gates, K. M. (2019). Comparing directed functional connectivity between groups with confirmatory subgrouping GIMME. NeuroImage, 188, 642653. https://doi.org/10.1016/j.neuroimage.2018.12.040.CrossRefGoogle ScholarPubMed
Herpertz, S. C., Dietrich, T. M., Wenning, B., Krings, T., Erberich, S. G., Willmes, K., … Sass, H. (2001). Evidence of abnormal amygdala functioning in borderline personality disorder: A functional MRI study. Biological Psychiatry, 50(4), 292298. https://doi.org/10.1016/S0006-3223(01)01075-7.CrossRefGoogle ScholarPubMed
Janak, P. H., & Tye, K. M. (2015). From circuits to behaviour in the amygdala. Nature, 517(7534), 284292. https://doi.org/10.1038/nature14188.CrossRefGoogle ScholarPubMed
Johnson, S. L., Elliott, M. V., & Carver, C. S. (2020). Impulsive responses to positive and negative emotions: Parallel neurocognitive correlates and their implications. Biological Psychiatry, 87(4), 338349. https://doi.org/10.1016/j.biopsych.2019.08.018.CrossRefGoogle ScholarPubMed
Jovanovic, T., & Ressler, K. J. (2010). How the neurocircuitry and genetics of fear inhibition May inform Our understanding of PTSD. American Journal of Psychiatry, 167(6), 648662. https://doi.org/10.1176/appi.ajp.2009.09071074.CrossRefGoogle ScholarPubMed
Kamphausen, S., Schröder, P., Maier, S., Bader, K., Feige, B., Kaller, C. P., … Tüscher, O. (2013). Medial prefrontal dysfunction and prolonged amygdala response during instructed fear processing in borderline personality disorder. The World Journal of Biological Psychiatry, 14(4), 307318. https://doi.org/10.3109/15622975.2012.665174.CrossRefGoogle ScholarPubMed
Kaye, A. P. (2021). Amygdala–Insula circuit computations in posttraumatic stress disorder. Biological Psychiatry, 89(9), e49e50. https://doi.org/10.1016/j.biopsych.2021.03.001.CrossRefGoogle ScholarPubMed
LeDoux, J. (2007). The amygdala. Current Biology: CB, 17(20), R868R874. https://doi.org/10.1016/j.cub.2007.08.005.CrossRefGoogle ScholarPubMed
Linehan, M. (1993). Cognitive-behavioral treatment of borderline personality disorder. New York, NY: Guilford Press.Google Scholar
Lynam, D. R., Smith, G. T., Whiteside, S. P., & Cyders, M. A. (2006). The UPPS-P: Assessing five personality pathways to impulsive behavior (vol. 10). West Lafayette, IN: Purdue University.Google Scholar
Martinez, E., Pasquereau, B., Drui, G., Saga, Y., Météreau, É., & Tremblay, L. (2020). Ventral striatum supports methylphenidate therapeutic effects on impulsive choices expressed in temporal discounting task. Scientific Reports, 10(1), 716. https://doi.org/10.1038/s41598-020-57595-6.CrossRefGoogle ScholarPubMed
Millman, K. J., & Brett, M. (2007). Analysis of functional magnetic resonance imaging in python. Computing in Science Engineering, 9(3), 5255. https://doi.org/10.1109/MCSE.2007.46.CrossRefGoogle Scholar
Minzenberg, M. J., Fan, J., New, A. S., Tang, C. Y., & Siever, L. J. (2007). Fronto-limbic dysfunction in response to facial emotion in borderline personality disorder: An event-related fMRI study. Psychiatry Research: Neuroimaging, 155(3), 231243. https://doi.org/10.1016/j.pscychresns.2007.03.006.CrossRefGoogle ScholarPubMed
Morey, L. (1991). An interpretive guide to the personality assessment inventory professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar
Moritz, S., & Cule, E. (2018). ridge: Ridge Regression with Automatic Selection of the Penalty Parameter (2.3) [Computer software]. https://CRAN.R-project.org/package=ridge.Google Scholar
Motzkin, J. C., Philippi, C. L., Wolf, R. C., Baskaya, M. K., & Koenigs, M. (2015). Ventromedial prefrontal Cortex Is critical for the regulation of amygdala activity in humans. Biological Psychiatry, 77(3), 276284. https://doi.org/10.1016/j.biopsych.2014.02.014.CrossRefGoogle ScholarPubMed
Namburi, P., Beyeler, A., Yorozu, S., Calhoon, G. G., Halbert, S. A., Wichmann, R., … Tye, K. M. (2015). A circuit mechanism for differentiating positive and negative associations. Nature, 520(7549), 675678. https://doi.org/10.1038/nature14366.CrossRefGoogle ScholarPubMed
Nawa, N. E., & Ando, H. (2019). Effective connectivity within the ventromedial prefrontal cortex-hippocampus-amygdala network during the elaboration of emotional autobiographical memories. NeuroImage, 189, 316328. https://doi.org/10.1016/j.neuroimage.2019.01.042.CrossRefGoogle ScholarPubMed
Olino, T. M., Stepp, S. D., Keenan, K., Loeber, R., & Hipwell, A. (2014). Trajectories of depression and anxiety symptoms in adolescent girls: A comparison of parallel trajectory approaches. Journal of Personality Assessment, 96(3), 316326. https://doi.org/10.1080/00223891.2013.866570.CrossRefGoogle ScholarPubMed
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nature Neuroscience, 5(2), 9798. https://doi.org/10.1038/nn802.CrossRefGoogle ScholarPubMed
Pawluk, E. J., & Koerner, N. (2016). The relationship between negative urgency and generalized anxiety disorder symptoms: The role of intolerance of negative emotions and intolerance of uncertainty. Anxiety, Stress, & Coping, 29(6), 606615. https://doi.org/10.1080/10615806.2015.1134786.CrossRefGoogle ScholarPubMed
Pfohl, B., Blum, N. S., & Zimmermann, M. (1997). Structured interview for DSM-IV personality: SIDP-IV. Washington, DC: American Psychiatric Press.Google Scholar
Pruim, R. H. R., Mennes, M., van Rooij, D., Llera, A., Buitelaar, J. K., & Beckmann, C. F. (2015). ICA-AROMA: A robust ICA-based strategy for removing motion artifacts from fMRI data. NeuroImage, 112, 267277. https://doi.org/10.1016/j.neuroimage.2015.02.064.CrossRefGoogle ScholarPubMed
Quinn, P. D., & Harden, K. P. (2013). Differential changes in impulsivity and sensation-seeking and the escalation of substance use from adolescence to early adulthood. Development and Psychopathology, 25(1), 223239. https://doi.org/10.1017/S0954579412000284.CrossRefGoogle ScholarPubMed
Quirk, G. J., & Gehlert, D. R. (2006). Inhibition of the amygdala: Key to pathological states? Annals of the New York Academy of Sciences, 985(1), 263272. https://doi.org/10.1111/j.1749-6632.2003.tb07087.x.CrossRefGoogle Scholar
Quirk, G. J., Likhtik, E., Pelletier, J. G., & Paré, D. (2003). Stimulation of medial prefrontal cortex decreases the responsiveness of central amygdala output neurons. Journal of Neuroscience, 23(25), 88008807. https://doi.org/10.1523/JNEUROSCI.23-25-08800.2003.CrossRefGoogle ScholarPubMed
Roche, A. (2011). A four-dimensional registration algorithm with application to joint correction of motion and slice timing in fMRI. IEEE Transactions on Medical Imaging, 30(8), 15461554. https://doi.org/10.1109/TMI.2011.2131152.CrossRefGoogle ScholarPubMed
Rosenkranz, J. A., & Grace, A. A. (2001). Dopamine attenuates prefrontal cortical suppression of sensory inputs to the basolateral amygdala of rats. Journal of Neuroscience, 21(11), 40904103. https://doi.org/10.1523/JNEUROSCI.21-11-04090.2001.CrossRefGoogle Scholar
Rosenkranz, J. A., & Grace, A. A. (2002). Cellular mechanisms of infralimbic and prelimbic prefrontal cortical inhibition and dopaminergic modulation of basolateral amygdala neurons In vivo. Journal of Neuroscience, 22(1), 324337. https://doi.org/10.1523/JNEUROSCI.22-01-00324.2002.CrossRefGoogle ScholarPubMed
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48, 136. https://doi.org/10.18637/jss.v048.i02.CrossRefGoogle Scholar
Salvador, R., Vega, D., Pascual, J. C., Marco, J., Canales-Rodríguez, E. J., Aguilar, S., Anguera, , … Pomarol-Clotet, E. (2016). Converging medial frontal resting state and diffusion-based abnormalities in borderline personality disorder. Biological Psychiatry, 79(2), 107116. https://doi.org/10.1016/j.biopsych.2014.08.026.CrossRefGoogle ScholarPubMed
Sarkheil, P., Ibrahim, C. N., Schneider, F., Mathiak, K., & Klasen, M. (2019). Aberrant functional connectivity profiles of brain regions associated with salience and reward processing in female patients with borderline personality disorder. Brain Imaging and Behavior. https://doi.org/10.1007/s11682-019-00065-z.Google Scholar
Schaefer, A., Kong, R., Gordon, E. M., Laumann, T. O., Zuo, X.-N., Holmes, A. J., … Yeo, B. T. T. (2018). Local-Global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI. Cerebral Cortex, 28(9), 30953114. https://doi.org/10.1093/cercor/bhx179.CrossRefGoogle ScholarPubMed
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., … Bauer, A. (2008). Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. Journal of Neuroscience, 28(52), 1431114319. https://doi.org/10.1523/JNEUROSCI.2058-08.2008.CrossRefGoogle ScholarPubMed
Schulze, L., Schmahl, C., & Niedtfeld, I. (2016). Neural correlates of disturbed emotion processing in borderline personality disorder: A multimodal meta-analysis. Biological Psychiatry, 79(2), 97106. https://doi.org/10.1016/j.biopsych.2015.03.027.CrossRefGoogle ScholarPubMed
Settles, R. E., Fischer, S., Cyders, M. A., Combs, J. L., Gunn, R. L., & Smith, G. T. (2012). Negative urgency: A personality predictor of externalizing behavior characterized by neuroticism, Low conscientiousness, and disagreeableness. Journal of Abnormal Psychology, 121(1), 160172. https://doi.org/10.1037/a0024948.CrossRefGoogle ScholarPubMed
Shackman, A. J., & Fox, A. S. (2016). Contributions of the central extended amygdala to fear and AnxietyContributions of the central extended amygdala to fear and anxiety. Journal of Neuroscience, 36(31), 80508063. https://doi.org/10.1523/JNEUROSCI.0982-16.2016.CrossRefGoogle ScholarPubMed
Silbersweig, D., Clarkin, J. F., Goldstein, M., Kernberg, O. F., Tuescher, O., Levy, K. N., … Stern, E. (2007). Failure of frontolimbic inhibitory function in the context of negative emotion in borderline personality disorder. The American Journal of Psychiatry, 164(12), 18321841. https://doi.org/10.1176/appi.ajp.2007.06010126.CrossRefGoogle ScholarPubMed
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., … Matthews, P. M. (2004). Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage, Supplement 1(23), S208S219. https://doi.org/10.1016/j.neuroimage.2004.07.051.CrossRefGoogle Scholar
Soloff, P. H., White, R., Omari, A., Ramaseshan, K., & Diwadkar, V. A. (2015). Affective context interferes with brain responses during cognitive processing in borderline personality disorder: FMRI evidence. Psychiatry Research: Neuroimaging, 233(1), 2335. https://doi.org/10.1016/j.pscychresns.2015.04.006.CrossRefGoogle ScholarPubMed
Stein, J. L., Wiedholz, L. M., Bassett, D. S., Weinberger, D. R., Zink, C. F., Mattay, V. S., & Meyer-Lindenberg, A. (2007). A validated network of effective amygdala connectivity. NeuroImage, 36(3), 736745. https://doi.org/10.1016/j.neuroimage.2007.03.022.CrossRefGoogle ScholarPubMed
Steinberg, L., Icenogle, G., Shulman, E. P., Breiner, K., Chein, J., Bacchini, D. C., … Takash, H. M. S. (2018). Around the world, adolescence is a time of heightened sensation seeking and immature self-regulation. Developmental Science, 21(2), e12532. https://doi.org/10.1111/desc.12532.CrossRefGoogle ScholarPubMed
Tottenham, N., & Galván, A. (2016). Stress and the adolescent brain: Amygdala-prefrontal cortex circuitry and ventral striatum as developmental targets. Neuroscience & Biobehavioral Reviews, 70, 217227. https://doi.org/10.1016/j.neubiorev.2016.07.030.CrossRefGoogle ScholarPubMed
Tye, K. M., Prakash, R., Kim, S.-Y., Fenno, L. E., Grosenick, L., Zarabi, H., … Deisseroth, K. (2011). Amygdala circuitry mediating reversible and bidirectional control of anxiety. Nature, 471(7338), 358362. https://doi.org/10.1038/nature09820.CrossRefGoogle ScholarPubMed
Watanabe, N., Bhanji, J. P., Tanabe, H. C., & Delgado, M. R. (2019). Ventromedial prefrontal cortex contributes to performance success by controlling reward-driven arousal representation in amygdala. NeuroImage, 202, 116136. https://doi.org/10.1016/j.neuroimage.2019.116136.CrossRefGoogle ScholarPubMed
Weiss, N. H., Tull, M. T., Sullivan, T. P., Dixon-Gordon, K. L., & Gratz, K. L. (2015). Posttraumatic stress disorder symptoms and risky behaviors among trauma-exposed inpatients with substance dependence: The influence of negative and positive urgency. Drug and Alcohol Dependence, 155, 147153. https://doi.org/10.1016/j.drugalcdep.2015.07.679.CrossRefGoogle ScholarPubMed
Wenzel, K. R., Weinstock, J., Vander Wal, J. S., & Weaver, T. L. (2014). Examining the role of negative urgency in a predictive model of bulimic symptoms. Eating Behaviors, 15(3), 343349. https://doi.org/10.1016/j.eatbeh.2014.04.014.CrossRefGoogle Scholar
Whiteside, S. P., & Lynam, D. R. (2001). The five-factor model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences, 30(4), 669689. https://doi.org/10.1016/S0191-8869(00)00064-7.CrossRefGoogle Scholar
Zahm, D. S., Jensen, S. L., Williams, E. S., & Martin, J. R. (1999). Direct comparison of projections from the central amygdaloid region and nucleus accumbens shell. European Journal of Neuroscience, 11(4), 11191126. https://doi.org/10.1046/j.1460-9568.1999.00524.x.CrossRefGoogle ScholarPubMed
Zanarini, M. C., & Frankenburg, F. R. (1997). Pathways to the development of borderline personality disorder. Journal of Personality Disorders, 11(1), 93104. https://doi.org/10.1521/pedi.1997.11.1.93.CrossRefGoogle Scholar
Zanarini, M. C., Gunderson, J. G., Marino, M. F., Schwartz, E. O., & Frankenburg, F. R. (1989). Childhood experiences of borderline patients. Comprehensive Psychiatry, 30(1), 1825. https://doi.org/10.1016/0010-440X(89)90114-4.CrossRefGoogle ScholarPubMed
Zanarini, M. C., Temes, C. M., Frankenburg, F. R., Reich, D. B., & Fitzmaurice, G. M. (2018). Description and prediction of time-to-attainment of excellent recovery for borderline patients followed prospectively for 20 years. Psychiatry Research, 262, 4045. https://doi.org/10.1016/j.psychres.2018.01.034.CrossRefGoogle ScholarPubMed
Zelkowitz, P., Paris, J., Guzder, J., Feldman, R., Roy, C., & Rosval, L. (2007). A five-year follow-up of patients with borderline pathology of childhood. Journal of Personality Disorders, 21(6), 664674. https://doi.org/10.1521/pedi.2007.21.6.664.CrossRefGoogle ScholarPubMed
Zhang, W.-H., Zhang, J.-Y., Holmes, A., & Pan, B.-X. (2021). Amygdala circuit substrates for stress adaptation and adversity. Biological Psychiatry, 89(9), 847856. https://doi.org/10.1016/j.biopsych.2020.12.026.CrossRefGoogle ScholarPubMed
Zorrilla, E. P., & Koob, G. F. (2019). Impulsivity derived from the dark side: Neurocircuits that contribute to negative urgency. Frontiers in Behavioral Neuroscience, 13, 136. https://doi.org/10.3389/fnbeh.2019.00136.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. Nodes without labels were not fit with CS-GIMME but depict medial prefrontal and ACC nodes that were dropped from our initial consideration set. Arrows reflect the directed influence of one node on another at the group and subgroup (BPD vs control) level. Solid lines denote edges that were estimated at the group (entire sample) level with the solid green edge denoting a significantly higher edge values amongst subjects in the control group. Dashed lines denote edges estimated at the subgroup (BPD vs HC) level, with red and green dashed lines denoting edges that were only estimated for subjects in the BPD and control group, respectively.

Figure 1

Fig. 2. (a) Conceptual diagram of latent growth curve model reported in Table 2. Solid green lines denote positive parameter estimates, demonstrating that group main effects are higher for both intercept terms (overall levels of ERI) in the BPD group. Solid red lines denote negative parameter estimates, demonstrating that age main effects on both intercept terms indicate decreasing levels of ERI in the total sample. Faded red lines denote “marginally” significant parameter estimates (0.05 < p < 0.10). Paths from age that intersect with paths from BPD to LGCM terms represent interactive effects (moderation) of age and group to predict LGCM terms. (b) Visual depiction of age × group interaction for each LGCM term, demonstrating significant group × age interactions for both NU and PU intercept terms and a marginally significant group × age interaction for NU slope.

Figure 2

Fig. 3. (a) Conceptual diagram of final latent growth curve model reported in Table 3. Solid green lines denote positive parameter estimates, demonstrating that main effects are higher for both baseline ERI variables and R CeNin in the BPD group. Solid red lines denote negative parameter estimates, demonstrating that R CeNin decreased with age, and that BPD was associated with lower R CeNout, which was in turn associated with lower (e.g. “more negative”) within-person change in PU. Faded red lines denote “marginally” significant parameter estimates (0.05 < p < 0.10). Paths from age that intersect with paths from R CeNin and R CeNout to LGCM terms represent interactive effects (moderation) of age on the second-stage mediation (i.e. from R CeN connectivity to LGCM terms). (b) Significant moderated mediation of from BPD to NU baseline levels through R CeNout, which was moderated by age. (c) Significant moderated mediation of from BPD to NU within-person change through R CeNout, which was moderated by age. (d) Visual split of moderated mediation into young participants (under 20 years old) and older participants (over 20 years old). Note most importantly the lower left panel, showing that amongst adolescents, participants with higher R CeNout had more negative levels of within-person change in NU over one year, demonstrating more rapid reductions in NU symptoms over the one-year follow-up.

Figure 3

Table 1. Joint model: group differences in in- and -out-degree centrality

Figure 4

Table 2. Parameter table: latent growth curve model of ERI scales and relations to BPD, Age, and their interaction

Figure 5

Table 3. Parameter table: dual-mediator latent growth curve model includes mediation by R CeN in- and out-degree

Supplementary material: File

Hall and Hallquist supplementary material

Hall and Hallquist supplementary material

Download Hall and Hallquist supplementary material(File)
File 3 MB