Hostname: page-component-745bb68f8f-b6zl4 Total loading time: 0 Render date: 2025-02-11T01:36:44.421Z Has data issue: false hasContentIssue false
  • English
  • Français

Structure of internalizing and externalizing symptoms in early adolescence: A comparison of a bifactor and a two-factor model over time and across reporters

Published online by Cambridge University Press:  10 February 2025

Matthew D. Scalco Open the ORCID record for Matthew D. Scalco [Opens in a new window] ,
Yuliya Kotelnikova Open the ORCID record for Yuliya Kotelnikova [Opens in a new window] ,
Miranda Evans ,
Chris Harshaw ,
Nicole M. Webre ,
Lilliana J. Lengua Open the ORCID record for Lilliana J. Lengua [Opens in a new window]  and
Craig R. Colder
Matthew D. Scalco*
Affiliation:
Psychology, University of New Orleans College of Sciences, New Orleans, LA, USA
Yuliya Kotelnikova
Affiliation:
Psychology, University of New Orleans College of Sciences, New Orleans, LA, USA
Miranda Evans
Affiliation:
Psychology, University of New Orleans College of Sciences, New Orleans, LA, USA
Chris Harshaw
Affiliation:
Psychology, University of New Orleans College of Sciences, New Orleans, LA, USA
Nicole M. Webre
Affiliation:
Psychology, University of New Orleans College of Sciences, New Orleans, LA, USA
Lilliana J. Lengua
Affiliation:
Psychology, University of Washington, Seattle, WA, USA
Craig R. Colder
Affiliation:
Psychology, University at Buffalo, Buffalo, NY, USA
*
Corresponding author: Matthew D. Scalco; Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Psychopathology assessed across the lifespan often can be summarized with a few broad dimensions: internalizing, externalizing, and psychosis/thought disorder. Extensive overlap between internalizing and externalizing symptoms has garnered interest in bifactor models comprised of a general co-occurring factor and specific internalizing and externalizing factors. We focus on internalizing and externalizing symptoms and compare a bifactor model to a correlated two-factor model of psychopathology at three timepoints in a large adolescent community sample (N = 387; 55 % female; 83% Caucasian; M age = 12.1 at wave 1) using self- and parent-reports. Each model was tested within each time-point with 25–28 validators. The bifactor models demonstrated better fit to the data. Child report had stronger invariance across time. Parent report had stronger reliability over time. Cross-informant correlations between the factors at each wave indicated that the bifactor model had slightly poorer convergent validity but stronger discriminant validity than the two-factor model. With notable exceptions, this pattern of results replicated across informants and waves. The overlap between internalizing and externalizing pathology is systematically and, sometimes, non-linearly related to risk factors and maladaptive outcomes. Strengths and weaknesses to modeling psychopathology as two or three factors and clinical and developmental design implications are discussed.

Keywords

Bifactorexternalizinginternalizingstructure of psychopathologyvalidity
Type
Regular Article
Information
Development and Psychopathology , First View , pp. 1 - 27
Check for updates
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. University of Vermont, Research Center for Children, Youth, & Families.Google Scholar
Afzali, M. H., Sunderland, M., Carragher, N., & Conrod, P. (2018). The structure of psychopathology in early adolescence: Study of a canadian sample. The Canadian Journal of Psychiatry / La Revue Canadienne De Psychiatrie, 63(4), 223–230. https://doi.org/10.1177/0706743717737032 Google ScholarPubMed
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association, American Psychiatric Association.Google Scholar
Bader, M., & Moshagen, M. (2022). No probifactor model fit index bias, but a propensity toward selecting the best model. Journal of Psychopathology and Clinical Science, 131(6), 689–695. https://doi.org/10.1037/abn0000685 CrossRefGoogle ScholarPubMed
Black, L., Panayiotou, M., & Humphrey, N. (2019). The dimensionality and latent structure of mental health difficulties and wellbeing in early adolescence. PLoS ONE, 14(2), e0213018. https://doi.org/10.1371/journal.pone CrossRefGoogle ScholarPubMed
Bonifay, W., Lane, S. P., & Reise, S. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184–186.CrossRefGoogle Scholar
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81.CrossRefGoogle ScholarPubMed
Canty, A., & Ripley, B. D. (2022). Bootstrap R (S-Plus) functions. R package version 1.3-28.1.Google Scholar
Carragher, N., Teesson, M., Sunderland, M., Newton, N. C., Krueger, R. F., Conrod, P. J., Barrett, E. L., Champion, K. E., Nair, N. K., & Slade, T. (2016). The structure of adolescent psychopathology: A symptom-level analysis. Psychological Medicine, 46(5), 981–994. https://doi.org/10.1017/S0033291715002470 CrossRefGoogle ScholarPubMed
Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H. L., Israel, S., Meier, M. H., Ramrakha, S., Shalev, I., Poulton, R., & Moffitt, T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137. https://doi.org/10.1177/2167702613497473 CrossRefGoogle Scholar
Castellanos-Ryan, N., Brière, F. N., O’Leary-Barrett, M., Banaschewski, T., Bokde, A., Bromberg, U., Büchel, C., Flor, H., Frouin, V., Gallinat, J., Garavan, H., Martinot, J.-L., Nees, F., Paus, T., Pausova, Z., Rietschel, M., Smolka, M. N., Robbins, T. W., Whelan, R., Schumann, G., & Conrod, P. (2016). The structure of psychopathology in adolescence and its common personality and cognitive correlates. Journal of Abnormal Psychology, 125(8), 1039–1052. https://doi.org/10.1037/abn0000193 CrossRefGoogle ScholarPubMed
Clark, D. A., Hicks, B. M., Angstadt, M., Rutherford, S., Taxali, A., Hyde, L., Weigard, A. S., Heitzeg, M. M., & Sripada, C. (2021). The general factor of psychopathology in the adolescent brain cognitive development (ABCD) study: A comparison of alternative modeling approaches. Clinical Psychological Science, 9(2), 169–182. https://doi.org/10.1177/2167702620959317 CrossRefGoogle ScholarPubMed
Cohen, J. (1988). The effect size. In: Statistical power analysis for the behavioral sciences (pp. 77–83). Lawrence Erlbaum Associates.Google Scholar
Coie, J. D., Lochman, J. E., Terry, R., & Hyman, C. (1992). Predicting early adolescent disorder from childhood aggression and peer rejection. Journal of Consulting and Clinical Psychology, 60(5), 783–792.CrossRefGoogle ScholarPubMed
Colder, C. R., Scalco, M., Trucco, E. M., Read, J. P., Lengua, L. J., Wieczorek, W. F., & Hawk, L. W. (2013). Prospective associations of internalizing and externalizing problems and their co-occurrence with early adolescent substance use. Journal of Abnormal Child Psychology, 41(4), 667–677.CrossRefGoogle ScholarPubMed
Colder, C. R., Trucco, E. M., Lopez, H. I., Hawk, L. W. Jr, Read, J. P., Lengua, L. J., Weiczorek, W. F., & Eiden, R. D. (2011). Revised reinforcement sensitivity theory and laboratory assessment of BIS and BAS in children. Journal of Research in Personality, 45(2), 198–207. https://doi.org/10.1016/j.jrp.2011.01.005 CrossRefGoogle ScholarPubMed
Coplan, R. J., Prakash, K., O’Neil, K., & Armer, M. (2004). Do you “want” to play? Distinguishing between conflicted shyness and social disinterest in early childhood. Developmental Psychology, 40(2), 244–258.CrossRefGoogle Scholar
Costello, E. J., Copeland, W., & Angold, A. (2011). Trends in psychopathology across the adolescent years: What changes when children become adolescents, and when adolescents become adults? Journal of Child Psychology and Psychiatry, 52(10), 1015–1025.CrossRefGoogle ScholarPubMed
Cotter, K. L., & Smokowski, P. R. (2016). Perceived peer delinquency and externalizing behavior among rural youth: The role of descriptive norms and internalizing symptoms. Journal of Youth and Adolescence, 45, 520–531.CrossRefGoogle ScholarPubMed
Crews, S. D., Bender, H., Cook, C. R., Gresham, F. M., Kern, L., & Vanderwood, M. (2007). Risk and protective factors of emotional and/or behavioral disorders in children and adolescents: A mega-analytic synthesis. Behavioral Disorders, 32(2), 64–77.CrossRefGoogle Scholar
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.CrossRefGoogle ScholarPubMed
Darling, N., Cumsille, P., Caldwell, L. L., & Dowdy, B. (2006). Predictors of adolescents’ disclosure to parents and perceived parental knowledge: Between- and within-person differences. Journal of Youth and Adolescence, 35(4), 667–678. https://doi.org/10.1007/s10964-006-9058-1 CrossRefGoogle Scholar
Dodge, K. A., Pettit, G. S., Bates, J. E., & Valente, E. (1995). Social information processing patterns partially mediate the effect of early physical abuse on later conduct problems. Journal of Abnormal Psychology, 104(4), 632–643.CrossRefGoogle ScholarPubMed
Dueber, D. M. (2017). Bifactor indices calculator: A microsoft excel-based tool to calculate various indices relevant to bifactor CFA models. https://doi.org/10.13023/edp.tool.01.CrossRefGoogle Scholar
Dwyer, S. B., Nicholson, J. M., & Battistutta, D. (2006). Parent and teacher identification of children at risk of developing internalizing or externalizing mental health problems: A comparison of screening methods. Prevention Science, 7(4), 343–357.CrossRefGoogle ScholarPubMed
Elliott, D. S., & Huizinga, D. (1983). Social class and delinquent behavior in a national youth panel. Criminology: An Interdisciplinary Journal, 21(2), 149–177. https://doi.org/10.1111/j.1745-9125.1983.tb00256.x CrossRefGoogle Scholar
Ellis, L. K., & Rothbart, M. K. (2001). Revision of the early adolescent temperament questionnaire. In: Poster presented at the 2001 biennial meeting of the society for research in child development.Google Scholar
Fergusson, D. M., Woodward, L. J., & Horwood, L. J. (1999). Childhood peer relationship problems and young people’s involvement with deviant peers in adolescence. Journal of Abnormal Child Psychology, 27(5), 357–369. https://doi.org/10.1023/A:1021923917494 CrossRefGoogle Scholar
Foster, K. T., Hicks, B. M., & Zucker, R. A. (2018). Positive and negative effects of internalizing on alcohol use problems from childhood to young adulthood: The mediating and suppressing role of externalizing. Journal of Abnormal Psychology, 12(4), 394–403.CrossRefGoogle Scholar
Fried, E. I., Greene, A. L., & Eaton, N. R. (2021). The p factor is the sum of its parts, for now. World Psychiatry, 20(1), 69–70.CrossRefGoogle Scholar
Gignac, G. E. (2016). The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence (Norwood), 55, 57–68. https://doi.org/10.1016/j.intell.2016.01.006 CrossRefGoogle Scholar
Gjone, H., & Stevenson, J. (1997). The association between internalizing and externalizing behavior in childhood and early adolescence: Genetic or environmental common influences? Journal of Abnormal Child Psychology, 25(4), 277–286. https://doi.org/10.1023/A:1025708318528 CrossRefGoogle ScholarPubMed
Gray, J. A. (1991). The neuropsychology of temperament. In Strelau, J., & Angleitner, A. (Ed.), Explorations in temperament: International perspectives on theory and measurement (pp. 105–128). Plenum Press.CrossRefGoogle Scholar
Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., Waldman, I. D., Cicero, D. C., Conway, C. C., Docherty, A. R., Fried, E. I., Ivanova, M. Y., Jonas, K. G., Latzman, R. D., Patrick, C. J., Reininghaus, U., Tackett, J. L., Wright, A. G. C., & Kotov, R. (2019). Are fit indices used to test psychopathology structure biased? A simulation study. Journal of Abnormal Psychology, 128(7), 740–764.CrossRefGoogle ScholarPubMed
Haltigan, J. D., Aitken, M., Skilling, T., Henderson, J., Hawke, L., Battaglia, M., Strauss, J., Szatmari, P., & Andrade, B. F. (2018). “P” and “DP:” examining symptom-level bifactor models of psychopathology and dysregulation in clinically referred children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 57(6), 384–396. https://doi.org/10.1016/j.jaac.2018.03.010 CrossRefGoogle ScholarPubMed
Hamlat, E. J., Snyder, H. R., Young, J. F., & Hankin, B. L. (2019). Pubertal timing as a transdiagnostic risk for psychopathology in youth. Clinical Psychological Science, 7(3), 411–429. https://doi.org/10.1177/2167702618810518 CrossRefGoogle ScholarPubMed
Hankin, B. L., Poggi, E., Snyder, H., Young, J. F., Glynn, M., & Sandman, C. A. (2017). Temperament factors and dimensional, latent bifactor models of child psychopathology: Transdiagnostic and specific associations in two youth samples. Psychiatry Research, 252(2), 139–146. https://doi.org/10.1111/j.1467-8330.1974.tb00606.x CrossRefGoogle ScholarPubMed
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118 CrossRefGoogle Scholar
Kagan, J. (1998). Biology and the child. In Damon, W., & Eisenberg, N. (Ed.), Handbook of child psychology: Vol. 3.Social, emotional, and personality development (Vol. 3, 5th ed. pp. 177–235). Wiley.Google Scholar
Keeley, J., & Blashfield, R. K. (2010). Clinicians’ conceptualizations of comorbid cases: A test of additive versus nonadditive models. Journal of Clinical Psychology, 66(10), 1121–1130.CrossRefGoogle Scholar
Keiley, M. K., Lofthouse, N., Bates, J. E., Dodge, K. A., & Pettit, G. S. (2003). Differential risks of covarying and pure components in mother and teacher reports of externalizing and internalizing behavior across ages 5 to 14. Journal of Abnormal Child Psychology, 31(3), 267–283. https://doi.org/10.1023/A:1023277413027 CrossRefGoogle ScholarPubMed
Kochenderfer, B. J., & Ladd, G. W. (1996). Peer victimization: Manifestations and relations to school adjustment in kindergarten. Journal of School Psychology, 34(3), 267–283. https://doi.org/10.1016/0022-4405(96)00015-5 CrossRefGoogle Scholar
Kotelnikova, Y., Mackrell, S. V. M., Jordan, P. L., & Hayden, E. P. (2015). Longitudinal associations between reactive and regulatory temperament traits and depressive symptoms in middle childhood. Journal of Clinical Child and Adolescent Psychology, 44(5), 775–786. https://doi.org/10.1080/15374416.2014.893517 CrossRefGoogle ScholarPubMed
Kotelnikova, Y., Olino, T. M., Klein, D. N., Kryski, K. R., & Hayden, E. P. (2016). Higher- and lower-order factor analyses of the children’s behavior questionnaire in early and middle childhood. Psychological Assessment, 28(1), 92–108. https://doi.org/10.1037/pas0000153 CrossRefGoogle ScholarPubMed
Kotelnikova, Y., Olino, T. M., Klein, D. N., Mackrell, S. V. M., & Hayden, E. P. (2017). Higher and lower order factor analyses of the temperament in middle childhood questionnaire. Assessment, 24(8), 1050–1061. https://doi.org/10.1177/1073191116639376 CrossRefGoogle ScholarPubMed
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., Eaton, N. R., Forbes, M. K., Forbush, K. T., Goldberg, D., Hasin, D., Hyman, S. E., Ivanova, M. Y., Lynam, D. R., Markon, K., Miller, J. D., Moffitt, T. E., Morey, L. C., Mullins-Sweatt, S. N., Ormel, J., Patrick, C. J., Regier, D. A., Rescorla, L., Ruggero, C. J., Samuel, D. B., Sellbom, M., Simms, L. J., Skodol, A. E., Slade, T., South, S. C., Tackett, J. L., Waldman, I. D., Waszczuk, M. A., Widiger, T. A., Wright, A. G. C., & Zimmerman, M. (2017). The hierarchical taxonomy of psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454–477. https://doi.org/10.1037/abn0000258 CrossRefGoogle ScholarPubMed
Krueger, R. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56(10), 921–926.CrossRefGoogle ScholarPubMed
La Greca, A. M., & Lopez, N. (1998). Social anxiety among adolescents: Linkages with peer relations and friendships. Journal of Abnormal Child Psychology, 26, 83–94.CrossRefGoogle ScholarPubMed
Laceulle, O. M., Chung, J. M., Vollebergh, W. A. M., & Ormel, J. (2019). The wide-ranging life outcome correlates of a general psychopathology factor in adolescent psychopathology. Personality and Mental Health, 14(1), 9–29. https://doi.org/10.1002/pmh.1465 CrossRefGoogle ScholarPubMed
Laceulle, O. M., Vollebergh, W. A. M., & Ormel, J. (2015). The structure of psychopathology in adolescence: Replication of a general psychopathology factor in the trails study. Clinical Psychological Science, 3(6), 850–860. https://doi.org/10.1177/2167702614560750 CrossRefGoogle Scholar
Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012). Is there a general factor of prevalent psychopathology during adulthood? Journal of Abnormal Psychology, 121(4), 971–977. https://doi.org/10.1037/a0028355 CrossRefGoogle Scholar
Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D., & Zald, D. H. (2017). A hierarchical causal taxonomy of psychopathology across the life span. Psychological Bulletin, 143(2), 142–186. https://doi.org/10.1037/bul0000069 CrossRefGoogle ScholarPubMed
Lahey, B. B., Moore, T. M., Kaczkurkin, A. N., & Zald, D. H. (2021). Hierarchical models of psychopathology: Empirical support, implications, and remaining issues. World Psychiatry, 20(1), 57–63.CrossRefGoogle ScholarPubMed
Lahey, B. B., Van Hulle, C. A., Singh, A. L., Waldman, I. D., & Rathouz, P. J. (2011). Higher-order genetic and environmental structure of prevalent forms of child and adolescent psychopathology. Archives of General Psychiatry, 68(2), 181–189. https://doi.org/10.1001/archgenpsychiatry.2010.192 CrossRefGoogle ScholarPubMed
Lahey, B. B., Zald, D. H., Perkins, S. F., Villalta‐Gil, V., Werts, K. B., Van Hulle, C. A., Rathouz, P. J., Applegate, B., Class, Q. A., Poore, H. E., Watts, A. L., & Waldman, I. D. (2018). Measuring the hierarchical general factor model of psychopathology in young adults. International Journal of Methods in Psychiatric Research, 27(1), 1–9. https://doi.org/10.1002/mpr.1593 CrossRefGoogle ScholarPubMed
Lengua, L. J., Sadowski, C. A., Friedrich, W. N., & Fisher, J. (2001). Rationally and empirically derived dimensions of children’s symptomatology: Expert ratings and confirmatory factor analyses of the CBCL. Journal of Consulting and Clinical Psychology, 69(4), 683–698.CrossRefGoogle ScholarPubMed
Levin-Aspenson, H., Watson, D., Clark, L. A., & Zimmerman, M. (2021). What is the general factor of psychopathology? Consistency of the p factor across samples. Assessment, 28(4), 1035–1049. https://doi.org/10.1177/1073191120954921 CrossRefGoogle Scholar
Lynch, S. J., Sunderland, M., Newton, N. C., & Chapman, C. (2021). A systematic review of transdiagnostic risk and protective factors for general and specific psychopathology in young people. Clinical Psychology Review, 87, 102036. https://doi.org/10.1016/j.cpr.2021 CrossRefGoogle ScholarPubMed
Markon, K. E. (2019). Bifactor and hierarchical models: Specification, inference, and interpretation. Annual Review of Clinical Psychology, 15(1), 51–69. https://doi.org/10.1146/annurev-clinpsy-050718-095522 CrossRefGoogle ScholarPubMed
Martel, M. M., Pan, P. M., Hoffmann, M. D. S., Gadelha, A., do Rosário, M. C., Mari, J. J., Manfro, G. G., Miguel, E. D. C., Paus, T., Bressan, R. A., Rohde, L. A., & Salum, G. A. (2017). A general psychopathology factor (P factor) in children: Structural model analysis and external validation through familial risk and child global executive function. Journal of Abnormal Psychology, 126(1), 137–148. https://doi.org/10.1037/abn0000205 CrossRefGoogle ScholarPubMed
McElroy, E., Belsky, J., Carragher, N., Fearon, P., & Patalay, P. (2018). Developmental stability of general and specific factors of psychopathology from early childhood to adolescence: Dynamic mutualism or p-differentiation? Journal of Child Psychology and Psychiatry, 59(6), 667–675. https://doi.org/10.1111/jcpp CrossRefGoogle ScholarPubMed
Moore, T. M., Kaczkurkin, A. N., Durham, E. L., Jeong, H. J., McDowell, M. G., Dupont, R. M., Applegate, B., Tackett, J. L., Cardenas-Iniguez, C., Kardan, O., Akcelik, G. N., Stier, A. J., Rosenberg, M. D., Hedeker, D., Berman, M. G., & Lahey, B. B. (2020). Criterion validity and relationships between alternative hierarchical dimensional models of general and specific psychopathology. Journal of Abnormal Psychology, 129(7), 677–688. https://doi.org/10.1037/abn0000601 CrossRefGoogle ScholarPubMed
Murray, A. L., Eisner, M., & Ribeaud, D. (2016). The development of the general factor of psychopathology p factor through childhood and adolescence. Journal of Abnormal Child Psychology, 44(8), 1573–1586. https://doi.org/10.1007/s10802-016-0132-1 CrossRefGoogle ScholarPubMed
Muthén, L. K., & Muthén, B. O. (2017). Mplus Statistical Analysis with Latent Variables User's Guide (Version 8). Muthén & Muthén.Google Scholar
Neumann, A., Pappa, I., Lahey, B. B., Verhulst, F. C., Medina-Gomez, C., Jaddoe, V. W., Bakermans-Kranenburg, M. J., Moffitt, T. E., van IJzendoorn, M. H., & Tiemeier, H. (2016). Single nucleotide polymorphism heritability of a general psychopathology factor in children. Journal of the American Academy of Child & Adolescent Psychiatry, 55(12), 1038–1045. https://doi.org/10.1016/j.jaac.2016.09.498 CrossRefGoogle ScholarPubMed
Noordhof, A., Krueger, R. F., Ormel, J., Oldehinkel, A. J., & Hartman, C. A. (2015). Integrating autism-related symptoms into the dimensional internalizing and externalizing model of psychopathology. the TRAILS study. Journal of Abnormal Child Psychology, 43(3), 577–587. https://doi.org/10.1007/s10802-014-9923-4 CrossRefGoogle ScholarPubMed
Olino, T. M., Bufferd, S. J., Dougherty, L. R., Dyson, M. W., Carlson, G. A., & Klein, D. N. (2018). The development of latent dimensions of psychopathology across early childhood: Stability of dimensions and moderators of change. Journal of Abnormal Child Psychology, 46(7), 1373–1383. https://doi.org/10.1007/s10802-018-0398-6 CrossRefGoogle ScholarPubMed
Olino, T. M., Dougherty, L. R., Bufferd, S. J., Carlson, G. A., & Klein, D. N. (2014). Testing models of psychopathology in preschool-aged children using a structured interview-based assessment. Journal of Abnormal Child Psychology, 42(7), 1201–1211. https://doi.org/10.1007/s10802-014-9865-x CrossRefGoogle ScholarPubMed
Panak, W. F., & Garber, J. (1992). Role of aggression, rejection, and attributions in the prediction of depression in children. Development and Psychopathology, 4(1), 145–165.CrossRefGoogle Scholar
Patalay, P., Fonagy, P., Deighton, J., Belsky, J., Vostanis, P., & Wolpert, M. (2015). A general psychopathology factor in early adolescence. British Journal of Psychiatry, 207(1), 15–22. https://doi.org/10.1192/bjp.bp.114.149591 CrossRefGoogle ScholarPubMed
Peterson, A. C., Crockett, L., Richards, M., & Boxer, A. (1988). A self-report measure of pubertal status: Reliability, validity, and initial norms. Journal of Youth and Adolescence, 17, 117–133.CrossRefGoogle Scholar
Pettersson, E., Lahey, B. B., Larsson, H., & Lichtenstein, P. (2018). Criterion validity and utility of the general factor of psychopathology in childhood: Predictive associations with independently measured severe adverse mental health outcomes in adolescence. Journal of the American Academy of Child & Adolescent Psychiatry, 57(6), 372–383. https://doi.org/10.1016/j.jaac.2017.12.016 CrossRefGoogle ScholarPubMed
Pillow, D. R., Pelham, W. E. Jr., Hoza, B., Molina, B. S. G., & Stultz, C. H. (1998). Confirmatory factor analyses examining attention deficit hyperactivity disorder symptoms and other childhood disruptive behaviors. Journal of Abnormal Child Psychology, 26(4), 293–309. https://doi.org/10.1023/A:1022658618368 CrossRefGoogle ScholarPubMed
Platt, J. M., Colich, N. L., McLaughlin, K. A., Gary, D., & Keyes, K. M. (2017). Transdiagnostic psychiatric disorder risk associated with early age of menarche: A latent modeling approach. Comprehensive Psychiatry, 79, 70–79. https://doi.org/10.1016/j.comppsych.2017.06.010 CrossRefGoogle ScholarPubMed
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012 CrossRefGoogle ScholarPubMed
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150.CrossRefGoogle ScholarPubMed
Ronald, A. (2019). The psychopathology p factor: Will it revolutionise the science and practice of child and adolescent psychiatry? Journal of Child Psychology and Psychiatry, 60(5), 497–499.CrossRefGoogle ScholarPubMed
Rothbart, M. K. (2012). Advances in temperament. In Handbook of temperament (pp. 3–20). The Guilford Press.Google Scholar
Scalco, M. D., Colder, C. R., Read, J. P., Lengua, L. J., Wieczorek, W. F., & Hawk, L. W. (2021). Testing alternative cascades from internalizing and externalizing symptoms to adolescent alcohol use and alcohol use disorder through co-occurring symptoms and peer delinquency. Development and Psychopathology, 33(1), 29–46.CrossRefGoogle ScholarPubMed
Scalco, M. D., Meisel, S. N., & Colder, C. R. (2016). Misperception and accurate perception of close friend substance use in early adolescence: Developmental and intervention implications. Psychology of Addictive Behaviors, 30(3), 300–311. https://doi.org/10.1037/adb0000175 CrossRefGoogle ScholarPubMed
Slade, T., & Watson, D. (2006). The structure of common DSM-IV and ICD-10 mental disorders in the australian general population. Psychological Medicine, 36(11), 1593–1600. https://doi.org/10.1017/S0033291706008452 CrossRefGoogle ScholarPubMed
Smith, G. T., Atkinson, E. A., Davis, H. A., Riley, E. N., & Oltmanns, J. R. (2020). The general factor of psychopathology. Annual Review of Clinical Psychology, 16(1), 75–98. https://doi.org/10.1146/annurev-clinpsy-071119-115848 CrossRefGoogle ScholarPubMed
Snyder, H. R., Young, J. F., & Hankin, B. L. (2017). Strong homotypic continuity in common psychopathology-, internalizing-, and externalizing-specific factors over time in adolescents. Clinical Psychological Science, 5(1), 98–110. https://doi.org/10.1177/2167702616651076 CrossRefGoogle ScholarPubMed
Stochl, J., Khandaker, G. M., Lewis, G., Perez, J., Goodyer, I. M., Zammit, S., Sullivan, S., Croudace, T. J., & Jones, P. B. (2015). Mood, anxiety and psychotic phenomena measure a common psychopathological factor. Psychological Medicine, 45(7), 1483–1493.CrossRefGoogle Scholar
Sung, M., Erkanli, A., Angold, A., & Costello, E. J. (2004). Effects of age at first substance use and psychiatric comorbidity on the development of substance use disorders. Drug and Alcohol Dependence, 75(3), 287–299.CrossRefGoogle ScholarPubMed
Tackett, J. L., Lahey, B. B., Van Hulle, C., Waldman, I., Krueger, R. F., & Rathouz, P. J. (2013). Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. Journal of Abnormal Psychology, 122(4), 1142.CrossRefGoogle Scholar
Tuvblad, C., Zheng, M., Raine, A., & Baker, L. A. (2009). A common genetic factor explains the covariation among ADHD, ODD, and CD symptoms in 9-10-year-old boys and girls. Journal of Abnormal Child Psychology, 37(2), 153–167. https://doi.org/10.1007/s10802-008-9278- CrossRefGoogle ScholarPubMed
van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2020). Multitrait-multimethod analyses of change of internalizing and externalizing problems in adolescence: Predicting internalizing and externalizing DSM disorders in adulthood. Journal of Abnormal Psychology, 129(4), 343–354. https://doi.org/10.1037/abn0000510 CrossRefGoogle ScholarPubMed
Vine, V., Byrd, A. L., Mohr, H., Scott, L. N., Beeney, J. E., & Stepp, S. D. (2020). The structure of psychopathology in a sample of clinically referred, emotionally dysregulated early adolescents. Journal of Abnormal Child Psychology, 48(11), 1379–1393.CrossRefGoogle Scholar
Vitaro, F., Brendgen, M., & Wanner, B. (2005). Patterns of affiliation with delinquent friends during late childhood and early adolescence: Correlates and consequences. Social Development, 14(1), 82–108.CrossRefGoogle Scholar
Wang, F. L., Eisenberg, N., Valiente, C., & Spinrad, T. L. (2016). Role of temperament in early adolescent pure and co-occurring internalizing and externalizing problems using a bifactor model: Moderation by parenting and gender. Development and Psychopathology, 28(4pt2), 1487–1504.CrossRefGoogle ScholarPubMed
Supplementary material: File

Scalco et al. supplementary material

Scalco et al. supplementary material
Download Scalco et al. supplementary material(File)
File 96.9 KB