Hostname: page-component-586b7cd67f-gb8f7 Total loading time: 0 Render date: 2024-11-23T02:00:31.019Z Has data issue: false hasContentIssue false

Tractable limitations of current polygenic scores do not excuse genetically confounded social science

Published online by Cambridge University Press:  11 September 2023

Damien Morris
Affiliation:
Social, Genetic, and Developmental Psychiatry Centre, King's College London, London, UK [email protected] https://www.kcl.ac.uk/people/damien-morris [email protected] https://www.kcl.ac.uk/people/stuart-ritchie
Stuart J. Ritchie
Affiliation:
Social, Genetic, and Developmental Psychiatry Centre, King's College London, London, UK [email protected] https://www.kcl.ac.uk/people/damien-morris [email protected] https://www.kcl.ac.uk/people/stuart-ritchie
Alexander I. Young
Affiliation:
UCLA Anderson School of Management, Los Angeles, CA, USA Human Genetics Department, UCLA David Geffen School of Medicine, Los Angeles, CA, USA [email protected] https://geneticvariance.wordpress.com/

Abstract

Burt's critique of using polygenic scores in social science conflates the “scientific costs” of sociogenomics with “sociopolitical and ethical” concerns. Furthermore, she paradoxically enlists recent advances in controlling for environmental confounding to argue such confounding is scientifically “intractable.” Disinterested social scientists should support ongoing efforts to improve this technology rather than obstructing progress and excusing genetically confounded research.

Type
Open Peer Commentary
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

Burt promises her readers a dispassionate essay challenging the “value of polygenic scores [(PGS)]… for social science.” She states she will do this “not by questioning the ethical or sociopolitical implications of this work…but by scrutinizing the science,” and on this basis will conclude that the “scientific costs outweigh [the] meager benefits.” But the “scientific costs” she enumerates – “obscuring environmental influences, perpetuating a flawed concept of genetic potential…and wasting resources” – are not scientific critiques at all but precisely the “sociopolitical and ethical concerns” she disavows.

Were this a disinterested critique focused on scientific accuracy, Burt would be as concerned about exaggerating the effects of “structural disadvantages and cultural influences” as “obscuring” them. Instead, she admits to “holding sociogenomic methods to higher standards than standard social science methodologies,” excusing this double-standard on the basis of the “social risks” she pledged to leave aside. Similarly, she argues the “scientific costs” of “promoting PGS as ‘genetic potential’…include…promoting the individualization of social problems.” These are ideological objections, not scientific ones.

Burt cautions against “wasting finite resources searching for ‘genes for educational attainment’” – that is, by performing genome-wide association studies (GWASs) that identify genetic variants associated with individual differences in social science outcomes. But a substantial share of the funding for GWASs comes from private and philanthropic sources who disagree with Burt's assessment. As for the remainder, what could be more “sociopolitical” than the question of how taxpayer dollars should be directed by the government and its agencies? Besides, this puts sociogenomics in a Catch-22: Should we fund research to address some of the limitations of PGSs that Burt raises in her essay, or should we give up in despair? Burt counsels despair: “the production of environmentally confounded genetic associations with complex social outcomes is not simply a tractable empirical problem to be addressed with more sophisticated methods. Rather, such confounding is inevitable.”

However, Burt's four substantive criticisms of using PGSs for behavioral outcomes – “relatedness confounding, downward causation, limited coverage of genetic influences, and context-specificity” – are scientifically tractable issues that have substantially been addressed. Within-family studies that use parent or sibling PGS as control variables largely address issues of population stratification and familial confounding, as Burt essentially acknowledges. Furthermore, constructing PGSs from within-family GWASs can remove confounding biases from the PGS. In addition, if the genetic variants associated with behavioral outcomes are principally expressed in the brain rather than in the skin, hair, or musculoskeletal system (e.g., Lee et al., Reference Lee, Wedow, Okbay, Kong, Maghzian, Zacher and Cesarini2018) this constrains the possibility that reported associations are confounded by “downward causation,” that is, by “social selection on attractiveness, height, weight, [or] colorism.” Conducting GWASs in large samples with whole-exome or whole-genome sequencing can increase the fraction of genetic influences covered by PGSs by capturing the effects of rarer variants and shed light on the basic biology underlying behavioral differences (Chen et al., Reference Chen, Tian, Ge, Lam, Sanchez-Andrade, Singh and Runz2022). Finally, extending GWASs to more historically, geographically, and culturally diverse samples will help to quantify the effects of different social contexts on the strength and direction of genetic associations.

The Catch-22 is, however, inescapable: “Even if the problems with environmental confounding could be solved,” Burt insists, “the justification for incorporating PGS into social science is lacking.” This is because, according to Burt, we know the answers to all the important questions already. We don't need PGSs “to demonstrate that supportive, stimulating parenting is associated with child educational attainment” because “we can observe and measure different …background factors and assess how these affect student progressions through educational systems.” But Burt blurs the distinction between the language of association and the language of causation (“affect”). Environmental causation is precisely what genetically controlled designs help establish in observational research. And although we might not need PGSs to recognize “that children who experience childhood disadvantage are not able to fully realize their educational potential,” they can help us more accurately quantify the extent to which various environmental disadvantages account for observed differences in social outcomes and measure how much these effects differ across contexts and conditions. Burt is keen to emphasize the context-specificity of genetic and environmental influences on social outcomes but, as one psychologist forcefully put it, using this as a pretext for “abandoning quantitative estimates is practically and theoretically bankrupt” (Rowe, Reference Rowe1994, p. 24).

The upshot of Burt's critique seems to be that social scientists can safely ignore genetics so long as they include a boilerplate disclaimer that “genetic differences… matter in a complex, context-sensitive way.” But the extent of genetic confounding is not mysterious or unquantifiable. Although Burt is correct that using current PGSs to control for genetic influences is partial at best, a well-established literature going back to the 1970s has used genetically sensitive study designs to investigate social science outcomes. These not only include conventional twin studies (which consistently show genetic differences account for a substantial share of the observed individual differences in social science outcomes, e.g., Frisell, Pawitan, Långström, & Lichtenstein, Reference Frisell, Pawitan, Långström and Lichtenstein2012; Hyytinen, Ilmakunnas, Johansson, & Toivanen, Reference Hyytinen, Ilmakunnas, Johansson and Toivanen2019; Silventoinen et al., Reference Silventoinen, Jelenkovic, Sund, Latvala, Honda, Inui and Kaprio2020) but also a panoply of other genetically sensitive designs, such as adoption designs, extended twin designs, sibling difference designs, and more (Baier, Eilertsen, Ystrom, Zambrana, & Lyngstad, Reference Baier, Eilertsen, Ystrom, Zambrana and Lyngstad2022; Björklund & Salvanes, Reference Björklund, Salvanes, Hanushek, Machin and Woessmann2011; Holmlund, Lindahl, & Plug, Reference Holmlund, Lindahl and Plug2011; Sariaslan et al., Reference Sariaslan, Mikkonen, Aaltonen, Hiilamo, Martikainen and Fazel2021; Wolfram & Morris, Reference Wolfram and Morris2022). These various designs show substantially attenuated statistical associations between predictor and outcome after controlling for genetic confounds and sometimes remove the original association altogether. Burt insists her article is a broadside against “the scientific value of adding genetics to social science” generally, and not just an argument “about the value of PGS for social science,” yet she neglects to explain why these older, kinship-based designs can be safely ignored.

Burt is correct that social scientists should include appropriate caveats when incorporating PGSs into their work and take efforts to control for environmental confounding. But for the reasons outlined above, they should also support ongoing scientific endeavors to improve this technology. They should not – as Burt does – use tractable limitations of research incorporating PGSs as a pretext to obstruct progress or to excuse genetic confounding in social science research.

Financial support

This research received no specific grant from any funding agency, commercial, or not-for-profit sectors.

Competing interest

None.

References

Baier, T., Eilertsen, E. M., Ystrom, E., Zambrana, I. M., & Lyngstad, T. H. (2022). An anatomy of the intergenerational correlation of educational attainment – Learning from the educational attainments of Norwegian twins and their children. Research in Social Stratification and Mobility, 79, 100691. https://doi.org/10.1016/j.rssm.2022.100691.CrossRefGoogle Scholar
Björklund, A., & Salvanes, K. G. (2011). Chapter 3 – Education and family background: Mechanisms and policies. In Hanushek, E. A., Machin, S. & Woessmann, L. (Eds.), Handbook of the economics of education (Vol. 3, pp. 201247). Elsevier. https://doi.org/10.1016/B978-0-444-53429-3.00003-XGoogle Scholar
Chen, C.-Y., Tian, R., Ge, T., Lam, M., Sanchez-Andrade, G., Singh, T., … Runz, H. (2022). The impact of rare protein coding genetic variation on adult cognitive function. medRxiv. (p. 2022.06.24.22276728). https://doi.org/10.1101/2022.06.24.22276728CrossRefGoogle Scholar
Frisell, T., Pawitan, Y., Långström, N., & Lichtenstein, P. (2012). Heritability, assortative mating and gender differences in violent crime: Results from a total population sample using twin, adoption, and sibling models. Behavior Genetics, 42(1), 318. https://doi.org/10.1007/s10519-011-9483-0CrossRefGoogle ScholarPubMed
Holmlund, H., Lindahl, M., & Plug, E. (2011). The causal effect of parents’ schooling on children's schooling: A comparison of estimation methods. Journal of Economic Literature, 49(3), 615651. https://doi.org/10.1257/jel.49.3.615CrossRefGoogle Scholar
Hyytinen, A., Ilmakunnas, P., Johansson, E., & Toivanen, O. (2019). Heritability of lifetime earnings. The Journal of Economic Inequality, 17(3), 319335. https://doi.org/10.1007/s10888-019-09413-xCrossRefGoogle Scholar
Lee, J. J., Wedow, R., Okbay, A., Kong, E., Maghzian, O., Zacher, M., … Cesarini, D. (2018). Gene discovery and polygenic prediction from a genome-wide association study of educational attainment in 1.1 million individuals. Nature Genetics, 50(8), 1112. https://doi.org/10.1038/s41588-018-0147-3CrossRefGoogle ScholarPubMed
Rowe, D. C. (1994). The limits of family influence: Genes, experience, and behavior. Guilford PressGoogle Scholar
Sariaslan, A., Mikkonen, J., Aaltonen, M., Hiilamo, H., Martikainen, P., & Fazel, S. (2021). No causal associations between childhood family income and subsequent psychiatric disorders, substance misuse and violent crime arrests: A nationwide Finnish study of >650 000 individuals and their siblings. International Journal of Epidemiology, 50(5), 16281638. https://doi.org/10.1093/ije/dyab099CrossRefGoogle ScholarPubMed
Silventoinen, K., Jelenkovic, A., Sund, R., Latvala, A., Honda, C., Inui, F., … Kaprio, J. (2020). Genetic and environmental variation in educational attainment: An individual-based analysis of 28 twin cohorts. Scientific Reports, 10(1), 12681. https://doi.org/10.1038/s41598-020-69526-6CrossRefGoogle ScholarPubMed
Wolfram, T., & Morris, D. (2022). Conventional twin studies overestimate the environmental differences between families relevant to educational attainment. PsyArXiv. https://doi.org/10.31234/osf.io/m4eqvCrossRefGoogle Scholar