Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-29T15:04:20.108Z Has data issue: false hasContentIssue false
  • English
  • Français

Refining the assessment of disrupted maternal communication: Using item response models to identify central indicators of disrupted behavior

Published online by Cambridge University Press:  17 December 2017

John D. Haltigan ,
Sheri Madigan ,
Elisa Bronfman ,
Heidi N. Bailey ,
Catherine Borland-Kerr ,
Roger Mills-Koonce Open the ORCID record for Roger Mills-Koonce [Opens in a new window]  and
Karlen Lyons-Ruth
John D. Haltigan*
Affiliation:
University of Toronto
Sheri Madigan
Affiliation:
University of Calgary Alberta Children's Hospital Research Institute
Elisa Bronfman
Affiliation:
Harvard Medical School
Heidi N. Bailey
Affiliation:
University of Guelph
Catherine Borland-Kerr
Affiliation:
Family & Children's Services of Guelph & Wellington County
Roger Mills-Koonce
Affiliation:
University of North Carolina at Greensboro
Karlen Lyons-Ruth
Affiliation:
Harvard Medical School
*
Address correspondence and reprint requests to: John D. Haltigan, Department of Psychiatry, University of Toronto, Toronto, Canada; E-mail: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

The Atypical Maternal Behavior Instrument for Assessment and Classification (AMBIANCE; Bronfman, Madigan, & Lyons-Ruth, 2009–2014; Bronfman, Parsons, & Lyons-Ruth, 1992–2004) is a widely used and well-validated measure for assessing disrupted forms of caregiver responsiveness within parent–child interactions. However, it requires evaluating approximately 150 behavioral items from videotape and extensive training to code, thus making its use impractical in most clinical contexts. Accordingly, the primary aim of the current study was to identify a reduced set of behavioral indicators most central to the AMBIANCE coding system using latent-trait item response theory (IRT) models. Observed mother–infant interaction data previously coded with the AMBIANCE was pooled from laboratories in both North America and Europe (N = 343). Using 2-parameter logistic IRT models, a reduced set of 45 AMBIANCE items was identified. Preliminary convergent and discriminant validity was evaluated in relation to classifications of maternal disrupted communication assigned using the full set of AMBIANCE indicators, to infant attachment disorganization, and to maternal sensitivity. The results supported the construct validity of the refined item set, opening the way for development of a brief screening measure for disrupted maternal communication. IRT models in clinical scale refinement and their potential for bridging clinical and research objectives in developmental psychopathology are discussed.

Type
Regular Articles
Information
Development and Psychopathology , Volume 31 , Special Issue 1: The effect of maltreatment experiences on maltreating and dysfunctional parenting: A search for mechanisms , February 2019 , pp. 261 - 277
Copyright
Copyright © Cambridge University Press 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We are grateful to our collaborators and colleagues who contributed data for this project and to the families who participated in the studies. Further work with the refined Atypical Maternal Behavior Instrument for Assessment and Classification item set presented in this manuscript is being supported by the Social Sciences and Humanities Research Council of Canada.

References

Ainsworth, M. D. S., Blehar, M., Waters, E., & Wall, S. (1978). Patterns of attachment: A psychological study of the Strange Situation. Hillsdale, NJ: Erlbaum.Google Scholar
Albanese, M. T., & Knott, M. (1994). Bootstrapping latent variable models for binary response. British Journal of Mathematical and Statistical Psychology, 47, 235–246. doi:10.1111/j.2044-8317.1994.tb01036.xGoogle Scholar
Baker, F. B. (2001). The basics of item response theory. College Park, MD: University of Maryland, ERIC Clearinghouse on Assessment and Evaluation.Google Scholar
Bernier, A., & Meins, E. (2008). A threshold approach to understanding the origins of attachment disorganization. Developmental Psychology, 44, 969–982. doi:10.1037/0012-1649.44.4.969Google Scholar
Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of EM algorithm. Psychometrika, 46, 443–459. doi:10.1007/BF02293801Google Scholar
Bronfman, E., Madigan, S., & Lyons-Ruth, K. (2009–2014). Disrupted Maternal Behavior Instrument for Assessment and Classification (AMBIANCE): Manual for coding disrupted affective communication (2nd ed.). Unpublished manuscript, Harvard University Medical School.Google Scholar
Bronfman, E. T., Parsons, E., & Lyons-Ruth, K. (1992–2008). Disrupted Maternal Behavior Instrument for Assessment and Classification (AMBIANCE): Manual for coding disrupted affective communication (1st ed.). Unpublished manuscript, Harvard University Medical School.Google Scholar
Bronfman, E. T., Parsons, E., & Lyons-Ruth, K. (1992–2004). Disrupted Maternal Behavior Instrument for Assessment and Classification (AMBIANCE), Version 2.1. Unpublished manuscript, Harvard Medical School.Google Scholar
Canty, A., & Ripley, B. (2016). boot: Bootstrap R (S-Plus) Functions. R package version 1.3-18 [Computer software]. Vienna: R Foundation for Statistical Computing.Google Scholar
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. doi:10.1037//0033-2909.112.1.155Google Scholar
Cole, D. A., Cai, L., Martin, N. C., Findling, R. L., Youngstrom, E. A., Garber, J., … Forehand, R. (2011). Structure and measurement of depression in youths: Applying response theory to clinical data. Psychological Assessment, 23, 819–833. doi:10.1037/a0023518Google Scholar
Cook, K. F., Kallen, M. A., & Amtmann, D. (2009). Having a fit: Impact of the number of items and distribution of data on traditional criteria for assisting IRT's unidimensionality assumption. Quality of Life Research, 18, 447–460. 10.1007/s11136-009-9464-4Google Scholar
Cooke, D. J., & Michie, C. (1997). An item response theory analyses of the Hare Psychopathy Checklist—Revised. Psychological Assessment, 9, 3–14. doi:10.1037/1040-3590.9.1.3Google Scholar
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. doi:10.1037/h0040957Google Scholar
Cyr, C., Euser, E. M., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2010). Attachment security and disorganization in maltreating and high-risk families: A series of meta-analyses. Development and Psychopathology, 22, 87–108. doi:10.1017/S0954579409990289Google Scholar
de Menezes, L. M. (1999). On fitting latent class models for binary data: The estimation of standard errors. British Journal of Mathematical and Statistical Psychology, 52, 149–168. doi:10.1348/000711099159026Google Scholar
Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16, 5–18. doi:10.1007/s11136-007-9198-0Google Scholar
Egeland, B., Pianta, R., & O'Brien, M. (1993). Maternal intrusiveness in infancy and child maladaptation in early school years. Development and Psychopathology, 5, 359–370. doi:10.1017/S0954579400004466Google Scholar
Fearon, R. P., Bakermans-Kranenburg, M. J., van IJzendoorn, M. H., Lapsley, A.-M., & Roisman, G. I. (2010). The significance of insecure attachment and disorganization in the development of children's externalizing behavior: A meta-analytic study. Child Development, 81, 435–456. doi:10.1111/j.1467-8624.2009.01405.xGoogle Scholar
Finkelman, M. D., Green, J. G., Gruber, M. J., & Zaslavsky, A. M. (2011). A zero- and K-inflated mixture model for health questionnaire data. Statistics in Medicine, 30, 1028–1043. doi:10.1002/sim.4217Google Scholar
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286–299. doi:10.1037/1040-3590.7.3.286Google Scholar
Forbes, L. M., Evans, E. M., Moran, G., & Pederson, D. R. (2007). Change in disrupted maternal behavior predicts change in attachment disorganization from 12 to 24 months in a high-risk sample. Child Development, 78, 955–971. doi:10.1111/j.1467-8624.2007.01043.xGoogle Scholar
Forero, C. G., & Maydeu-Olivares, A. (2009). Estimation of IRT graded response models: Limited versus full information methods. Psychological Methods, 14, 275–299. doi:10.1037/a0015825Google Scholar
Fraley, R. C., Waller, N. G., & Brennan, K. A. (2000). An item response theory analysis of self-report measures of adult attachment. Journal of Personality and Social Psychology, 78, 350–365. doi:10.1037//0022-3514.78.2.350Google Scholar
Goldberg, S., Gotowiec, A., & Simmons, R. J. (1995). Infant-mother attachment and behavior problems in healthy and chronically ill preschoolers. Developmental and Psychopathology, 7, 267–282. doi:10.1017/S0954579400006490Google Scholar
Gordon, R. A. (2015). Measuring constructs in family science: How can item response theory improve precision and validity? Journal of Marriage and Family, 77, 147–176. doi:10.1111/jomf.12157Google Scholar
Haltigan, J. D., Leerkes, E., Supple, A. J., & Calkins, S. D. (2013). Infant negative affect and maternal interactive behavior during the still-face procedure: The moderating role of adult attachment states of mind. Attachment and Human Development, 16, 149–173. doi:10.1080/14616734.2013.863734Google Scholar
Haltigan, J. D., Leerkes, E., Wong, M. S., Fortuna, K., Roisman, G. I., Supple, A. J., … Plamondon, A. (2014). Adult attachment states of mind: Measurement invariance across ethnicity and associations with maternal sensitivity. Child Development, 85, 1019–1035. doi:10.1111/cdev.12180Google Scholar
Haltigan, J. D., & Roisman, G. I. (2015). Infant attachment insecurity and dissociative symptomatology: Findings from the NICHD study of early child care and youth development. Infant Mental Health Journal, 36, 30–41. doi:10.1002/imhj.21479Google Scholar
Hobson, R. P., Patrick, M., Crandell, L., García-Pérez, R., & Lee, A. (2005). Personal relatedness and attachment in infants of mothers with borderline personality disorder. Development and Psychopathology, 17, 329–347. doi:10.1017/S0954579405050169Google Scholar
Hobson, R. P., Patrick, M., Hobson, J. A., Crandell, L., Bronfman, E., & Lyons-Ruth, K. (2009). How mothers with borderline personality disorder relate to their one-year-old infants. British Journal of Psychiatry, 195, 1–6. doi:bjp.bp.108.060624Google Scholar
Kim, Y., & Pilkonis, P. A. (1999). Selecting the most informative items in the IIP scales for personality disorders: An application of item response theory. Journal of Personality Disorders, 13, 157–174. doi:10.1521/pedi.1999.13.2.157Google Scholar
Krueger, R. F., Nichol, P. E., Hicks, B. M., Markon, K. E., Patrick, C. J., Iacono, W. G., & McGue, M. (2004). Using latent trait modeling to conceptualize an alcohol problems continuum. Psychological Assessment, 16, 107–119. doi:10.1037/1040-3590.16.2.107Google Scholar
Langenbucher, J. W., Labouvie, E., Martin, C. S., Sanjuan, P. M., Bavly, L., Kirisci, L., & Chung, T. (2004). An application of item response theory analysis to alcohol, cannabis, and cocaine criteria in DSM-IV. Journal of Abnormal Psychology, 113, 72–80. doi:10.1037/0021-843X.113.1.72Google Scholar
Lyons-Ruth, K., Alpern, L., & Repacholi, B. (1993). Disorganized infant attachment classification and maternal psychosocial problems as predictors of hostile-aggressive behavior in the preschool classroom. Child Development, 64, 572–585. doi:10.2307/1131270Google Scholar
Lyons-Ruth, K., Bronfman, E., & Atwood, G. (1999). A relational diathesis model of hostile-helpless states of mind: Expressions in mother-infant interaction. In Solomon, J. & George, C. (Eds.), Attachment disorganization (pp. 33–70). New York: Guilford Press.Google Scholar
Lyons-Ruth, K., Bronfman, E., & Parsons, E. (1999). Maternal frightened, frightening or disrupted behavior and disorganized infant attachment patterns. Monographs of the Society for Research in Child Development, 64(3, Serial No. 258).Google Scholar
Lyons-Ruth, K., Bureau, J.-F., Holmes, B., Easterbrooks, A., & Brooks, N. (2013). Borderline symptoms and suicidality/self-injury in late adolescence: Prospectively observed relationship correlates in infancy and childhood. Psychiatry Research, 206, 273–281. doi:10.1016/j.psychres.2012.09.030Google Scholar
Lyons-Ruth, K., Connell, D., Grunebaum, H., & Botein, S. (1990). Infants at social risk: Maternal depression and family support services as mediators of infant development and security of attachment. Child Development, 61, 85–98. doi:10.1111/j.1467-8624.1990.tb02762.xGoogle Scholar
Lyons-Ruth, K., & Jacobvitz, D. (2016). Attachment disorganization from infancy to adulthood: Neurobiological correlates, parenting context, and pathways to disorder. In Cassidy, J. & Shaver, P. R. (Eds.), Handbook of attachment: Theory, research, and clinical applications (3rd ed., pp. 667–695). New York: Guilford Press.Google Scholar
Lyons-Ruth, K., Pechtel, P., Yoon, S. A., Anderson, C. M., & Teicher, M. H. (2016). Disorganized attachment in infancy predicts greater amygdala volume in adulthood. Behavioural Brain Research, 308, 83–93. doi:10.1016/j.bbr.2016.03.050Google Scholar
Macfie, J., McElwain, N. L., Houts, R. M., & Cox, M. J. (2005). Intergenerational transmission of role reversal between parent and child: Dyadic and family systems internal working models. Attachment and Human Development, 7, 51–65. doi:10.1080/14616730500039663Google Scholar
Madigan, S., Bakermans-Kranenburg, M. J., van IJzendoorn, M. H., Moran, G., Pederson, D. R., & Benoit, D. (2006). Unresolved states of mind, anomalous parental behavior, and disorganized attachment: A review and meta-analysis of a transmission gap. Attachment and Human Development, 8, 89–111. doi:10.1080/14616730600774458Google Scholar
Madigan, S., Brumariu, L. E., Villani, V., Atkinson, L., & Lyons-Ruth, K. (2016). Representational and questionnaire measures of attachment: A meta-analysis of relations to child internalizing and externalizing problems. Psychological Bulletin, 142, 367–399. doi:10.1037/bul0000029Google Scholar
Madigan, S., Voci, S., & Benoit, D. (2011). Stability of disrupted caregiver behaviors over six years and associations with disorganized infant-caregiver attachment. Attachment and Human Development, 13, 237–252. doi:10.1080/14616734.2011.562410Google Scholar
Main, M., & Hesse, E. (1990). Parents’ unresolved traumatic experiences are related to infant disorganized status: Is frightened and/or frightening parental behavior the linking mechanism? In Greenberg, M. T., Cicchetti, D., & Cummings, E. M. (Eds.), Attachment in the preschool years: Theory, research, and intervention (pp. 161–182). Chicago: University of Chicago Press.Google Scholar
Main, M., & Solomon, J. (1990). Procedures for identifying infants as disorganized/disoriented during the Ainsworth Strange Situation. In Greenberg, M. T., Cicchetti, D., & Cummings, M. (Eds.), Attachment in the preschool years: Theory, research, and intervention (pp. 121–160). Chicago: University of Chicago Press.Google Scholar
Martin, C. S., Chung, T., Kirisci, L., & Langenbucher, J. W. (2006). Item response theory analysis of diagnostic criteria for alcohol and cannabis use disorders in adolescents: Implications for DSM-V. Journal of Abnormal Psychology, 115, 807–814. doi:10.1037/0021-843X.115.4.807Google Scholar
Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147–163. doi:10.1037/1082-989X.9.2.147Google Scholar
Mayseless, O., Bartholomew, K., Henderson, A., & Trinke, S. (2004). “I was more her mom than she was mine”: Role reversal in a community sample. Family Relations, 53, 78–86. doi:10.1111/j.1741-3729.2004.00011.xGoogle Scholar
Mills-Koonce, W. R., Willoughby, M. T., Rehder, P. D., Gottfredson, N., Bronfman, E., Madigan, S., & Lyons-Ruth, K. (2017). Associations between disrupted maternal caregiving and oppositional defiant and callous-unemotional behaviors differ for boys versus girls. Manuscript submitted for publication.Google Scholar
Muthén, B. O. (1989). Dichotomous factor analysis of symptom data. Sociological Methods and Research, 18, 19–65.Google Scholar
Muthén, L. K., & Muthén, B. O. (1998–2012). Mplus user's guide (7th ed.). Los Angeles: Author.Google Scholar
NICHD Early Child Care Research Network. (1997). The effects of infant childcare on infant-mother attachment security: Results of the NICHD study of early childcare. Child Development, 68, 860–879. doi:10.2307/1132038Google Scholar
NICHD Early Child Care Research Network. (2001). Child-care and family predictors of preschool attachment and stability from infancy. Developmental Psychology, 37, 847–862. doi:10.1037/0012-1649.37.6.847Google Scholar
NICHD Early Child Care Research Network. (2004). Father's and mother's parenting behavior and beliefs as predictors of child social adjustment in the transition to school. Journal of Family Psychology, 18, 628–638. doi:10.1037/0893-3200.18.4.628Google Scholar
NICHD Early Child Care Research Network. (2005). Child care and child development. New York: Guilford Press.Google Scholar
Ondersma, S. J., Chaffin, M. J., Mullins, S. M., & LeBreton, J. M. (2005). A brief form of the child abuse potential inventory: Development and validation. Journal of Clinical Child and Adolescent Psychology, 34, 300–311. doi:10.1207/s15374424jccp3402_9Google Scholar
Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning (Vol. 161). Thousand Oaks, CA: Sage.10.4135/9781412993913Google Scholar
R Core Team. (2016). R: A language and environment for statistical computing [Computer software]. Vienna: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/Google Scholar
Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48. doi:10.1146/annurev.clinpsy.032408.153553Google Scholar
Rizopoulos, D. (2006). ltm: An R package for latent variable modelling and item response theory analyses. Journal of Statistical Software, 17, 1–25.10.18637/jss.v017.i05Google Scholar
Sheridan, M. A., & McLauglin, K. A. (2014). Dimensions of early experience and neural development: Deprivation and threat. Trends in Cognitive Sciences, 18, 580–585. doi:10.1016/j.tics.2014.09.001Google Scholar
Shi, Z., Bureau, J.-F., Easterbrooks, M. A., Zhao, X., & Lyons-Ruth, K. (2012). Childhood maltreatment and prospectively observed quality of early care as predictors of antisocial personality disorder features. Infant Mental Health Journal, 33, 55–69. doi:10.1002/imhj.20295Google Scholar
Sroufe, L. A., Jacobvitz, D., Mangelsdorf, S., DeAngelo, E., & Ward, M. J. (1985). Generational boundary dissolution between mothers and their preschool children: A relationship systems approach. Child Development, 56, 317–325. doi:10.2307/1129722Google Scholar
Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251. doi:10.1037/0033-2909.87.2.245Google Scholar
Sterba, S. K., Copeland, W., Egger, H. L., Costello, E. J., Erkanli, A., & Angold, A. (2010). Longitudinal dimensionality of adolescent psychopathology: Testing the differentiation hypothesis. Journal of Child Psychology and Psychiatry, 51, 871–884. doi:10.1111/j.1469-7610.2010.02234.xGoogle Scholar
Swaminathan, H., Hambleton, R. K., Sireci, S. G., Xing, D., & Rizavi, S. M. (2003). Small sample estimation in dichotomous item response models: Effect of priors based on judgmental information on the accuracy of item parameter estimates. Applied Psychological Measurement, 27, 27–51. doi:10.1177/0146621602239475Google Scholar
Teicher, M., Samson, J., Anderson, C., & Ohashi, K. (2016). The effects of childhood maltreatment on brain structure, function and connectivity. Nature Reviews Neuroscience, 17, 652–666. doi:10.1038/nrn.2016.111Google Scholar
Tereno, S., Madigan, S., Lyons-Ruth, K., Plamondon, A., Atkinson, L., Guedeney, N., … Guedeney, A. (2017). Assessing mechanisms of effect in a randomized home-visiting trial: Reduced disrupted maternal communication decreases infant disorganization. Development and Psychopathology, 29, 637–649. doi:10.1017/S0954579417000232Google Scholar
van IJzendoorn, M. H., Schuengel, C., & Bakermans-Kranenburg, M. J. (1999). Disorganized attachment in early childhood: Meta-analysis of precursors, concomitants, and sequalae. Development and Psychopathology, 11, 225–249. doi:10.1017/S0954579499002035Google Scholar
Wall, M. M., Park, J. Y., & Moustaki, I. (2015). IRT modeling in the presence of zero-inflation with application to psychiatric disorder severity. Applied Psychological Measurement, 39, 583–597. doi:10.1177/0146621615588184Google Scholar