Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-29T10:27:17.709Z Has data issue: false hasContentIssue false
  • English
  • Français

On establishing the validity of ‘objective’ data: can we rely on cross-interview agreement?1

Published online by Cambridge University Press:  09 July 2009

Stephen Platt
Stephen Platt*
Affiliation:
Medical Research Council Unit for Epidemiological Studies in Psychiatry, Edinburgh
*
2Address for correspondence: Mr S. D. Platt, Medical Research Council Unit for Epidemiological Studies in Psychiatry, University Department of Psychiatry, Royal Edinburgh Hospital, Morningside Park, Edinburgh EHIO SHF.
Get access Rights & Permissions [Opens in a new window]

Synopsis

It has been proposed that a high level of agreement between informants‘ reports about events and happenings (‘objective’ data) is a sound basis for establishing (a) the validity of the measure which is based on the reports, and (b) the nature of objective reality. In this paper it is argued that such agreement may not be an adequate basis for validation since the accounts may not be independent. Likewise, low across-interview agreement may not signify the inaccuracy of either report because of the phenomenon of ‘object-variation’. It is concluded that, although this method of validation can be significantly improved, it should be supplemented, wherever possible, by other approaches.

Type
Research Article
Information
Psychological Medicine , Volume 10 , Issue 3 , August 1980 , pp. 573 - 581
Copyright
Copyright © Cambridge University Press 1980

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

1

This is a substantially revised version of a paper presented at the Medical Sociology Group Annual Conference, 16–18 September 1977

References

Aitken, R. C. B. (1974). Assessment of mood by analogue scales. In The Prediction of Suicide (ed. Beck, A. T., Resnik, H. L. P. and Lettieri, D. J.), pp. 94–105. Charles Press: Bowie, Maryland.Google Scholar
Bahr, H. M. & Houts, K. C. (1971). Can you trust a homeless man? A comparison of official records and interview responses by Bowery men. Public Opinion Quarterly 35, 374–382.CrossRefGoogle Scholar
Beck, A. T., Schuyler, D. & Herman, I. (1974). Development of suicidal intent scales. In The Prediction of Suicide (ed.Beck, A. T., Resnik, H. L. P. and Lettieri, D. J.), pp. 45–55. Charles Press: Bowie, Maryland.Google Scholar
Berger, P. L. & Luckman, T. (1971). The Social Construction of Reality. Penguin: Harmondsworth.Google Scholar
Brown, G. W. & Rutter, M. (1966). The measurement of family activities and relationships: a methodological study. Human Relations 19, 241–263.CrossRefGoogle Scholar
Brown, G. W., Birley, J. L. T. & Wing, J. K. (1972). Influence of family life on the course of schizophrenic disorders: a replication. British Journal of Psychiatry 121, 241–258.CrossRefGoogle ScholarPubMed
Bruner, J. S. & Goodman, C. C. (1947). Value and need as organising factors in perception. Journal of Abnormal and Social Psychology 42, 33–44.CrossRefGoogle ScholarPubMed
Campbell, D. T. & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin 56, 81–105.CrossRefGoogle ScholarPubMed
Cantril, H. (1957). Perception and interpersonal relations. American Journal of Psychiatry 114, 119–126.CrossRefGoogle ScholarPubMed
Clark, A. L. & Wallin, P. (1964). The accuracy of husbands‘ and wives‘ report of frequency of marital coitus. Population Studies 18, 165–173.CrossRefGoogle Scholar
Clark, A. W. (1968). The personality and social network adjustment scale. Human Relations 21, 85–95.CrossRefGoogle Scholar
Clausen, A. R. (1968–1969). Response validity: vote report. Public Opinion Quarterly 32, 588–606.CrossRefGoogle Scholar
Cronbach, L. J. & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin 52, 281–302.CrossRefGoogle ScholarPubMed
Cureton, E. E. (1968). Psychometrics. In International Encyclopaedia of the Social Sciences, vol. 13, pp. 95–112. Macmillan: New York.Google Scholar
Dean, J. P. & Whyte, W. F. (1958). How do you know if the informant is telling the truth? Human Organization 17, 34–38.CrossRefGoogle Scholar
Gouldner, A. W. (1971). The Coming Crisis of Western Sociology. Heinemann: London.Google Scholar
Hagburg, E. C. (1968). Validity of questionnaire data: reported and observed attendance at an adult education program. Public Opinion Quarterly 32, 453–456.CrossRefGoogle Scholar
Haggerty, R. J. (1965). Family diagnosis: research methods and their reliability for studies of the medical–social unit, the family. American Journal of Public Health 55, 1521–1533.CrossRefGoogle ScholarPubMed
Hastorf, A. H. & Cantril, H. (1954). They saw a game: a case study. Journal of Abnormal and Social Psychology 49, 129–134.CrossRefGoogle Scholar
Hoffman, L. W. & Lippitt, R. (1960). The measurement of family life variables. In Handbook of Research Methods in Child Development (ed. Mussen, P. H.), pp. 945–1005. Wiley: New York.Google Scholar
Hyman, H. (1944). Do they tell the truth? Public Opinion Quarterly 8, 557–559.CrossRefGoogle Scholar
Jacobson, A. H. (1952). Conflict of attitudes towards the roles of husband and wife in marriage. American Sociological Review 17, 146–150.CrossRefGoogle Scholar
Johnson-Abercrombie, M. L. (1960). The Anatomy of Judgement: an Investigation into the Processes of Perception and Reasoning. Hutchinson: London.Google Scholar
Katz, M. M. & Lyerly, S. B. (1963). Methods for measuring adjustment and social behaviour in the community. I. Rationale, description, discriminative validity and scale development. Psychological Reports 13, 503–535.CrossRefGoogle Scholar
Laing, R. D. & Esterson, A. (1964). Sanity, Madness and the Family. Tavistock: London.Google Scholar
McCall, G. J. & Simmons, J. L. (1966). Identities and Interactions. Free Press: New York.Google Scholar
McCord, J. & McCord, W. (1961). Cultural stereotypes and the validity of interviews for research in child development. Child Development 32, 171–185.Google Scholar
Minuchin, S., Montalvo, B., Guerney, B. G., Rosman, B. L. & Schumer, F. (1967). Families of the Slums. Basic Books: New York.Google Scholar
Mosher, L. R., Wild, C., Valcov, A. & Feinstein, A. E. (1972). Cognitive style, schizophrenia and the family: methodological implications of contextual effects. Family Process 11, 125–146.CrossRefGoogle Scholar
Nyc, I. & Macdougall, E. (1960). Do families have subcultures? Sociology and Social Research 44, 311–316.Google Scholar
Parloff, M. B., Kelman, H. C. & Frank, J. D. (1954). Comfort, effectiveness, and self-awareness as criteria of improvement in psychotherapy. American Journal of Psychiatry 111, 343–351.CrossRefGoogle ScholarPubMed
Parry, H. J. & Crossley, H. M. (1950). Validity of responses to survey questions. Public Opinion Quarterly 14, 61–80.CrossRefGoogle Scholar
Parry, H. J., Balter, M. B. & Cisin, I. H. (1970). Primary levels of under-reporting psychotropic drug use. Public Opinion Quarterly 34, 582–592.CrossRefGoogle Scholar
Quinton, D., Rutter, M. & Rowland, O. (1976). An evaluation of an interview assessment of marriage. Psychological Medicine 6, 577–586.CrossRefGoogle ScholarPubMed
Rapoport, R. & Rosow, I. (1957). An approach to family relationships and role performance. Human Relations 10, 209–221.CrossRefGoogle Scholar
Rutter, M. (1975). Helping Troubled Children. Penguin: Harmondsworth.Google Scholar
Rutter, M. & Brown, G. W. (1966). The reliability and validity of measures of family life and relationships in families containing a psychiatric patient. Social Psychiatry 1, 38–53.CrossRefGoogle Scholar
Rutter, M. & Sussenwein, E. (1971). Developmental and behavioural approach to the treatment of preschool autistic children. Journal of Autism and Childhood Schizophrenia 1, 376–397.Google Scholar
Sherif, M. & Hovland, C. I., (1961). Social Judgment. Yale University Press: New Haven, Conn.Google Scholar
Singer, M. T. & Wynne, L. C. (1965). Thought disorder and family relations of schizophrenics. IV. Results and implications. Archives of General Psychiatry 12, 201–212.CrossRefGoogle ScholarPubMed
Tonge, W. L., James, D. S. & Hillam, S M. (1975). Families Without Hope: A Controlled Study of 33 Problem Families. Royal College of Psychiatrists: London.Google Scholar
Udry, J. R. & Morris, N. M. (1967). A method for validation of reported sexual data. Journal of Marriage and the Family 29, 442–446.CrossRefGoogle Scholar
Weaver, C. N. & Swanson, C. L. (1974). Validity of reported date of birth, salary and seniority. Public Opinion Quarterly 38, 69–80.CrossRefGoogle Scholar
Weiss, C. H. (1968–1969). Validity of welfare mothers‘ interview responses. Public Opinion Quarterly 32, 622–633.CrossRefGoogle Scholar
Weller, L. & Luchterhand, E. (1969). Comparing interviews and observations on family functioning. Journal of Marriage and the Family 31, 115–122.CrossRefGoogle Scholar
Wing, J. K., Birley, J. L. T., Cooper, J. E., Graham, P. & Isaacs, A. O. (1967). Reliability of a procedure for measuring and classifying ‘Present Psychiatric State’. British Journal of Psychiatry 113, 499–515.CrossRefGoogle ScholarPubMed
Yarrow, M. R., Clausen, J. A. & Robbins, P. R. (1955 a). The social meaning of mental illness. Journal of Social Issues 11, 33–48.CrossRefGoogle Scholar
Yarrow, M. R., Schwartz, C. G., Murphy, H. S. & Deasy, L. C. (1955 b). The psychological meaning of mental illness in the family. Journal of Social Issues 11, 12–24.CrossRefGoogle Scholar