Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-20T11:31:23.286Z Has data issue: false hasContentIssue false
  • English
  • Français

How Expert are “Expert” Wine Judges?*

Published online by Cambridge University Press:  08 June 2012

Robert T. Hodgson
Robert T. Hodgson
Affiliation:
Professor emeritus, Humboldt State University, Arcata, California. Owner/winemaker, Fieldbrook Winery. Email: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

Recent papers by Hodgson (2008) and Gawel and Godden (2008) have questioned the consistency of expert wine judges in a wine competition setting. In the latter paper, a methodology introduced in psychometric research to measure judge reliability corrected for chance was used to quantify judge consistency (Cohen, 1968). This paper extends that notion, suggesting a value of 0.7 for Cohen's weighted kappa might be used to define an expert wine judge. With that criterion, less than 30% of judges who participated in either of the two studies would be considered “expert.” (JEL Classification: C1, L15)

Type
Shorter Papers
Information
Journal of Wine Economics , Volume 4 , Issue 2 , Winter 2009 , pp. 233 - 241
Copyright
Copyright © American Association of Wine Economists 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ashenfelter, O. and Quandt, R. (1999). Analyzing a wine tasting statistically. Chance, 12, 16–20.CrossRefGoogle Scholar
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.CrossRefGoogle Scholar
Cohen, J. (1968). Weighted kappa: nominal scale agreement with provision for scaled disagreement of partial credit. Psychological Bulletin, 70(4), 213–220.CrossRefGoogle ScholarPubMed
Cicchetti, D.V. (2004). Who won the 1976 blind tasting of French Bordeaux and U.S. Cabernets? Parametrics to the rescue. Journal of Wine Research, 15(3), 211–220.CrossRefGoogle Scholar
Gawel, R. and Godden, P.W. (2008). Evaluation of the consistency of wine quality assessments from expert wine tasters. Australian Journal of Grape and Wine Research, 14, 1–8.CrossRefGoogle Scholar
Hodgson, R.T. (2008). Evaluation of wine judges ata major U.S. wine competition. Journal of Wine Economics, 3(2), 105–113.CrossRefGoogle Scholar