Hostname: page-component-cd9895bd7-jkksz Total loading time: 0 Render date: 2024-12-23T00:02:41.187Z Has data issue: false hasContentIssue false
  • English
  • Français

Agreement between bovine respiratory disease scoring systems for pre-weaned dairy calves

Published online by Cambridge University Press:  26 November 2014

Sharif S. Aly ,
William J. Love ,
Deniece R. Williams ,
Terry W. Lehenbauer ,
Alison Van Eenennaam ,
Christiana Drake ,
Philip H. Kass  and
Thomas B. Farver
Sharif S. Aly*
Affiliation:
Veterinary Medicine Teaching and Research Center, School of Veterinary Medicine, University of California, Davis, Tulare, California, USA Department of Population Health and Reproduction, School of Veterinary Medicine, University of California, Davis, California, USA
William J. Love
Affiliation:
Veterinary Medicine Teaching and Research Center, School of Veterinary Medicine, University of California, Davis, Tulare, California, USA
Deniece R. Williams
Affiliation:
Veterinary Medicine Teaching and Research Center, School of Veterinary Medicine, University of California, Davis, Tulare, California, USA
Terry W. Lehenbauer
Affiliation:
Veterinary Medicine Teaching and Research Center, School of Veterinary Medicine, University of California, Davis, Tulare, California, USA Department of Population Health and Reproduction, School of Veterinary Medicine, University of California, Davis, California, USA
Alison Van Eenennaam
Affiliation:
Department of Animal Science, University of California, Davis, California, USA
Christiana Drake
Affiliation:
Department of Statistics, University of California, Davis, California, USA
Philip H. Kass
Affiliation:
Department of Population Health and Reproduction, School of Veterinary Medicine, University of California, Davis, California, USA
Thomas B. Farver
Affiliation:
Department of Population Health and Reproduction, School of Veterinary Medicine, University of California, Davis, California, USA
*
*Corresponding author: E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Clinical scoring systems have been proposed for respiratory disease diagnosis in calves, including the Wisconsin (WI) system (McGuirk in 2008) which uses five clinical signs, each partitioned into four levels of severity. Recently, we developed the California (CA) bovine respiratory disease (BRD) scoring system requiring less calf handling and consisting of six clinical signs, each classified as normal or abnormal. The objective of this study was to estimate the on-farm agreement between the WI and the CA scoring systems. A total of 100 calves were enrolled on a CA dairy and assessed for BRD case status using the two scoring systems simultaneously. The Kappa coefficient of agreement between these two systems was estimated to be 0.85, which indicated excellent agreement beyond chance. The simpler design and reduced calf handling required by the CA BRD scoring system may make it advantageous for on-farm use.

Keywords

bovine respiratory diseasedairy calvesclinical signsCA scoring systemWI scoring system
Type
Review Article
Information
Animal Health Research Reviews , Volume 15 , Issue 2 , December 2014 , pp. 148 - 150
Check for updates
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/3.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Cambridge University Press 2014

Introduction

Bovine respiratory disease (BRD) is an important disease of calves that leads to reduced weight gain and productivity (Waltner-Toews et al., Reference Waltner-Toews, Martin and Meek1986; Warnick et al., Reference Warnick, Erb and White1997; Donovan et al., Reference Donovan, Dohoo, Montgomery and Bennett1998). Field diagnosis remains a challenge for control and treatment of BRD. Several clinical scoring systems have been proposed, including the Wisconsin (WI) system (McGuirk, Reference McGuirk2008) that uses five clinical signs, each partitioned into four levels of severity. Recently, we developed a BRD scoring system for pre-weaned dairy calves based on a matched case–control study of 2030 Holstein calves on a large calf ranch in the San Joaquin Valley, California (CA) (BRD3 scoring system; Love et al., Reference Love, Lehenbauer, Kass, Van Eenennaam and Aly2014). The CA BRD scoring system is based on the presence or absence of six clinical signs, each assigned a model-based score (Appendix 1). The objective of this study was to estimate the on-farm agreement between the WI and the CA BRD scoring systems in pre-weaned dairy calves.

Materials and methods

Agreement beyond chance between the two systems was estimated using Kappa (κ), as described by Cohen (Reference Cohen1960). Given a 1:3 allocation between BRD cases and non-cases, a sample size of 100 calves was required to detect a true κ value of 0.75 in a two-sided test of the null hypothesis that κ is equal to 0 with 99% power and 5% level of significance (Flack et al., Reference Flack, Afifi, Lachenbruch and Schouten1988). The κ estimate was interpreted as poor if <0.40; fair to good if 0.41–0.75; or excellent agreement beyond chance if >0.75 (Fleiss et al., Reference Fleiss, Levin, Paik, Balding, Cressie, Fisher, Johnstone, Kadane, Ryan, Scott, Smith and Teugels2003).

One hundred pre-weaned calves from a 3200 dairy cow herd were evaluated by the same investigator for clinical signs required by the WI and CA scoring systems, including nasal discharge, ocular discharge, cough (spontaneous and induced), respiration quality, temperature, and ear droop or head tilt. Study personnel identified ill calves with signs of depression, anorexia, or loss of appetite which were then examined by thoracic auscultation and ultrasound. Calves with abnormal ultrasound or auscultation were identified as cases and scored using both the WI and CA scoring systems. In addition, a random sample of approximately five to ten healthy calves were enrolled and scored using both systems on study days.

The study calves were housed in individual wooden hutches with elevated slatted floors and given free choice water and starter grain until weaning at approximately 75 days of age. Calves were fed 2 liters of pasteurized waste milk supplemented with milk replacer containing 20% protein and 20% fat twice a day. In the first month of life, calves were treated with an intra-nasal, modified live vaccine for the prevention of infectious bovine rhinotracheitis virus, bovine respiratory syncytial virus, and parainfluenza type 3 virus; and a parenteral, killed vaccine for the above viruses and bovine viral diarrhea virus types 1 and 2. Data analysis was performed using Stata 13.1 (College Station, Texas, USA).

Results

Of the 100 calves enrolled, 63 were Holsteins and 37 were Jerseys. Sixty-eight calves were heifers. Enrolled calves ranged from 21 to 110 days of age with a mean age of 62 days. The CA scoring system identified 29 calves positive for BRD, and the WI system identified 27 calves positive for BRD. Twenty-five calves were identified as cases by both scoring systems. Cohen's κ for the two scoring systems was estimated to be 0.85 (SD = 0.099) indicating that the WI and CA BRD scoring systems had excellent agreement beyond chance.

Significance

Agreement beyond chance between the WI and the CA scoring systems based on 100 pre-weaned calves on a CA dairy was excellent. Calf raisers assessing BRD in pre-weaned calves on dairies with similar management conditions and risk for BRD can use the CA scoring system and expect excellent agreement with the WI scoring system. However, differences exist between the two systems. The WI scoring system assesses five clinical signs including ocular discharge, nasal discharge, induced or spontaneous cough, rectal temperature, and head tilt or ear position. In addition to these five clinical signs, the CA system assesses quality of respiration but involves less calf handling as it does not require additional handling of calves for inducing a cough, which may be a biosecurity concern due to the potential transfer of infectious material between calves. Another difference is that the WI scoring system relies on four severity levels for each clinical sign with scores uniformly distributed between 0 and 3. In contrast, the CA system relies on a simpler design, the presence or absence of clinical signs, and utilizes model-based scores. As a result, using the CA scoring system, only calves with either nasal discharge or any two clinical signs of spontaneous cough, ocular discharge, or abnormal respiration would require calf handling to measure rectal temperature and confirm BRD status. The simpler design and reduced calf handling required by the CA scoring system may make it the preferred scoring system for on-farm use.

Limitations of the current study include the use of a single herd and the cross-sectional study design. Hence, the agreement between the WI and CA BRD scoring system may change in herds with different calf management conditions and BRD risk. Future research should describe the diagnostic accuracy (sensitivity and specificity) of such scoring systems in order to better inform users about the strengths and weaknesses of using scoring systems for on-farm diagnosis of BRD in calves.

Acknowledgments

The CA BRD scoring system was developed using case–control data that were collected as part of the Bovine Respiratory Disease Complex Coordinated Agricultural Project (BRDC CAP, www.brdcomplex.org) funded by the USDA National Institute of Food and Agriculture (Grant  no. 2011-68004-30367; J. E. Womack, PD). Development of the scoring system and this study were funded by the University of California, Davis Division of Agriculture and Natural Resources (Grant no. 1753; S. S. Aly, PI). The authors thank the study dairies and calf ranch owners for their participation, and Mr. Paul Rossitto.

Appendix 1. The California Bovine Respiratory Disease (BRD) scoring system for pre-weaned dairy calves1 Add scores for all six signs, if total score is ⩾5, calf may be a BRD case.

Footnotes

1 BRD3 scoring system in ‘Development of a novel clinical scoring system for on-farm diagnosis of bovine respiratory disease in pre-weaned dairy calves.’ Love et al. (Reference Love, Lehenbauer, Kass, Van Eenennaam and Aly2014). https://peerj.com/articles/238.pdf

2 Any abnormality including, but not limited to, the examples shown in the above pictures.

References

Cohen, J (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20: 37–46.CrossRefGoogle Scholar
Donovan, GA, Dohoo, IR, Montgomery, DM and Bennett, FL (1998). Calf and disease factors affecting growth in female Holstein calves in Florida, USA. Preventive Veterinary Medicine 33: 1–10.CrossRefGoogle ScholarPubMed
Flack, VF, Afifi, AA, Lachenbruch, PA and Schouten, HJA (1988). Sample size determinations for the two rater kappa statistic. Psychometrika 53: 321–325.Google Scholar
Fleiss, JL, Levin, B and Paik, MC (2003). The measurement of interrater agreement. In: Statistical Methods for Rates and Proportions, (eds) Balding, David J., Cressie, Noel A. C., Fisher, Nicholas I., Johnstone, Iain M., Kadane, J. B., Ryan, Louise M., Scott, David W., Smith, Adrian F. M., Teugels, Jozef L.. 3rd edn.New York, NY: Wiley, p. 604.CrossRefGoogle Scholar
Love, WJ, Lehenbauer, TW, Kass, PH, Van Eenennaam, AL and Aly, SS (2014). Development of a novel clinical scoring system for on-farm diagnosis of bovine respiratory disease in pre-weaned dairy calves. Peer Journal 2: e238.CrossRefGoogle ScholarPubMed
McGuirk, SM (2008). Disease management of dairy calves and heifers. Veterinary Clinics of North America Food Animal Practice 24: 139–153.Google Scholar
Waltner-Toews, D, Martin, SW and Meek, AH (1986). The effect of early calfhood health status on survivorship and age at first calving. Canadian Journal of Veterinary Research 50: 314–317.Google Scholar
Warnick, LD, Erb, HN and White, ME (1997). The relationship of calfhood morbidity with survival after calving in 25 New York Holstein herds. Preventive Veterinary Medicine 31: 263–273.Google Scholar
Figure 0

Appendix 1. The California Bovine Respiratory Disease (BRD) scoring system for pre-weaned dairy calves1 Add scores for all six signs, if total score is ⩾5, calf may be a BRD case.