Hostname: page-component-848d4c4894-nmvwc Total loading time: 0 Render date: 2024-07-02T19:13:06.890Z Has data issue: false hasContentIssue false

A systematic review and network meta-analysis of injectable antibiotic options for the control of bovine respiratory disease in the first 45 days post arrival at the feedlot

Published online by Cambridge University Press:  21 February 2020

A. M. O'Connor*
Affiliation:
Department of Veterinary Diagnostic and Production Animal Medicine, Iowa State University, Ames, Iowa50010, USA
D. Hu
Affiliation:
Department of Statistics, Iowa State University, Ames, Iowa, USA
S. C. Totton
Affiliation:
Guelph, Ontario, N1G 1S1, Canada
N. Scott
Affiliation:
Department of Veterinary Diagnostic and Production Animal Medicine, Iowa State University, Ames, Iowa50010, USA
C. B. Winder
Affiliation:
Department of Population Medicine, University of Guelph, Ontario, N1G 2W1, Canada
B. Wang
Affiliation:
Department of Food Science and Technology, University of Nebraska-Lincoln, Lincoln, Nebraska, USA
C. Wang
Affiliation:
Department of Veterinary Diagnostic and Production Animal Medicine, Iowa State University, Ames, Iowa50010, USA Department of Statistics, Iowa State University, Ames, Iowa, USA
J. Glanville
Affiliation:
York Health Economics Consortium, University of York, England
H. Wood
Affiliation:
York Health Economics Consortium, University of York, England
B. White
Affiliation:
Department of Clinical Sciences, Kansas State University, Manhattan, Kansas, USA
R. Larson
Affiliation:
Department of Clinical Sciences, Kansas State University, Manhattan, Kansas, USA
C. Waldner
Affiliation:
Department of Large Animal Clinical Sciences, University of Saskatchewan, Saskatoon, CA, USA
J. M. Sargeant
Affiliation:
Guelph, Ontario, N1G 1S1, Canada
*
Author for correspondence: Annette O'Connor, Department of Veterinary Diagnostic and Production Animal Medicine, Iowa State University, Ames, Iowa50010, USA. E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

We conducted a systematic review and network meta-analysis to determine the comparative efficacy of antibiotics used to control bovine respiratory disease (BRD) in beef cattle on feedlots. The information sources for the review were: MEDLINE®, MEDLINE In-Process and MEDLINE® Daily, AGRICOLA, Epub Ahead of Print, Cambridge Agricultural and Biological Index, Science Citation Index, Conference Proceedings Citation Index – Science, the Proceedings of the American Association of Bovine Practitioners, World Buiatrics Conference, and the United States Food and Drug Administration Freedom of Information New Animal Drug Applications summaries. The eligible population was weaned beef cattle raised in intensive systems. The interventions of interest were injectable antibiotics used at the time the cattle arrived at the feedlot. The outcome of interest was the diagnosis of BRD within 45 days of arrival at the feedlot. The network meta-analysis included data from 46 studies and 167 study arms identified in the review. The results suggest that macrolides are the most effective antibiotics for the reduction of BRD incidence. Injectable oxytetracycline effectively controlled BRD compared with no antibiotics; however, it was less effective than macrolide treatment. Because oxytetracycline is already commonly used to prevent, control, and treat BRD in groups of feedlot cattle, the use of injectable oxytetracycline for BRD control might have advantages from an antibiotic stewardship perspective.

Type
Systematic Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2020

Introduction

Rationale

Bovine respiratory disease complex (BRD) is the most economically significant disease of feedlot cattle (Apley, Reference Apley2006; Miles, Reference Miles2009; Taylor et al., Reference Taylor, Fulton, Lehenbauer, Step and Confer2010). Putative causal organisms include Mannheimia haemolytica, Pasteurella multocida, Histophilus somni, Mycoplasma bovis, bovine herpes virus, bovine viral diarrhea virus, bovine respiratory syncytial virus, and parainfluenza type 3 virus. Although vaccination against the putative causal organisms is frequently used to help control BRD, antibiotics are also given to beef cattle when the cattle first arrive at feedlots (United States Department of Agriculture Animal and Plant Health Inspection Service Veterinary Services Centers for Epidemiology and Animal Health April, 2013). With growing concern about antibiotic use in the beef industry, it is essential to fully understand the efficacy of antibiotics to ensure that they are being used prudently (Landers et al., Reference Landers, Cohen, Wittum and Larson2012; Martin et al., Reference Martin, Thottathil and Newman2015; White House Forum Spotlights Antibiotic Overuse in Medicine and Food Production, 2015).

Drug efficacy is one of the many factors that must be considered when selecting antibiotics for use in a given setting. Evidence of the comparative efficacies of the available antibiotics is essential for prudent selection. If veterinarians know that multiple antibiotic regimes have comparable efficacies, then factors such as cost and antibiotic stewardship considerations can be used to differentiate among comparable products.

Systematic review and pairwise meta-analysis of randomized controlled trials yield the best evidence of the comparative efficacies of different treatments under field conditions (Wellman and O'Connor, Reference Wellman and O'Connor2007; Baptiste and Kyvsgaard, Reference Baptiste and Kyvsgaard2017). It is often the case, however, that an insufficient number of trials are available for a pairwise meta-analysis. In such situations, network meta-analysis can be used to borrow information from the network of available evidence in order to obtain estimates of comparative efficacy (Taylor et al., Reference Taylor, Fulton, Lehenbauer, Step and Confer2010; Jackson et al., Reference Jackson, White, Price, Copas and Riley2017; Lin et al., Reference Lin, Xing, Kofler and Murad2019). Several network meta-analyses have been conducted to evaluate the comparative efficacies of antibiotics for the treatment and control of BRD in beef production (O'Connor et al., Reference O'Connor, Coetzee, da Silva and Wang2013, Reference O'Connor, Yuan, Cullen, Coetzee, da Silva and Wang2016; Abell et al., Reference Abell, Theurer, Larson, White and Apley2017). Although the assessment of bias is an important component of a systematic review, an approach to describe the contributions of multiple studies to biases in estimates resulting from systematic reviews was not available until recently (CINeMA: Confidence in Network Meta-Analysis [Software] 2017).

Objectives

We sought to comprehensively assess the evidence for the efficacies of the different antibiotics used to control BRD in feedlot cattle in the USA using the network of trials currently available in the literature. In addition, we sought to update the approach used to assess the risk of bias in our estimates of efficacy.

Methods

Protocol and registration

The protocol for this study was developed before the review, approved by the funding agency advisory board and the funding agency staff, and posted online for public access (https://works.bepress.com/annette_oconnor/82/ and http://www.syreaf.org). Some minor modifications of the approved protocol were made to facilitate a more comprehensive systematic review and are described as needed. This review was reported using the approach described previously for network meta-analyses (Hutton et al., Reference Hutton, Salanti, Caldwell, Chaimani, Schmid, Cameron, Ioannidis, Straus, Thorlund, Jansen, Mulrow, Catala-Lopez, Gotzsche, Dickersin, Boutron, Altman and Moher2015).

Eligibility criteria

Population

The eligible population was defined as weaned cattle raised for meat production in intensive systems that put animals at risk of BRD. Eligible cattle were housed in feedlot settings, that is, as groups of penned cattle receiving rations rather than grazing on pasture. Calves explicitly described as veal or dairy calves were excluded from consideration. Calves raised on pasture, such as pre-conditioning and stocker calves, also were excluded.

Interventions

The interventions of interest were the injectable antibiotics listed in Table 1. The interventions were used in the early stages of the feedlot period to control the incidence of BRD. Any injectable antibiotic regime was eligible for inclusion; however, for reporting purposes, we only report on the efficacy of regimes that are licensed for use in the USA. All of the included antibiotics are licensed by the United States Food and Drug Administration (FDA) for the purpose of disease control, so the purpose of each antibiotic use was defined as control rather than treatment or prevention. The animals that received the antibiotics were a mixture of animals that were clinically sick but did not display detectable symptoms of BRD and animals that were disease free but at risk of developing BRD. Studies that assessed the efficacy of antibiotics used to treat cattle that had been previously diagnosed with BRD were not relevant to the review. Some studies explicitly removed detectably ‘sick’ animals from the study population at the time the animals arrived at the feedlot. The FDA considers such a study design to be an assessment of BRD control rather than BRD prevention, given the imperfect sensitivity of the methods used to detect BRD when the cattle arrive at the feedlot (Timsit et al., Reference Timsit, Dendukuri, Schiller and Buczinski2016). Although the FDA uses the term ‘control,’ we were unable to find an explicit definition of disease control used by the FDA. The American Veterinary Medical Association (AVMA) defines control as follows: Antimicrobial control of disease (synonym: metaphylaxis):

  • Control is the administration of an antimicrobial to an individual animal with a subclinical infection to reduce the risk of the infection becoming clinically apparent, spreading to other tissues or organs, or being transmitted to other individuals.

  • On a population basis, control is the use of antimicrobials to reduce the incidence of infectious disease in a group of animals that already has some individuals with evidence of infectious disease or evidence of infection (American Veterinary Medical Association, 2017).

Table 1. Antibiotic regimens extracted from studies identified by the systematic review

The antibiotic use in the studies included in our review corresponds to the second item in the AVMA definition. Furthermore, the synonym given by the AVMA for antimicrobial disease control, metaphylaxis, is defined by the European Union Commission as follows: term ‘metaphylaxis’, refers to the administration of the product at the same time to a group of clinically healthy (but presumably infected) in-contact animals, to prevent them from developing clinical signs, and to prevent further spread of the disease (European Union Commission, 2015), which is consistent with the AVMA definition. Much of the debate about what is control or prevention in the USA and Europe occurred after many of the studies in our review were conducted and reported. Therefore, the authors of the studies might have been uncertain about the distinctions between prevention and control, which are now important considerations but were not always so, and the peer-review process might likewise have been relatively unconcerned about ensuring that the precise purpose of the antibiotic use (i.e. prevention or control) was clarified.

The outcome that we extracted from the studies was the cumulative incidence of initial treatment for diagnosed BRD within the first 45 days that the cattle were on the feedlot. The choice of 45 days was somewhat arbitrary compared to other possible intervals such as 30 or 60 days. However, the goal was to capture early occurrences of BRD that might be impacted by the use of antibiotics at the time the cattle arrived on the feedlot. Secondary outcomes were BRD incidence and BRD mortality over the entire time the cattle were on the feedlot. The metrics extracted from the studies were prioritized as follows:

  • First priority metric: Estimates of efficacy that adjusted for the clustering of feedlot populations, such as adjusted risk ratios, adjusted odds ratios, or the arm-level probability of an event obtained by transformation of the adjusted odds ratio. If the study was conducted in only one pen, the adjustment was not considered necessary.

  • Second priority metric: Estimates of efficacy that did not adjust for the clustering of feedlot populations, such as unadjusted risk ratios, unadjusted odds ratios, or the arm-level probability of an event obtained by transformation of the unadjusted odds ratio.

  • Third priority metric: Raw arm-level data, such as the number of animals with BRD and the number of animals allocated and analyzed in the group.

If the first priority metric was reported, the lower priority metrics were not extracted. Our rationale for the prioritization was that the meta-analysis should use an adjusted summary effect, as most relevant studies are randomized trials conducted in clustered populations.

Study designs

Studies relevant to the review had to contain at least one comparison group (active comparator or placebo) and at least one group that received one of the injectable antibiotic regimens considered an on-label use to control BRD in feedlot cattle (Table 1). Each study had to describe how the investigator selected the allocation to distinguish it from a cohort study. Challenge studies were not eligible. Although the approved protocol stated that only randomized studies were to be included, studies that reported using ‘systematic randomization’ or pure systematic (e.g. alternation) allocation were included, because they were considered trials. The potential for bias associated with non-random allocation methods was captured by the risk-of-bias assessment. Studies with cluster-based or individual-based allocation were eligible for inclusion.

Report characteristics

In addition to the eligibility criteria described in the PICOS elements described above, the included studies had to have their full texts available in English. Peer review was not an eligibility criterion, as information from conference proceedings was eligible for inclusion. No country or date restrictions were applied.

Information sources

The electronic databases used for the literature search were MEDLINE, MEDLINE In-Process and MEDLINE Daily, Epub Ahead of Print, Cambridge Agricultural and Biological Index (CABI), Science Citation Index, Conference Proceedings Citation Index Science, and AGRICOLA. MEDLINE sources were searched using the Ovid interface. AGRICOLA was searched via Proquest. The remainder of the databases were searched using the Iowa State University Web of Science interface.

The proceedings of the American Association of Bovine Practitioners (1997–2017) and the World Buiatrics Conference (1997–2017) were searched for relevant citations. We also searched the FDA Freedom of Information (FOI) New Animal Drug Applications (NADA) summaries online (https://animaldrugsatfda.fda.gov/adafda/views/#/foiDrugSummaries). European Medicines Authority (EMA) data were not searched because neither the European Public Assessment Report (EPAR) nor its product information provides data similar to the FDA FOI NADA summaries. Finally, we searched the bibliographies of the reviews that were identified in the initial screening for additional studies (Abell et al., Reference Abell, Theurer, Larson, White and Apley2017; Baptiste and Kyvsgaard, Reference Baptiste and Kyvsgaard2017). The search results were uploaded to EndNoteX9 (Clarivate Analytics, Philadelphia, PA, USA), and duplicate results were identified and removed. The records were then uploaded to the systematic review management software DistillerSR (Evidence Partners Inc., Ottawa, ON, USA) and examined further to exclude duplicate records.

Search

The searches conducted are summarized in Supplementary Tables S1–S5. The search approach was modified for the different database or information source as appropriate.

Selection of studies relevant to the review

The first round of study selection was based on abstracts and titles. The second round of study selection, for relevance to the meta-analysis, was based on the full text of the articles. The questions used for each level of screening are provided in the protocol available online (https://works.bepress.com/annette_{o}connor/82/). Some minor modifications for clarity were made to the questions in the protocol, as described in the text accompanying the Supplementary materials S1 and S12. For example, an additional answer option was included that allowed reviewers to identify reviews that were potentially relevant to the project.

Two reviewers conducted a pre-test of the first 100 abstracts identified in the search to ensure that the questions were clear and consistently understood. The questions and their wording were revised during the pre-test phase until there was agreement that they captured the required information. Studies were excluded if both reviewers responded ‘no’ to either Q1 or Q2 in Table S2. If at least one reviewer responded ‘yes’ to each question, the study was advanced to the full-text assessment, which determined if the studies met the eligibility criteria for inclusion in the meta-analysis. Two reviewers conducted a pre-test on the first five full texts that were advanced to the full-text assessment to again ensure that the questions were clear and consistently understood. The questions and their wording were revised further during the second pre-test phase until there was agreement that they captured the required information. During the data extraction phase, if disagreements about eligibility occurred, a third reviewer (AOC) was consulted. As a result of the consultation process, the final agreement among the reviewers was 100%.

Studies that passed the full-text assessment were included in the meta-analysis if they contained sufficient data for the log odds ratio and the standard error of the log odds ratio to be calculated using the prioritized metrics extracted from the study. The criteria for inclusion in the meta-analysis are described further in the statistical analysis section.

Data collection process

Systematic review management software (DistillerSR®, Evidence Partners, Ontario, Canada) was used to extract data from the selected studies into the pre-tested forms. Two reviewers independently extracted all of the data elements of interest from the relevant full-text articles. After extraction, any disagreements were resolved by discussion. If the discussions did not lead to consensus, a third reviewer (AOC) was consulted. The unit of concern for data extraction was the study level, if available. Data from multi-site studies were extracted at the site level if the relevant information was reported. If investigators combined multiple sites into a single analysis and only reported the pooled information, then the pooled information was extracted. We did not contact the study authors about missing data. If multiple studies were linked, we used all of the available information and cited the study that provided the most complete report.

Data items

Items such as the country and year in which the study was conducted, the interventions that were used, and the outcomes that were measured were extracted at the study level. If baseline characteristics and information about the loss to follow-up were reported, those were extracted as arm-level data. Other data extracted at the arm level included the treatments and the results (based on prioritization). The published protocol, which includes a list of all items extracted, is available online.

Geometry of the network

Network geometry was assessed using a previously proposed approach (Salanti et al., Reference Salanti, Kavvoura and Ioannidis2008). The probability of an inter-species encounter (PIE) index was calculated using a custom R script. The PIE index is a continuous variable that decreases in value as unevenness increases. Values <0.75 can be considered to reflect a limited diversity of interventions. We also assessed co-occurrence using the C-score, which is based on a checkerboard analysis and describes whether particular pairwise comparisons of specific treatments are preferred or avoided within the network (Salanti et al., Reference Salanti, Kavvoura and Ioannidis2008). The C-score test was performed using the R package EcoSimR version 0.1.0 (Gotelli and Entsminger, Reference Gotelli and Entsminger2001).

Risk of bias within individual studies

The risk-of-bias form used for this study was based on the Cochrane Risk of Bias 2.0 tool for randomized trials. The form was modified to ensure its relevance to the topic area (Higgins et al., Reference Higgins, Sterne, Savović, Page, Hróbjartsson, Boutron, Reeves and Eldridge2016). The risk-of-bias assessment was conducted at the outcome level (BRD morbidity and mortality) for the outcome assessment domain. For the other risk domains, the responses for BRD morbidity and mortality were considered the same within a given study. For the purpose of assessing the risk of bias due to allocation processes, the Cochrane Risk of Bias tool for individually allocated studies places substantial emphasis on allocation concealment. It is unclear, however, if that emphasis is applicable in beef production settings. Therefore, rather than make an overall bias assessment for bias arising from the allocation approach, we asked the following three signaling questions:

  • SQ 1.1 – Was the allocation sequence random?

  • SQ 1.2 – Was the allocation sequence concealed until participants were recruited and assigned to interventions?

  • SQ 1.3 – Were there evident baseline imbalances that suggested a problem with the randomization process?

For cluster-randomized trials, the first three signaling questions for bias arising from the allocation approach were also assessed and presented with the individual-level questions. Two additional questions related to bias arising from the characteristics of individual participants in the cluster-randomized studies were assessed and presented separately.

  • Were all the characteristics of the individual participants likely to be evenly distributed across the treatment groups?

  • Were there any baseline imbalances that suggested differential identification or recruitment of individual participants between arms?

If studies within a single citation had different characteristics that impacted bias, such as loss to follow-up, a risk-of-bias assessment was made for each study separately. Otherwise, multiple studies presented within a single citation were considered as a single set of results.

The other bias domains considered were the following:

  1. (1) Domain 2: Bias arising from deviations from the intended interventions;

  2. (2) Domain 3: Bias arising from missing outcome data;

  3. (3) Domain 4: Bias arising from the measurement of the outcome; and

  4. (4) Domain 5: Bias arising from the selection of the reported outcome.

Summary measures

The baseline risk used to convert the odds ratios to the risk ratio was obtained using the distribution of the log odds of the placebo group. The posterior distribution of the mean was N(−0.3759; 1.0323). The posterior distribution of the standard deviation was N(1.0059; 0.1392).

Planned method of statistical analysis

The proposed method of statistical analysis has been described in detail elsewhere (Dias et al., Reference Dias, Welton, Caldwell and Ades2010). We used a random-effects Bayesian model for continuous outcomes. Let b denote the baseline treatment of the whole network (usually placebo), and let b i denote the trial-specific baseline treatment of trial i. It could be the case that b ≠ b i. Suppose there are L treatments in a network. Assume a normal distribution for the continuous measure of the treatment effects of arm k relative to the trial-specific baseline arm b i in trial i, $y_{ib_ik}$, with variance $V_{ib_ik}$, such that

$$y_{ib_ik}\sim N\lpar {{\rm \theta }_{ib_ik}\comma \;V_{ib_ik}} \rpar \comma \;$$

and

$${\rm \theta }_{ib_ik}\sim \left\{{\matrix{ {N\lpar {d_{b_ik}\comma \;\sigma_{b_ik}^2 } \rpar \comma \;} & {{\rm for\;}b_i = b\comma \;} \cr {N\lpar {d_{bk}-d_{bb_i}\comma \;\sigma_{b_ik}^2 } \rpar \comma \;} & {{\rm for\;}b_i\ne b\comma \;} \cr } } \right.$$

where d bk is the treatment effects of k relative to the network baseline treatment b and ${\rm \sigma }_{b_ik}^2 $ is the between-trial variance. The priors of d bk and ${\rm \sigma }_{b_ik}$ are

$$d_{bk}\sim N\lpar {0\comma \;10000} \rpar \comma \;$$

and there is a homogeneous variance assumption that ${\rm \sigma }_{b_ik}^2 = {\rm \sigma }^2$, where σ ~ U(0, 5). Thus, for L treatments, we have L − 1 priors for d bl, l ∈ {1, …, L}, l ≠ b. For l = b, we have d bb = 0.

Handling of multi-arm trials

For multi-arm trials, we assumed that the co-variance between ${\rm \theta }_{jb_jk}$ and ${\rm \theta }_{jb_j{k}^{\prime}}$ was σ2/2 (Higgins and Whitehead, Reference Higgins and Whitehead1996; Lu and Ades, Reference Lu and Ades2004). The likelihood of a trial i with a i arms would be defined as multivariate normal:

$$\left({\matrix{ {y_{i\comma 1\comma 2}} \cr {y_{i\comma 1\comma 3}} \cr \vdots \cr {y_{i\comma 1\comma a_i}} \cr } } \right)\sim N_{a_i-1}\left({\left({\matrix{ {{\rm \theta }_{i\comma 1\comma 2}} \cr {{\rm \theta }_{i\comma 1\comma 3}} \cr \vdots \cr {{\rm \theta }_{i\comma 1\comma a_i}} \cr } } \right)\comma \;\left[{\matrix{ {V_{i\comma 1\comma 2}} & {se_{i1}^2 } & \cdots & {se_{i1}^2 } \cr {se_{i1}^2 } & {V_{i\comma 1\comma 3}} & \cdots & {se_{i1}^2 } \cr \vdots & \vdots & \ddots & \vdots \cr {se_{i1}^2 } & {se_{i1}^2 } & \cdots & {V_{i\comma 1\comma a_i}} \cr } } \right]} \right)\comma$$

where the diagonal elements in the variance–covariance matrix represent the variances of the treatment differences, and the off-diagonal elements represent the observed variance in the control arm in trial i, denoted by $se_{i1}^2 $. For all studies, the results were converted to log odds ratios for analysis. If the study authors reported a risk ratio, that was converted back to the log odds ratio using the reported risk of disease in the placebo group. When the authors reported the probability of BRD in each treatment arm on the basis of a model, then that probability was converted back to the logs odds ratio using a method described elsewhere (Hu et al., Reference Hu, Wang and O'Connor2019).

Selection of prior distributions in the Bayesian analysis

The prior distributions were originally based on an approach reported previously (Dias et al., Reference Dias, Welton, Sutton and Ades2011). As in previous models, we assessed σ ~ U(0, 2) and σ ~ U(0, 5), and our results suggested that σ ~ U(0, 5) was preferable. We repeated that assessment and retained the same prior distributions used in the previous models (O'Connor et al., Reference O'Connor, Yuan, Cullen, Coetzee, da Silva and Wang2016).

Implementation and output

All posterior samples were generated using a Markov Chain Monte Carlo (MCMC) simulation implemented with the Just Another Gibbs Sampler (JAGS) software (Plummer, Reference Plummer2015). All statistical analyses were performed using R software (version 3.5.2) (R Core Team, 2015). We fitted the model using JAGS, an MCMC sampler, by calling JAGS from R through the rjags package (version 4-8) (Plummer, Reference Plummer2015). Three chains were simulated and the convergence was assessed using Gelman–Rubin diagnostics. We discarded 5000 ‘burn-in’ iterations based on our inferences from a further 10,000 iterations. The model output included all possible pairwise comparisons of the log odds ratios (for inconsistency assessment), risk ratios (used for comparative efficacy reporting), and treatment failure rankings (for comparative efficacy reporting).

Assessment of the model fit

The fit of the model was assessed on the basis on the log odds ratios by examining the residual deviance between the predicted values from the MTC model and the observed values from each study (Dias et al., Reference Dias, Welton, Caldwell and Ades2010).

Assessment of inconsistency

Network meta-analysis relies on an assumption of consistency between direct and indirect intervention effects that are distinct from the usual variation that stems from a random effects meta-analysis model. For example, if one study compares the direct effect of treatment A with the effect of treatment B, and another study compares the efficacies of treatments B and C, then the (indirect) effect of treatment A relative to the efficacy of treatment C can be inferred. We used the back calculation method to assess the consistency assumption (Dias et al., Reference Dias, Welton, Caldwell and Ades2010). We did not rely only on the P-values for the consistency evaluation; instead, we compared the direction and magnitude of the estimates. We also compared the estimates from the direct and indirect models and considered the standard deviation of each estimate. Comparisons in which the direct and indirect estimates had different signs were further evaluated and discussed.

Risk of bias assessment across studies

To describe the overall quality of the evidence network and the bias across the studies, we employed a modification of the GRADE approach for network meta-analysis (Salanti et al., Reference Salanti, Del Giovane, Chaimani, Caldwell and Higgins2014; Papakonstantinou et al., Reference Papakonstantinou, Nikolakopoulou, Rucker, Chaimani, Schwarzer, Egger and Salanti2018) using the Confidence in Network Meta-Analysis (CINEMA) online software (http://cinema.ispm.ch) (CINeMA: Confidence in Network Meta-Analysis [Software] 2017). CINEMA takes a frequentist approach to the calculation of treatment effects based on the metafor package in R (Viechtbauer, Reference Viechtbauer2010). The contribution matrix for the risk of bias is based on that approach. An equivalent tool using a Bayesian analysis is not currently available. The system that we used evaluates within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence. We evaluated and reported the contributions of studies to the within-study bias on the basis of randomization and blinding rather than an overall assessment of bias. The rationale for using that approach was that there is evidence from veterinary science that failure to include randomization and blinding elements in the study design is associated with larger estimates of effects, whereas there is no evidence that other elements included in the Cochrane risk of bias, such as allocation concealment, introduce any bias in livestock production data (Sargeant et al., Reference Sargeant, Elgie, Valcour, Saint-Onge, Thompson, Marcynuk and Snedeker2009). For randomization, we evaluated the risk of bias as follows:

  • ‘Low risk of bias’ refers to studies that reported and provided evidence of random allocation, identified by a ‘yes’ or ‘probably yes’ answer to risk-of-bias question Q1.1.

  • ‘Unclear risk of bias’ refers to studies that reported random allocation but provided no evidence, identified by a ‘no information random’ response to risk-of-bias question Q1.1.

  • ‘High risk of bias’ refers to studies that used non-random allocation or provided no information about allocation, identified by a ‘no,’ ‘probably no,’ or ‘no information at all’ response to risk-of-bias question Q1.1.

We considered proper blinding of caregivers and outcome assessors to be associated with a low risk of bias. If the study authors mentioned only one of those, we considered it unclear whether or not there was potential for bias, and if neither was reported, we considered the potential for bias to be high.

  • ‘Low risk of bias’ refers to studies that reported blinding of caregivers and outcome assessors, identified by a ‘no’ or ‘probably no’ response to risk-of-bias questions Q 2.2 and Q4.1.

  • ‘Unclear risk of bias’ refers to studies that reported blinding of caregivers and outcome assessors, identified by a ‘no’ or ‘probably no’ response to risk-of-bias question Q 2.2 or Q4.1, but not both.

  • ‘High risk of bias’ refers to studies that did not fall into the above two categories.

In CINEMA, indirectness refers to how closely the study populations resemble the populations in which the intervention is to be used. Given the narrow eligibility criteria for our meta-analysis, we did not consider indirectness to be an issue. Accordingly, we considered the risk of bias due to indirectness to be low in all of the selected studies. The ability to assess bias across studies in a network meta-analysis is poorly developed. None of the studies that we reviewed had a sufficient number of pairs to make an informative pairwise assessment of small-study effects, so we did not attempt that assessment. For the assessment of imprecision, which indicates if the boundaries of the confidence intervals for the treatment effects could lead to different outcomes, we used 0.8, a clinically important odds ratio that equates to ±0.2231 on the log scale. We used the same odds ratio to assess heterogeneity. We did not present the inconsistency analysis from CINEMA, because that analysis was already conducted as part of the Bayesian analysis.

Additional analyses

No additional analyses were conducted.

Results

Study selection

The flow of the studies from citation retrieval to inclusion in the meta-analysis is shown in the PRISMA diagram in Fig. 1. In the PRISMA diagram, we only show unique relevant citations. Some citations had multiple trials, multiple arms, or multiple time periods at which outcomes were reported. Because of the rarity of the mortality outcome, we deviated from the approved protocol and did not analyze that outcome. Eighty-five trials from a total of 73 citations reported at least one BRD morbidity outcome.

Fig. 1. Flowchart describing the flow of literature through the review.

Study selection: excluded because of data extraction issues

Seventeen citations had at least one trial in which an arm was excluded from our meta-analysis because of one of the following data issues: multiple arms represented the same treatment, there were zero events in one arm, no extractable data were presented, there was no P-value or baseline risk available for data conversion, the treatment regimen was inadequately described, or the treatment was entirely disconnected from the network (Schipper and Kelling, Reference Schipper and Kelling1974; Janzen and McManus, Reference Janzen and McManus1980; Brown et al., Reference Brown, Faulkner and Cmarik1989; van Koevering et al., Reference van Koevering, Gill, Smith, Hill and Ball1992; Guichon et al., Reference Guichon, Booker and Jim1993; Galyean et al., Reference Galyean, Gunter and Malcolm-Callis1995; Montague et al., Reference Montague, Smith and Gill1996; Reece and Smith, Reference Reece and Smith1996; Brazle, Reference Brazle1997; Hibbard et al., Reference Hibbard, Robb, Chester, Dame, Moseley and Bryson2002; Booker et al., Reference Booker, Schunicht, Guichon, Jim, Wildman, Pittman and Perrett2006; Booker et al., Reference Booker, Abutarbush, Schunicht, Jim, Perrett, Wildman, Guichon, Pittman, Jones and Pollock2007; Fazzio et al., Reference Fazzio, Giuliodori, Galvan, Streitenberger and Landoni2015; Crepieux et al., Reference Crepieux, Miller, Regev-Shoshani, Schaefer, Dorin, Alexander and Timsit2016; Miller et al., Reference Miller, Hubbert, Reinhardt, Loest, Schwandt and Thomson2016; Timsit et al., Reference Timsit, Hallewell, Booker, Tison, Amat and Alexander2017a, Reference Timsit, Workentine, Crepieux, Miller, Regev-Shoshani, Schaefer and Alexander2017b; Food and Drug Administration, 2018f).

Study selection: excluded because of the duration of BRD assessment

Nineteen trials either did not report the duration of their observations of BRD incidence or had an observation period longer than 45 days (Schipper and Kelling, Reference Schipper and Kelling1971; Stokka and Kreikemeier, Reference Stokka and Kreikemeier1996; Schunich et al., Reference Schunich, Guichon, Booker, Jim, Wildman, Hill, Ward, Bauck and Jacobsen2002; Cusack, Reference Cusack2004; Step et al., Reference Step, Engelken, Romano, Holland, Krehbiel, Johnson, Lawrence, Tucker and Robb2007; Bryant et al., Reference Bryant, Nichols, Adams, Farmer and Miles2008; John et al., Reference John, Bryson, Sam and Breck2008; van Donkersgoed et al., Reference van Donkersgoed, Merrill and Hendrick2008; Corbin et al., Reference Corbin, Gould, Carter, McClary and Portillo2009; Blasi et al., Reference Blasi, Epp and Derstein2010; van Donkersgoed and Merrill, Reference van Donkersgoed and Merrill2012; Hendrick et al., Reference Hendrick, Bateman and Rosengren2013; Stegner et al., Reference Stegner, Lucas, McLaughlin, Davis, Alaniz, Weigel, Pollreisz, Tucker, Koers, Turgeon and Szasz2013; van Donkersgoed and Merrill, Reference van Donkersgoed and Merrill2013a, Reference van Donkersgoed and Merrill2013b; Compiani et al., Reference Compiani, Baldi, Bonfanti, Fucci, Pisoni, Jottini and Torres2014; Tennant et al., Reference Tennant, Ives, Harper, Renter and Lawrence2014; Sturgess and Renter, Reference Sturgess and Renter2017; van Donkersgoed et al., Reference van Donkersgoed, Hendrick and Nickel2017).

Study selection: included in the meta-analysis

Our meta-analysis included data from 37 citations that described 46 studies in which BRD morbidity was reported within 45 days of the arrival of the cattle at the feedlot (Lofgreen et al., Reference Lofgreen, Addis, Dunbar and Clark1978; Breeze et al., Reference Breeze, McManus, Magonigle, Olson, Tonkinson and Costerton1982; Gill et al., Reference Gill, Smith, Hicks and Ball1986; Schumann et al., Reference Schumann, Janzen and McKinnon1990; Harland et al., Reference Harland, Jim, Guichon, Townsend and Janzen1991; Schumann et al., Reference Schumann, Janzen and McKinnon1991; Morck et al., Reference Morck, Merrill, Thorlakson, Olson, Tonkinson and Costerton1993; Vogel et al., Reference Vogel, Laudert, Zimmermann, Guthrie, Mechor and Moore1998; McClary and Vogel, Reference McClary and Vogel1999; Duff et al., Reference Duff, Walker, Malcolm-Callis, Wiseman and Hallford2000; Frank and Duff, Reference Frank and Duff2000; Glynn et al., Reference Glynn, Robert, Glenn, Raymond and Charles2002; Meeuwse and Hibbard, Reference Meeuwse and Hibbard2002; Food and Drug Administration, 2003; Guthrie et al., Reference Guthrie, Rogers, Christmas, Vogel, Laudert and Mechor2004; Kilgore et al., Reference Kilgore, Spensley, Sun, Nutsch, Rooney and Skogerboe2005; Rooney et al., Reference Rooney, Nutsch, Skogerboe, Weigel, Gajewski and Kilgore2005; Martin et al., Reference Martin, Partida, Villalobos, Lopez, Lopez-Guerrero and Blanco2007; Benton et al., Reference Benton, Erickson, Klopfenstein, Luebbe, Smith, Sides and Bryant2008; Montgomery et al., Reference Montgomery, Sindt, Greenquist, Loe and Drouillard2008; Nickell et al., Reference Nickell, White, Larson, Blasi and Renter2008; Rossi et al., Reference Rossi, Vandoni, Bonfanti and Forbes2010; Baggott et al., Reference Baggott, Casartelli, Fraisse, Manavella, Marteau, Rehbein, Wiedemann and Yoon2011; Gonzalez-Martin et al., Reference Gonzalez-Martin, Elvira, Lopez, Villalobos, Lopez-Guerrero and Astiz2011; Siddartha et al., Reference Siddartha, Thomson, Bello, Nosky and Reinhardt2013; Amrine et al., Reference Amrine, White, Goehl, Sweiger, Nosky and Tessman2014; White et al., Reference White, Amrine and Goehl2015; DeDonder et al., Reference DeDonder, Apley, Li, Gehring, Harhay, Lubbers, White, Capik, KuKanich, Riviere and Tessman2016; Hanzlicek et al., Reference Hanzlicek, Blasi, Oleen and Anderson2016; Hawley et al., Reference Hawley, Powell, Kegley and Beck2016; Regev-Shoshani et al., Reference Regev-Shoshani, McMullin, Nation, Church, Dorin and Miller2017; Food and Drug Administration, 2018a, 2018b, 2018c, 2018d, 2018e, 2018f, 2018g).

Presentation of the network structure

The final evidence network used in the meta-analysis represented 46 studies and 167 arms. Some of the arms used treatment regimens that were not labeled for use in the USA but contributed useful information about variations of regimens of interest. The antibiotic regimens used in those off-label studies are reported in Table 1. Four of the included studies were three-arm studies, and one was a four-arm study. Thirty-four of the studies compared non-active or controlled treatment groups with active treatment groups, whereas the other 12 studies compared multiple active treatment groups.

Summary of the network geometry

The geometry of the network was sparse, with many regimens assessed only once. The network was diverse, however, as indicated by the PIE index of 0.84. A PIE index of >0.75 suggests that a network is diverse, although, as with any threshold, that is a guideline rather than a strict cut-off for interpretation purposes (Salanti et al., Reference Salanti, Kavvoura and Ioannidis2008). The conclusion that the network was diverse is consistent with a visual examination of the network, which includes a large number of treatments (Fig. 2). The diversity measure considers all treatments included in the meta-analysis and is bolstered by treatments that were not relevant to the meta-analysis. The C-score was 19.45 (P = 0.43). The C-score is used to evaluate how random encounters occur in ecological populations. When used in a network meta-analysis, the C-score assesses whether or not there are particular pairwise comparisons that occur more (or less) often than expected if the pairing is random. Although the P-value suggests that the pairing was random, visual examination of the network suggests that researchers had a preference for comparisons that involved placebo-controlled study arms.

Fig. 2. The network of treatment arms used in the mixed-treatment comparisons meta-analysis. The size of the dot is a relative indicator of the number of arms, and the width of the lines is a relative indicator of the number of direct comparisons. Abbreviations defined in Table 1.

Study characteristics

The descriptive information, including the definitions of success and the exclusion criteria, about the studies identified in the literature search is provided in the Supplementary materials (Table S6). All of the relevant studies, rather than just those included in the meta-analysis, are listed in Table S6 to show how the study populations differed between the studies that were included in the meta-analysis and those that were excluded. Of particular interest is the baseline conditions applied to the animals in each study. Some of the studies failed to clearly document concurrent treatments that were received by the animals, such as vaccinations, antiparasitic treatments, and antibiotics. Other studies did provide that information, and some even reported using in-feed antibiotics concurrently with the injectable antibiotics for BRD control.

The approaches used to handle the cases of BRD that were diagnosed at the time the cattle arrived on the feedlot are reported in Table S7. Many studies failed to clearly describe how those cases of BRD were handled. The definitions of BRD reported by the study authors are listed in Table S8. In each instance where a single citation included multiple studies, the studies used the same definition of the outcome, so Table S8 is indexed by citation rather than by study. The definitions of outcomes were generally consistent and frequently reported.

Individual risk of bias

The results of the risk-of-bias assessments for the studies that were determined to be relevant to the meta-analysis are shown in Table S9. The answers to the two additional questions for the cluster-randomized trials are presented in Table S10.

Synthesis of the results

The final meta-analysis included results from 46 studies. The measures of convergence from the Bayesian model were within normal limits. The results of the model are presented in several ways. Table 4 shows the comparative risk ratios for only the label-dose regimens. The data are organized so that the event is the risk of treatment failure for the treatment listed in the row, divided by the risk of failure for the treatment listed in the column. For example, in the first row of the table, all the risk ratio estimates are >1, meaning that the risk of treatment failure was higher in the non-active control (NAC) groups for PLC compared with that in the active treatment groups for each of the other antibiotics. The upper right-hand quadrant of Table 4 shows the estimated risk ratio, and the lower quadrant reports the 95% CI. Estimates of the average ranks of the antibiotics in terms of efficacy are provided in Fig. 3, which only includes the label-dose regimens. The rankings for the label-dose regimens in the meta-analysis are presented in Table 2. We excluded the off-label regimens from Fig. 3 because we do not want to promote the off-label use of antibiotics. Rankings close to 1 are associated with low rates of treatment failure. There is considerable overlap in the confidence intervals of the rankings. The probability distribution of the treatment responses for the label-dose protocols is presented in the Supplementary materials (Table S13 and Fig. S1). Also included in the Supplementary materials is a summary of the probabilities of being ranked first and last (Table S14) and all possible pairwise probabilities of being better or worse than other antibiotic regimens in Table S15.

Fig. 3. Ranking plot of relevant treatments. Lower rankings indicate lower incidence of BRD. Rankings are reported for label-dose regimens only. Abbreviations are defined in Table 1.

Table 2. Mean ranking by treatment efficacy of antibiotic regimens based on the mixed-treatment comparisons meta-analysis

Lower rankings indicate a lower incidence of BRD. World Health Organization categories for medically important antibiotics: Critically Important Antimicrobial (CIA), Highly Important Antimicrobial (HIA), Important Antimicrobial (IA) (SD, standard deviation).

Exploration of inconsistency

The consistency between the direct and indirect sources of evidence in the final model using 46 studies and 167 arms is reported in Table 3. In the model, we found no evidence of inconsistency between the direct and indirect estimates. A potential reason for that finding is that the small number of studies available for some comparisons caused the standard deviations for the direct estimates to be very wide, making it difficult to detect differences between direct and indirect estimates.

Table 3. Results of the indirect comparison for the consistency assumption

Posterior means (d) and standard deviations (SD) of the log-odds ratio of treatment effects calculated using direct evidence only (dir), all evidence (MTC), and indirect evidence only (rest). The treatment on the left is the reference (denominator), and that on the right is the comparator (numerator). w and SD(w) are the inconsistency estimate and standard deviation of the inconsistency estimate, respectively.

Risk of bias across studies

There was an enormous number of possible pairwise comparisons (i.e. all possible pairs) in the risk-of-bias assessment. Therefore, we only presented the active-to-active comparisons of on-label antibiotic regimes (Table S11). The contributions of the included studies to the risk of bias based on the studies' randomization status are presented in Fig. 4. The contributions based on the studies' blinding status are presented in Fig. 5. Fewer studies presented a risk of bias due to randomization issues than presented risks due to blinding issues. We assumed that all of the studies were free of bias related to indirectness. For each outcome, a considerable number of comparisons presented major concerns related to imprecision, reflecting the large confidence intervals of the risk ratios resulting from the small number of trials in each comparison. Most of the comparisons presented no concerns about bias due to heterogeneity, which was expected on the basis of the wide confidence intervals of the risk ratios.

Fig. 4. The contributions to the point estimate of efficacy by studies using different allocation approaches: green indicates studies that provided evidence of random allocation; yellow indicates studies that reported random allocation but provided no supporting evidence; red indicates studies that reported no allocation approach or reported a non-random allocation approach. White vertical lines indicate the percentage contribution of separate studies. Each bar shows the percentage contribution from studies judged to be at low (green), moderate (yellow), and high (red) risk of bias.

Fig. 5. The contributions to the point estimate of efficacy by studies using different blinding approaches: green indicates studies that provided evidence of blinding of caregivers and outcome assessors; yellow indicates studies that provided evidence of blinding of either caregivers or outcome assessors; red indicates studies that reported no blinding of caregivers or outcome assessors. White vertical lines indicate the percentage contribution of separate studies. Each bar shows the percentage contribution from studies judged to be at low (green), moderate (yellow), and high (red) risk of bias.

Results of additional analyses

No additional analyses were conducted.

Discussion

Summary of the evidence

The results suggest that the macrolides as a group are the most effective antibiotics administered to cattle upon arrival at the feedlot to control BRD. The evidence for that conclusion is summarized best in the ranking plot (Fig. 3), which shows that the regimens involving tulathromycin, gamithromycin, tilmicosin, and tildipirosin are the top-ranked treatments. Ceftiofur had the next highest ranking, after the macrolides. Those results are consistent with the findings of other reviews of antibiotic use to control BRD in feedlot cattle (Abell et al., Reference Abell, Theurer, Larson, White and Apley2017; Baptiste and Kyvsgaard, Reference Baptiste and Kyvsgaard2017). The macrolides are listed as critically important antibiotics with the highest priority by the World Health Organization (WHO). Oxytetracycline and florfenicol, also listed as important antibiotics by the WHO, were less effective than the macrolides and ceftiofur, although they were more effective than danofloxacin and enrofloxacin (both of which are critically important). Many of the comparisons with other regimens in our meta-analysis are based on only a single study, so confidence in the pairwise differences is low. Data from the National Animal Health Monitoring Scheme Antibiotic Use 2017 report indicate that 14.8% (SE 3.5) of feedlots used injectable antibiotics in groups of cattle. In that report, ‘treated as a group’ meant that at least 90% of the cattle in a pen or group were treated with one or more injectable antimicrobial agent for the purpose of preventing, controlling, or treating a disease outbreak. Injectable oxytetracycline is the antibiotic most commonly used on groups of cattle on feedlots in the USA (United States Department of Agriculture Animal and Plant Health Inspection Service Veterinary Services National Animal Health Monitoring System May, 2019) (4.8%, SEM 2.5), followed by tulathromycin (2.8%, SEM 0.8), ceftiofur (2.7%, SEM 1.3), and enrofloxacin (2.4%, SEM 2.0). In terms of the percentage of cattle treated, rather than the percentage of feedlots using the antibiotic, the injectable antibiotic most commonly used in groups of cattle on feedlots was tulathromycin (4.4%, SEM 0.6), followed by gamithromycin (2.9%, SEM 0.8). It would be tempting to link those statistics with the estimates of efficacy from our network meta-analysis in order to make inferences about prudent antibiotic choices. That is not feasible, however, because the NAHMS report does not distinguish among instances of injectable antibiotic use for prevention, control, and treatment of BRD. Our results suggest that most of the injectable antibiotics are very effective at reducing the incidence of BRD during the first 45 days that cattle are on the feedlot. Although the posterior distributions of the risk ratios were often wide, as suggested by the credible intervals in Table 4, the means of the posterior distribution of the risk distribution suggest that apart from sulfamethoxazole and trimethoprim combinations, the injectable antibiotics reduced the risk of BRD within the first 45 days on the feedlot by 1.5-fold on average compared with placebo. An alternative way to look at those data is to use Table S15, which shows that all of the antibiotic regimens have at least a 0.5 probability of being better than a NAC. Because the diagnosis of BRD is imperfect, and misclassification would bias the associations toward the null, the actual efficacy of the antibiotics is likely even higher than our estimates (White and Renter, Reference White and Renter2009).

Table 4. Risk ratio of all possible pairwise comparisons within the evidence network for injectable on-label antibiotic regimes

The upper right-hand quadrant represents the estimated risk ratio, and the lower quadrant represents the 95% credible interval. Risk ratios are reported for registered antibiotic regimens only. Abbreviations are defined in Table 1.

Limitations of the body of work

The body of work that informed our literature review was large and relevant to the North American feedlot populations. In those characteristics, we believe that the studies met the important transit assumption of network meta-analysis: that the animals in a given study would be eligible for the treatments used in other studies. We did, however, find that lack of replication was an issue in some of the studies. For many interventions, only one trial was available. Therefore, estimates of effect sizes were often based on only one study. As with any scientific investigation, the value of replication is that it enables the consistency of effect measurements to be assessed.

Another limitation of the body of work is that the size of the effect of antibiotic use might change over time, and our time frame for study retrieval was not restricted. All methods of research synthesis assume that the network of evidence being used is static, meaning that the estimates presented in research reports are valid at the time the research was conducted and in subsequent years. However, there are a number of published studies suggesting that the frequency of antimicrobial resistance and the likelihood of multi-resistant organisms being present in host populations are growing (DeDonder and Apley, Reference DeDonder and Apley2015; Anholt et al., Reference Anholt, Klima, Allan, Matheson-Bird, Schatz, Ajitkumar, Otto, Peters, Schmid, Olson, McAllister and Ralston2017). The evaluation of trends over time in treated animals is complicated by the association between antibiotic treatment and the emergence of antimicrobial resistance in diagnostic samples (Magstadt et al., Reference Magstadt, Schuler, Coetzee, Krull, O'Connor, Cooper and Engelken2018). When antimicrobials, such as macrolides and tetracyclines, are used for both metaphylaxis and treatment, the emergence of resistant organisms becomes more likely (Timsit et al., Reference Timsit, Hallewell, Booker, Tison, Amat and Alexander2017a, Reference Timsit, Workentine, Crepieux, Miller, Regev-Shoshani, Schaefer and Alexander2017b). For those reasons, estimates of efficacy reported in older studies might no longer be valid because of recently emerging resistance, resulting in overestimations of current efficacy. Although it is unclear how the designation of ‘resistance’ empirically translates to metrics of clinical efficacy, most of the studies included in our meta-analysis were conducted early in the use period of the respective drugs and therefore represent the best-case scenario. If resistance is developing equally to all of the antibiotics, then the relative estimates of efficacy are likely still relevant. Alternatively, if resistance to some antibiotics is developing faster than that to other antibiotics, then the assumption of equal resistance development is not valid, and the relative estimates of efficacy have even more uncertainty than what is captured by research synthesis methods. One argument against changes in the prevalence of resistance being a major issue is that estimates derived from network meta-analyses very closely predict comparative efficacies in trials (O'Connor et al., Reference O'Connor, Coetzee, da Silva and Wang2013, Reference O'Connor, Yuan, Cullen, Coetzee, da Silva and Wang2016). Indeed, estimates of treatment efficacy for BRD from older studies were able to very accurately predict the comparative efficacies of new drugs (O'Connor et al., Reference O'Connor, Coetzee, da Silva and Wang2013, Reference O'Connor, Yuan, Cullen, Coetzee, da Silva and Wang2016). For example, for the comparison of gamithromycin (referent) and tulathromycin, the original model predicted a risk ratio of re-treatment of 0.54 (95% credible interval 0.27–0.87). In the subsequent randomized controlled trial, the observed risk ratio of re-treatment was 0.59 (95% confidence interval 0.45–0.78). For the gamithromycin (referent) and florfenicol comparison, the observed risk ratio in the randomized trial was 1.17 (95% confidence interval 0.83–1.64), and the estimated risk ratio from the prior model was 0.84 (95% credibility interval 0.48–1.3). For the gamithromycin and tilmicosin (referent) comparison, the risk ratio observed in the randomized trial was 0.99 (95% confidence interval 0.67–1.47), and the risk ratio estimated from the prior model was 1.09 (95% credible interval 0.64–1.79). If the data from older studies did not accurately represent current efficacy because of the emergence of resistant bacteria, those estimates would not be expected to be so close to the observed values. Assessment of error and bias is part of any good systematic review. The extent of random error is expressed by the credible intervals on the risk ratios and the rankings. The wide credible intervals in our results are mainly due to low replication within the studies. As shown in Fig. 2, for many antibiotic regimes, there is little publicly available information that could be incorporated into our meta-analysis. Large feedlot companies, veterinary consultants, and pharmaceutical companies likely have access to more trial data, but those data are not publicly available and could not be included in our meta-analysis.

The extent of possible systematic bias is presented individually in Table S9. It has been documented in a number of subfields of veterinary health that failure to randomize and blind studies is associated with biased estimates of intervention effects. However, in two previous systematic reviews and network meta-analyses related to BRD in beef cattle, we did not observe any overall changes in the magnitude of intervention effects (O'Connor et al., Reference O'Connor, Coetzee, da Silva and Wang2013, Reference O'Connor, Yuan, Cullen, Coetzee, da Silva and Wang2016). For some of the pairwise comparisons between antibiotics, Figs 4 and 5 show the relative contributions to the efficacy estimates of studies using different allocation approaches and blinding approaches (Papakonstantinou et al., Reference Papakonstantinou, Nikolakopoulou, Rucker, Chaimani, Schwarzer, Egger and Salanti2018). Our approach to those contribution matrices is that they should be used to interpret pairwise comparisons of particular interest. For example, the estimate for the comparison of OXY_1 and TMS (Table 4) suggests a 0.7-fold decreased risk of disease if OXY_1 is used instead of TMS. However, that estimate is based on several non-randomized studies, as indicated by the long red bar in Fig. 4, which also lacked information about blinding (Fig. 5). The problem with interpreting that kind of information is that, unlike in comparisons with placebos, we cannot hypothesize the direction of bias, because the contribution information is based on a pathway rather than a study. We therefore propose that the contribution information provides a visual indicator of the overall types of studies that contribute to a given estimate. Making more specific inferences about the direction of bias would require more knowledge about particular studies. We might also be skeptical about the results because of the sparse data, as indicated by the wide credible intervals. Although the data and derived estimates of efficacy represent the best evidence available, room for a healthy sense of uncertainty remains.

Limitations of the review process

Because our study was based on a systematic review, our first goal was to identify the relevant literature. The search was extensive, but it would have been ideal to have searched more databases if resources had permitted. Our database searches were complemented by other search approaches, such as hand searching. The database search strategies were sensitive, but they could have been made more sensitive by making greater use of the AND operator instead of the proximity operator, particularly to capture variant phrases related to the metaphylaxis concept. However, available resources dictated the use of the proximity operator since AND reduced precision and generated an unmanageably large volume of irrelevant records. It is also possible to search more websites and search engines, such as Google Scholar. However, within the limits of the available resources, we were able to achieve an extensive search.

Overall, the studies that contributed to the evidence base for our meta-analysis were well designed. Many studies reported randomization of cattle among treatment groups even if they did not provide evidence for the validity of the randomization. One of the major issues that we uncovered was differences in the baseline treatments that the cattle received when they arrived at the feedlot. Those differences could be interpreted in two ways: first, that the population was too heterogeneous to combine in a single analysis or, second, that the heterogeneity reflects the underlying population and is therefore a realistic representation of the cattle population most likely to receive antibiotics.

Conclusions

Overall, the existing body of research suggests that injectable antibiotics are generally effective at controlling BRD in feedlot cattle when they are administered at the time the cattle arrive at the feedlot. There is evidence that macrolides are the most effective injectable antibiotics for controlling BRD. The commonly used injectable oxytetracycline is also effective at controlling BRD, although less so than the macrolides. Oxytetracycline is already commonly used in groups of feedlot cattle to control, and treat BRD and therefore has advantages over the macrolides from an antibiotic stewardship perspective. Therefore, there might be an opportunity for wider use of injectable oxytetracycline to control BRD in feedlot cattle. If the use of antibiotics in feedlot cattle is discouraged, it is imperative that the efficacy of alternatives to antibiotics are fully understood so that producers can plan to mitigate the impacts that a lack of antibiotic use might have on animal welfare, health, and production.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S1466252320000031.

Acknowledgments

None to declare.

Author contributions

AOC developed the review protocol, coordinated the project team, assisted with the data analysis, interpreted the results, and prepared the manuscript drafts. DH conducted the data analysis, guided the interpretation of the results, commented on manuscript drafts, and approved the final version of the manuscript. ST conducted relevance screening, extracted data, provided guidance for the interpretation of the results, commented on the manuscript drafts, and approved the final manuscript. NS conducted relevance screening, extracted data, provided guidance for the interpretation of the results, commented on manuscript drafts, and approved the final manuscript. CWinder developed the review protocol, provided guidance for the interpretation of the results, commented on manuscript drafts, and approved the final manuscript version. JG developed the review protocol, provided guidance on the creation of the search, commented on manuscript drafts, and approved the final manuscript. HW developed the review protocol, developed and conducted the search, commented on the manuscript drafts, and approved the final version of the manuscript. BWang developed the review protocol, provided guidance on the conduct of the analyses and interpretation of the results, commented on the manuscript drafts, and approved the final manuscript version. CWang developed the review protocol, provided guidance on the conduct of the analyses and interpretation of the results, commented on manuscript drafts, and approved the final manuscript version. BWhite developed the review protocol, provided guidance on the conduct of the analyses and interpretation of the results, commented on manuscript drafts, and approved the final manuscript version. RL developed the review protocol, provided guidance on the conduct of the analyses and interpretation of the results, commented on manuscript drafts, and approved the final manuscript version. JS developed the review protocol, provided guidance for the interpretation of the results, commented on manuscript drafts, and approved the final manuscript version.

Financial support

Support for this project was provided by The Pew Charitable Trusts.

Conflict of interest

JS, CW, NS, CW, DH, JG, HW, and BWang have no conflicts to declare. AOC and ST have conducted prior reviews for Bayer Animal Health which may manufacture one or more of the products assessed. RL has conducted research or consulting for Zoetis Animal Health, Merck & Company, CEVA Biomune, Boehringer Ingelheim Vetmedica, and Merial Animal Health which may manufacture one or more of the products assessed. BW has conducted research or consulting for Bayer Animal Health, Boehringer Ingelheim, Elanco Animal Health, Merck Animal Health, Merial Animal Health, and Zoetis Animal Health which may manufacture one or more of the products assessed.

Publication declaration

The authors declare that this is a full and accurate description of the project and that no important information or analyses are omitted.

References

Abell, KM, Theurer, ME, Larson, RL, White, BJ and Apley, M (2017) A mixed treatment comparison meta-analysis of metaphylaxis treatments for bovine respiratory disease in beef cattle. Journal of Animal Science 95, 626635.Google ScholarPubMed
American Veterinary Medical Association (2017) AVMA definitions of antimicrobial use for treatment, control and prevention. Schaumburg, IL, USA. Available at https://www.avma.org/KB/Policies/Pages/AVMA-Definitions-of-Antimicrobial-Use-for-Treatment-Control-and-Prevention.aspx (Accessed 4 November 2019).Google Scholar
Amrine, D, White, B, Goehl, D, Sweiger, SH, Nosky, B and Tessman, RK (2014) Comparisons of metaphylactic treatments of Zactran® (gamithromycin) vs. Excede® (ceftiofur crystalline free acid) in high risk, stocker calves. International Journal of Applied Research in Veterinary Medicine 12, 221228.Google Scholar
Anholt, RM, Klima, C, Allan, N, Matheson-Bird, H, Schatz, C, Ajitkumar, P, Otto, SJ, Peters, D, Schmid, K, Olson, M, McAllister, T and Ralston, B (2017) Antimicrobial susceptibility of bacteria that cause bovine respiratory disease complex in Alberta, Canada. Frontiers in Veterinary Science 4, 207. Available at https://www.frontiersin.org/article/10.3389/fvets.2017.00207.CrossRefGoogle ScholarPubMed
Apley, M (2006) Bovine respiratory disease: pathogenesis, clinical signs, and treatment in lightweight calves. Veterinary Clinics of North America: Food Animal Practice 22, 399411.Google ScholarPubMed
Baggott, D, Casartelli, A, Fraisse, F, Manavella, C, Marteau, R, Rehbein, S, Wiedemann, M and Yoon, S (2011) Demonstration of the metaphylactic use of gamithromycin against bacterial pathogens associated with bovine respiratory disease in a multicentre farm trial. Veterinary Record 168, 241.CrossRefGoogle Scholar
Baptiste, KE and Kyvsgaard, NC (2017) Do antimicrobial mass medications work? A systematic review and meta-analysis of randomised clinical trials investigating antimicrobial prophylaxis or metaphylaxis against naturally occurring bovine respiratory disease. Pathogens and Disease 75. doi: 10.1093/femspd/ftx083CrossRefGoogle ScholarPubMed
Benton, JR, Erickson, GE, Klopfenstein, TJ, Luebbe, MK, Smith, DR, Sides, GE, and Bryant, L (2008) Effect of Excede® administered to calves at arrival in the feedlot on performance and respiratory disease. Nebraska Beef Cattle Reports 37, 99101.Google Scholar
Blasi, DA, Epp, MP and Derstein, R (2010) Feed-based metaphylaxis programs did not affect health or performance of high-risk calves mass medicated with Draxxin® on arrival. Kansas Agricultural Experiment Station Research Reports 0, 2628.Google Scholar
Booker, C, Schunicht, O, Guichon, P, Jim, G, Wildman, B, Pittman, T and Perrett, T (2006) An evaluation of the metaphylactic effect of ceftiofur crystalline free acid in feedlot calves. Veterinary Therapeutics 7, 257274.Google ScholarPubMed
Booker, CW, Abutarbush, SM, Schunicht, OC, Jim, G, Perrett, T, Wildman, BK, Guichon, TP, Pittman, TJ, Jones, C and Pollock, CM (2007) Evaluation of the efficacy of tulathromycin as a metaphylactic antimicrobial in feedlot calves. Veterinary Therapeutics 8, 183200.Google ScholarPubMed
Brazle, FK (1997) The effect of tilmicosin phosphate injection at arrival on newly purchased calves. Professional Animal Scientist 13, 141144.CrossRefGoogle Scholar
Breeze, RG, McManus, RF, Magonigle, RA, Olson, M, Tonkinson, L and Costerton, J (1982) Control of shipping fever in feedlot cattle with a long-acting oxytetracycline injectable. Bovine Practice 3, 3238.Google Scholar
Brown, JR, Faulkner, D and Cmarik, G (1989) The use of liquamycin LA-200 [oxytetracycline] in the prevention of the bovine respiratory complex. Agri-Practice 10, 1416.Google Scholar
Bryant, TC, Nichols, JR, Adams, JR, Farmer, TD and Miles, OG (2008) Effect of tilmicosin alone or in combination with Mannheimia haemolytica toxoid administered at initial feedlot processing on morbidity and mortality of high-risk calves. Bovine Practitioner 42, 5054.Google Scholar
CINeMA: Confidence in Network Meta-Analysis [Software] (2017). Available at http://cinema.ispm.ch.Google Scholar
Compiani, R, Baldi, G, Bonfanti, M, Fucci, D, Pisoni, G, Jottini, S and Torres, S (2014) Comparison of tildipirosin and tulathromycin for control of bovine respiratory disease in high-risk beef heifers. Bovine Practitioner 48, 114119.Google Scholar
Corbin, MJ, Gould, JA, Carter, BL, McClary, DG and Portillo, TA (2009) Effects and economic implications of metaphylactic treatment of feeder cattle with two different dosages of tilmicosin on the incidence of bovine respiratory disease (BRD) – a summary of two studies. Bovine Practitioner 43, 140152.Google Scholar
Crepieux, T, Miller, C, Regev-Shoshani, G, Schaefer, A, Dorin, C, Alexander, T and Timsit, E (2016) Randomized, non-inferiority trial comparing a nitric oxide releasing solution with a macrolide antibiotic for control of bovine respiratory disease in beef feedlot calves at high-risk of developing respiratory tract disease. Research in Veterinary Science 105, 216221.CrossRefGoogle ScholarPubMed
Cusack, PMV (2004) Effect of mass medication with antibiotics at feedlot entry on the health and growth rate of cattle destined for the Australian domestic market. Australian Veterinary Journal 82, 154156.CrossRefGoogle ScholarPubMed
DeDonder, K and Apley, M (2015) A literature review of antimicrobial resistance in pathogens associated with bovine respiratory disease. Animal Health Research Reviews 16, 125134.CrossRefGoogle ScholarPubMed
DeDonder, KD, Apley, MD, Li, M, Gehring, R, Harhay, DM, Lubbers, BV, White, BJ, Capik, SF, KuKanich, B, Riviere, JE and Tessman, RK (2016) Pharmacokinetics and pharmacodynamics of gamithromycin in pulmonary epithelial lining fluid in naturally occurring bovine respiratory disease in multisource commingled feedlot cattle. Journal of Veterinary Pharmacology & Therapeutics 39, 157166.CrossRefGoogle ScholarPubMed
Dias, S, Welton, N, Caldwell, D and Ades, A (2010) Checking consistency in mixed treatment comparison meta-analysis. Statistics in Medicine 29, 932944.CrossRefGoogle ScholarPubMed
Dias, S, Welton, NJ, Sutton, AJ and Ades, A (2011) NICE DSU technical support document 2: a generalised linear modelling framework for pairwise and network meta-analysis of randomised controlled trials. Available at https://research-information.bristol.ac.uk/files/7215331/TSD2_General_meta_analysis.final.08.05.12.pdf.Google Scholar
Duff, GC, Walker, DA, Malcolm-Callis, KJ, Wiseman, MW and Hallford, DM (2000) Effects of preshipping vs. arrival medication with tilmicosin phosphate and feeding chlortetracycline on health and performance of newly received beef cattle. Journal of Animal Science 78, 267274.CrossRefGoogle ScholarPubMed
European Union Commission (2015) Commission notice, Official Journal of the European Union, Guidelines for the prudent use of antimicrobials in veterinary medicine, (2015/C 299/04). Available at https://ec.europa.eu/health//sites/health/files/antimicrobial_resistance/docs/2015_prudent_use_guidelines_en.pdf (Accessed 4 November 2019).Google Scholar
Fazzio, LE, Giuliodori, MJ, Galvan, WR, Streitenberger, N and Landoni, MF (2015) A metaphylactic treatment with double dose oxytetracycline reduces the risk of bovine respiratory disease in feedlot calves. Revista Veterinaria 26, 8992.Google Scholar
Food and Drug Administration (2003) Freedom of Information Summary, Original New Animal Drug Application, NADA 141–209, Naxcel® XT sterile suspension (ceftiofur crystalline free acid sterile suspension). Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/729.Google Scholar
Food and Drug Administration (2018a) Freedom of Information Summary, Original New Animal Drug Application, NADA 141–244, Draxxin® Injectable Solution (tulathromycin), Approved May 2005. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/789.Google Scholar
Food and Drug Administration (2018b) Freedom of Information Summary, Original New Animal Drug Application, NADA 141–328, Zactran® gamithromycin Injectable Solution for beef and non-lactating dairy cattle, Approved June 2011. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/886.Google Scholar
Food and Drug Administration (2018c) Freedom of Information Summary, Original New Animal Drug Application, NADA 141–334, Zuprevo® tildipirosin 18% Injectable Solution for beef and non-lactating dairy cattle, Approved May 2012. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/892.Google Scholar
Food and Drug Administration (2018d) Freedom of Information Summary, Supplemental New Animal Drug Application, NADA 141–063, NUFLOR® Injectable Solution (florfenicol) for the control of respiratory disease in cattle at high risk of developing bovine respiratory disease (BRD) associated with Pasteurella haemolytica, Pasteurella multocida, and Haemophilus somnus, Approved December 1998. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/596.Google Scholar
Food and Drug Administration (2018e) Freedom of Information Summary, Supplemental New Animal Drug Application, NADA 141–068, Baytril® 100 enrofloxacin Injectable Solution for beef and non-lactating dairy cattle. Approved July 2012. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/607.Google Scholar
Food and Drug Administration (2018f) Freedom of Information Summary, Supplemental New Animal Drug Application, NADA 141–143, Tetradure 300® (oxytetracycline) injection 300 mg ml−1, Approved July 2003. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/658.Google Scholar
Food and Drug Administration (2018g) Freedom of Information Summary, Supplemental New Animal Drug Application, NADA 141–207, Advocin® Sterile Injectable Solution Danofloxacin Injection for beef cattle, Approved July, 2014. Available at https://animaldrugsatfda.fda.gov/adafda/app/search/public/document/downloadFoi/727.Google Scholar
Frank, GH and Duff, GC (2000) Effects of tilmicosin phosphate, administered prior to transport or at time of arrival, and feeding of chlortetracycline, after arrival in a feedlot, on Mannheimia haemolytica in nasal secretions of transported steers. American Journal of Veterinary Research 61, 14791483.CrossRefGoogle ScholarPubMed
Galyean, ML, Gunter, SA and Malcolm-Callis, KJ (1995) Effects of arrival medication with tilmicosin phosphate on health and performance of newly received beef cattle. Journal of Animal Science 73, 12191226.CrossRefGoogle ScholarPubMed
Gill, DR, Smith, RA, Hicks, RB and Ball, RL (1986) The effect of mass medication on health and performance of newly arrived stocker cattle. Animal Science Research Report Miscellaneous Publication, Oklahoma Agricultural Experiment Station 118, 260268.Google Scholar
Glynn, HF, Robert, EB, Glenn, CD, Raymond, WL and Charles, WP (2002) Effects of vaccination prior to transit and administration of florfenicol at time of arrival in a feedlot on the health of transported calves and detection of Mannheimia haemolytica in nasal secretions. American Journal of Veterinary Research 63, 251256.Google Scholar
Gonzalez-Martin, JV, Elvira, L, Lopez, MC, Villalobos, NP, Lopez-Guerrero, EC and Astiz, S (2011) Reducing antibiotic use: selective metaphylaxis with florfenicol in commercial feedlots. Livestock Science 141, 173181.CrossRefGoogle Scholar
Gotelli, N and Entsminger, G (2001) Ecosim: null models software for ecology. Available at http://www.uvm.edu/ ngotelli/EcoSim/EcoSim.html.Google Scholar
Guichon, PT, Booker, CW and Jim, GK (1993) Comparison of two formulations of oxytetracycline given prophylactically to reduce the incidence of bovine respiratory disease in feedlot calves. Canadian Veterinary Journal 34, 736741.Google ScholarPubMed
Guthrie, CA, Rogers, KC, Christmas, RA, Vogel, GJ, Laudert, SB and Mechor, GD (2004) Efficacy of metaphylactic tilmicosin for controlling bovine respiratory disease in high-risk northern feeder calves. Bovine Practitioner 38, 4653.Google Scholar
Hanzlicek, GA, Blasi, DA, Oleen, BE and Anderson, GA (2016) A randomized field study comparing differences in core body temperature, health, and performance in crossbred beef heifers administered 2 antimicrobial products given upon arrival at a stocker facility. Professional Animal Scientist 32, 438444.CrossRefGoogle Scholar
Harland, RJ, Jim, GK, Guichon, PT, Townsend, HG and Janzen, ED (1991) Efficacy of parenteral antibiotics for disease prophylaxis in feedlot calves. Canadian Veterinary Journal 32, 163168.Google ScholarPubMed
Hawley, J, Powell, JG, Kegley, EB and Beck, PA (2016) Comparison of ceftiofur crystalline free acid to tilmicosin for metaphylactic treatment of calves at risk for bovine respiratory disease. Bovine Practitioner 50, 3339.Google Scholar
Hendrick, SH, Bateman, KG and Rosengren, LB (2013) The effect of antimicrobial treatment and preventive strategies on bovine respiratory disease and genetic relatedness and antimicrobial resistance of Mycoplasma bovis isolates in a western Canadian feedlot. Canadian Veterinary Journal 54, 11461156.Google Scholar
Hibbard, B, Robb, EJ, Chester, ST, Dame, KJ, Moseley, WW and Bryson, WL (2002) Dose determination and confirmation for ceftiofur crystalline-free acid administered in the posterior aspect of the ear for control and treatment of bovine respiratory disease. Veterinary Therapeutics 3, 2230.Google ScholarPubMed
Higgins, J and Whitehead, A (1996) Borrowing strength from external trials in a meta-analysis. Statistics in Medicine 15, 27332749.3.0.CO;2-0>CrossRefGoogle ScholarPubMed
Higgins, J, Sterne, J, Savović, J, Page, M, Hróbjartsson, A, Boutron, I, Reeves, B, Eldridge, S (2016) A revised tool for assessing risk of bias in randomized trials. In Cochrane Methods, Cochrane Database of Systematic Reviews, Issue 10 (Suppl 1). 10.1002/14651858.CD201601.Google Scholar
Hu, D, Wang, C and O'Connor, AM (2019) A method of back-calculating the log odds ratio and standard error of the log odds ratio from the reported group-level risk of disease. bioRxiv. Available at https://www.biorxiv.org/content/early/2019/09/06/760942.Google Scholar
Hutton, B, Salanti, G, Caldwell, DM, Chaimani, A, Schmid, CH, Cameron, C, Ioannidis, JP, Straus, S, Thorlund, K, Jansen, JP, Mulrow, C, Catala-Lopez, F, Gotzsche, PC, Dickersin, K, Boutron, I, Altman, DG and Moher, D (2015) The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Annals of Internal Medicine 162, 777784.CrossRefGoogle ScholarPubMed
Jackson, D, White, IR, Price, M, Copas, J and Riley, RD (2017) Borrowing of strength and study weights in multivariate and network meta-analysis. Statistical Methods in Medical Research 26, 28532868.CrossRefGoogle ScholarPubMed
Janzen, ED and McManus, RF (1980) Observations on the use of a long-acting oxytetracycline for in-contact prophylaxis of undifferentiated bovine respiratory disease in feedlot steers under Canadian conditions. Bovine Practitioner 15, 8790.Google Scholar
John, CJ, Bryson, WL, Sam, B and Breck, DH (2008) Evaluation of on-arrival versus prompted metaphylaxis regimes using ceftiofur crystalline free acid for feedlot heifers at risk of developing bovine respiratory disease. Veterinary Therapeutics 9, 5362.Google Scholar
Kilgore, WR, Spensley, MS, Sun, FS, Nutsch, RG, Rooney, KA and Skogerboe, TL (2005) Clinical effectiveness of tulathromycin, a novel triamilide antimicrobial, for the control of respiratory disease in cattle at high risk for developing bovine respiratory disease. Veterinary Therapeutics 6, 136142.Google ScholarPubMed
Landers, TF, Cohen, B, Wittum, TE and Larson, EL (2012) A review of antibiotic use in food animals: perspective, policy, and potential. Public Health Reports (Washington, D.C. 1974) 127, 422.CrossRefGoogle ScholarPubMed
Lin, L, Xing, A, Kofler, MJ and Murad, MH (2019) Borrowing of strength from indirect evidence in 40 network meta-analyses. Journal of Clinical Epidemiology 106, 4149.CrossRefGoogle ScholarPubMed
Lofgreen, GP, Addis, DG, Dunbar, JR and Clark, JG (1978) Time of processing calves subjected to marketing and shipping stress. Journal of Animal Science 47, 13241328. Available at http://dx.doi.org/10.2527/jas1978.4761324x.CrossRefGoogle Scholar
Lu, G and Ades, A (2004) Combination of direct and indirect evidence in mixed treatment comparisons. Statistics in Medicine 23, 31053124.CrossRefGoogle ScholarPubMed
Magstadt, DR, Schuler, AM, Coetzee, JF, Krull, AC, O'Connor, AM, Cooper, VL and Engelken, TJ (2018) Treatment history and antimicrobial susceptibility results for Mannheimia haemolytica, Pasteurella multocida, and Histophilus somni isolates from bovine respiratory disease cases submitted to the Iowa state university veterinary diagnostic laboratory from 2013 to 2015. Journal of Veterinary Diagnostic Investigation 30, 99104. Available at https://doi.org/10.1177/1040638717737589.CrossRefGoogle ScholarPubMed
Martin, GJV, Partida, EL, Villalobos, PN, Lopez, CM, Lopez-Guerrero, CE and Blanco, AS (2007) Evaluation of mass and selective metaphylaxis medication with florfenicol at feedlot entry as a tool against bovine respiratory disease under commercial conditions in Spain. Cattle Practice 15, 309311.Google Scholar
Martin, MJ, Thottathil, SE and Newman, TB (2015) Antibiotics overuse in animal agriculture: a call to action for health care providers. American Journal of Public Health 105, 24092410.CrossRefGoogle Scholar
McClary, D and Vogel, G (1999) Effect of timing of tilmicosin metaphylaxis on control of bovine respiratory disease and performance in feeder cattle. Bovine Practitioner 33, 155161.Google Scholar
Meeuwse, DM and Hibbard, B (2002) ExcedeTM vs. Micotil® for control of bovine respiratory disease using a post-metaphylaxis interval. Pfizer Animal Health Technical Bulletin, Zoetis US. Available at https://www.zoetisus.com/products/beef/excede/tools-resources.aspx.Google Scholar
Miles, DG (2009) Overview of the North American beef cattle industry and the incidence of bovine respiratory disease (brd). Animal Health Research Reviews 10, 101103.CrossRefGoogle Scholar
Miller, TJ, Hubbert, ME, Reinhardt, CD, Loest, CA, Schwandt, EF and Thomson, DU (2016) Comparison of tulathromycin, tilmicosin, and gamithromycin for metaphylactic treatment of high-risk calves for control of bovine respiratory disease. Bovine Practitioner 50, 175179.Google Scholar
Montague, MR, Smith, SC and Gill, DR (1996) Effects of using Micotil 300, Liquamycin 200 or Terramycin as mass medication on receiving stocker cattle. Animal Science Research Report – Agricultural Experiment Station, Oklahoma State University P-951, 231234.Google Scholar
Montgomery, SP, Sindt, JJ, Greenquist, MA, Loe, ER and Drouillard, JS (2008) Comparison of bovine transfer factor and tilmicosin phosphate: effects on health and growth performance of newly arrived feedlot heifers. International Journal of Applied Research in Veterinary Medicine 6, 175180.Google Scholar
Morck, DW, Merrill, JK, Thorlakson, BE, Olson, ME, Tonkinson, LV and Costerton, JW (1993) Prophylactic efficacy of tilmicosin for bovine respiratory tract disease. Journal of the American Veterinary Medical Association 202, 273277.Google ScholarPubMed
Nickell, JS, White, BJ, Larson, RL, Blasi, DA and Renter, DG (2008) Comparison of short-term health and performance effects related to prophylactic administration of tulathromycin versus tilmicosin in long-hauled, highly stressed beef stocker calves. Veterinary Therapeutics 9, 147156.Google ScholarPubMed
O'Connor, AM, Coetzee, JF, da Silva, N and Wang, C (2013) A mixed treatment comparison meta-analysis of antibiotic treatments for bovine respiratory disease. Preventive Veterinary Medicine 110, 7787.CrossRefGoogle ScholarPubMed
O'Connor, AM, Yuan, C, Cullen, JN, Coetzee, JF, da Silva, N and Wang, C (2016) A mixed treatment meta-analysis of antibiotic treatment options for bovine respiratory disease – an update. Preventive Veterinary Medicine 132, 130139.CrossRefGoogle ScholarPubMed
Papakonstantinou, T, Nikolakopoulou, A, Rucker, G, Chaimani, A, Schwarzer, G, Egger, M and Salanti, G (2018) Estimating the contribution of studies in network meta-analysis: paths, flows and streams. F1000Research 7, 610.CrossRefGoogle ScholarPubMed
Plummer, M. (2015) Rjags: Bayesian Graphical Models using MCMC. R package version 3-15. Available at http://CRAN.R-project.org/package=rjags.Google Scholar
R Core Team (2015) R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing, Available at https://www.R-project.org/.Google Scholar
Reece, T. R. and Smith, R. A. (1996) Evaluation of metaphylactic medication in a backrounding operation. Animal Science Research Report – Agricultural Experiment Station, Oklahoma State University P-951, 241244.Google Scholar
Regev-Shoshani, G, McMullin, B, Nation, N, Church, JS, Dorin, C and Miller, C (2017) Non-inferiority of nitric oxide releasing intranasal spray compared to sub-therapeutic antibiotics to reduce incidence of undifferentiated fever and bovine respiratory disease complex in low to moderate risk beef cattle arriving at a commercial feedlot. Preventive Veterinary Medicine 138, 162169.CrossRefGoogle Scholar
Rooney, KA, Nutsch, RG, Skogerboe, TL, Weigel, DJ, Gajewski, K and Kilgore, R (2005) Efficacy of tulathromycin compared with tilmicosin and florfenicol for the control of respiratory disease in cattle at high risk of developing bovine respiratory disease. Veterinary Therapeutics 6, 154166.Google ScholarPubMed
Rossi, CAS, Vandoni, SL, Bonfanti, M and Forbes, AB (2010) Effects of arrival medication with gamithromycin on bovine respiratory disease in feedlot cattle in Italy. International Journal of Applied Research in Veterinary Medicine 8, 8796.Google Scholar
Salanti, G, Kavvoura, FK and Ioannidis, JP (2008) Exploring the geometry of treatment networks. Annals of Internal Medicine 148, 544553.CrossRefGoogle ScholarPubMed
Salanti, G, Del Giovane, C, Chaimani, A, Caldwell, DM and Higgins, JPT (2014). Evaluating the quality of evidence from a network meta-analysis. PLoS ONE 9, 114. Available at https://doi.org/10.1371/journal.pone.0099682.CrossRefGoogle ScholarPubMed
Sargeant, JM, Elgie, R, Valcour, J, Saint-Onge, J, Thompson, A, Marcynuk, P and Snedeker, K (2009) Methodological quality and completeness of reporting in clinical trials conducted in livestock species. Preventive Veterinary Medicine 91, 107115.CrossRefGoogle ScholarPubMed
Schipper, IA and Kelling, CL (1971) Shipping fever prophylaxis: comparison of vaccine and antibiotics administered following weaning. Canadian Veterinary Journal 12, 172175.Google ScholarPubMed
Schipper, IA and Kelling, CL (1974) Prophylactic use of antibiotics in preventing bovine respiratory disease complex. Veterinary Medicine, Small Animal Clinician 69, 1396, 8–401.Google ScholarPubMed
Schumann, FJ, Janzen, ED and McKinnon, JJ (1990) Prophylactic tilmicosin medication of feedlot calves at arrival. Canadian Veterinary Journal 31, 285288.Google ScholarPubMed
Schumann, FJ, Janzen, ED and McKinnon, JJ (1991) Prophylactic medication of feedlot calves with tilmicosin. Veterinary Record 128, 278280.CrossRefGoogle ScholarPubMed
Schunich, OC, Guichon, PT, Booker, CW, Jim, GK, Wildman, BK, Hill, BW, Ward, TI, Bauck, SW and Jacobsen, JA (2002) A comparison of prophylactic efficacy of tilmicosin and a new formulation of oxytetracycline in feedlot calves. Canadian Veterinary Journal 43, 355362.Google Scholar
Siddartha, T, Thomson, DU, Bello, NM, Nosky, BJ and Reinhardt, CD (2013) Field study of the comparative efficacy of gamithromycin and tulathromycin for the control of undifferentiated bovine respiratory disease complex in beef feedlot calves at high risk of developing respiratory tract disease. American Journal of Veterinary Research 74, 839846.Google Scholar
Stegner, JE, Lucas, MJ, McLaughlin, CL, Davis, MS, Alaniz, GR, Weigel, DJ, Pollreisz, JH, Tucker, CM, Koers, WC, Turgeon, OA and Szasz, JI (2013) Comparative effects of therapeutic programs on bovine respiratory disease, performance, carcass, and profitability of high-risk feedlot heifers. Professional Animal Scientist 29, 208218.CrossRefGoogle Scholar
Step, DL, Engelken, T, Romano, C, Holland, B, Krehbiel, C, Johnson, JC, Lawrence, BW, Tucker, CM and Robb, EJ (2007) Evaluation of three antimicrobial regimens used as metaphylaxis in stocker calves at high risk of developing bovine respiratory disease. Veterinary Therapeutics 8, 136147.Google ScholarPubMed
Stokka, G and Kreikemeier, K (1996) Influence of delayed processing and mass medication with either chlortetracycline (CTC) or tilmicosin phosphate (Micotil) on health and growth of highly stressed calves. Kansas State University Cattle Feeders Day Progress Report 773, 2327.Google Scholar
Sturgess, KL and Renter, DG (2017) Comparison of tulathromycin, tildipirosin, and tilmicosin for control of bovine respiratory disease in steers purchased from auction markets and fed in a Texas feedlot. Bovine Practitioner 51, 1724.Google Scholar
Taylor, JD, Fulton, RW, Lehenbauer, TW, Step, DL and Confer, AW (2010) The epidemiology of bovine respiratory disease: what is the evidence for predisposing factors? Canadian Veterinary Journal 51, 10951102.Google ScholarPubMed
Tennant, TC, Ives, SE, Harper, LB, Renter, DG and Lawrence, TE (2014) Comparison of tulathromycin and tilmicosin on the prevalence and severity of bovine respiratory disease in feedlot cattle in association with feedlot performance, carcass characteristics, and economic factors. Journal of Animal Science 92, 52035213.CrossRefGoogle ScholarPubMed
Timsit, E, Dendukuri, N, Schiller, I and Buczinski, S (2016) Diagnostic accuracy of clinical illness for bovine respiratory disease (brd) diagnosis in beef cattle placed in feedlots: a systematic literature review and hierarchical Bayesian latent-class meta-analysis. Preventive Veterinary Medicine 135, 6773.CrossRefGoogle ScholarPubMed
Timsit, E, Hallewell, J, Booker, C, Tison, N, Amat, S and Alexander, TW (2017a) Prevalence and antimicrobial susceptibility of Mannheimia haemolytica, Pasteurella multocida, and Histophilus somni isolated from the lower respiratory tract of healthy feedlot cattle and those diagnosed with bovine respiratory disease. Veterinary Microbiology 208, 118125.CrossRefGoogle Scholar
Timsit, E, Workentine, M, Crepieux, T, Miller, C, Regev-Shoshani, G, Schaefer, A and Alexander, T (2017b) Effects of nasal instillation of a nitric oxide-releasing solution or parenteral administration of tilmicosin on the nasopharyngeal microbiota of beef feedlot cattle at high-risk of developing respiratory tract disease. Research in Veterinary Science 115, 117124.CrossRefGoogle Scholar
United States Department of Agriculture Animal and Plant Health Inspection Service Veterinary Services Centers for Epidemiology and Animal Health (2013) Vaccine usage in U.S. feedlots, Report. Available at https://www.aphis.usda.gov/animal_health/nahms/feedlot/downloads/feedlot2011/Feed11_is_VaccineUsage.pdf.Google Scholar
United States Department of Agriculture Animal and Plant Health Inspection Service Veterinary Services National Animal Health Monitoring System (2019) Antimicrobial Use and Stewardship on U.S. Feedlots, 2017, Report. Available at https://www.aphis.usda.gov/aphis/ourfocus/animalhealth/monitoring-and-surveillance/nahms/antimicrobial_use_2017.Google Scholar
van Donkersgoed, J, Merrill, J and Hendrick, S (2008) Comparative efficacy of tilmicosin versus tulathromycin as a metaphylactic antimicrobial in feedlot calves at moderate risk for respiratory disease. Veterinary Therapeutics 9, 291297.Google ScholarPubMed
van Donkersgoed, J, Hendrick, S and Nickel, T (2017) Comparison of gamithromycin and tildipirosin for metaphylaxis treatment of winter-placed feedlot calves for control of bovine respiratory disease. Bovine Practitioner 51, 184189.Google Scholar
van Donkersgoed, J and Merrill, JK (2012) A comparison of tilmicosin to gamithromycin for on arrival treatment of bovine respiratory disease in feeder steers. Bovine Practitioner 46, 4651.Google Scholar
van Donkersgoed, J and Merrill, JK (2013a) Efficacy of tilmicosin and tildipirosin for on-arrival treatment of bovine respiratory disease in fall-placed feedlot calves in western Canada. Bovine Practitioner 47, 146151.Google Scholar
van Donkersgoed, J and Merrill, JK (2013b) Efficacy of tilmicosin for on-arrival treatment of bovine respiratory disease in backgrounded winter-placed feedlot calves. Bovine Practitioner 47, 712.Google Scholar
van Koevering, MT, Gill, DR, Smith, RA, Hill, WJ and Ball, RL (1992) Mass medication treatments for newly arrived stocker cattle. Animal Science Research Report, Agricultural Experiment Station, Oklahoma State University MP-136, 333338.Google Scholar
Viechtbauer, W (2010) Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36, 148. Available at http://www.jstatsoft.org/v36/i03/.CrossRefGoogle Scholar
Vogel, GJ, Laudert, SB, Zimmermann, A, Guthrie, CA, Mechor, GD and Moore, GM (1998) Effects of tilmicosin on acute undifferentiated respiratory tract disease in newly arrived feedlot cattle. Journal of the American Veterinary Medical Association 212, 19191924.Google ScholarPubMed
Wellman, NG and O'Connor, AM (2007) Meta-analysis of treatment of cattle with bovine respiratory disease with tulathromycin. Journal of Veterinary Pharmacology and Therapeutics 30, 234241.CrossRefGoogle ScholarPubMed
White, BJ and Renter, DG (2009) Bayesian estimation of the performance of using clinical observations and harvest lung lesions for diagnosing bovine respiratory disease in post-weaned beef calves. Journal of Veterinary Diagnostic Investigation 21, 446453.CrossRefGoogle ScholarPubMed
White, BJ, Amrine, DE and Goehl, DR (2015) Determination of value of bovine respiratory disease control using a remote early disease identification system compared with conventional methods of metaphylaxis and visual observations. Journal of Animal Science 93, 41154122.CrossRefGoogle ScholarPubMed
White House Forum Spotlights Antibiotic Overuse in Medicine and Food Production (2015) American Family Physician 92, 82.Google Scholar
Figure 0

Table 1. Antibiotic regimens extracted from studies identified by the systematic review

Figure 1

Fig. 1. Flowchart describing the flow of literature through the review.

Figure 2

Fig. 2. The network of treatment arms used in the mixed-treatment comparisons meta-analysis. The size of the dot is a relative indicator of the number of arms, and the width of the lines is a relative indicator of the number of direct comparisons. Abbreviations defined in Table 1.

Figure 3

Fig. 3. Ranking plot of relevant treatments. Lower rankings indicate lower incidence of BRD. Rankings are reported for label-dose regimens only. Abbreviations are defined in Table 1.

Figure 4

Table 2. Mean ranking by treatment efficacy of antibiotic regimens based on the mixed-treatment comparisons meta-analysis

Figure 5

Table 3. Results of the indirect comparison for the consistency assumption

Figure 6

Fig. 4. The contributions to the point estimate of efficacy by studies using different allocation approaches: green indicates studies that provided evidence of random allocation; yellow indicates studies that reported random allocation but provided no supporting evidence; red indicates studies that reported no allocation approach or reported a non-random allocation approach. White vertical lines indicate the percentage contribution of separate studies. Each bar shows the percentage contribution from studies judged to be at low (green), moderate (yellow), and high (red) risk of bias.

Figure 7

Fig. 5. The contributions to the point estimate of efficacy by studies using different blinding approaches: green indicates studies that provided evidence of blinding of caregivers and outcome assessors; yellow indicates studies that provided evidence of blinding of either caregivers or outcome assessors; red indicates studies that reported no blinding of caregivers or outcome assessors. White vertical lines indicate the percentage contribution of separate studies. Each bar shows the percentage contribution from studies judged to be at low (green), moderate (yellow), and high (red) risk of bias.

Figure 8

Table 4. Risk ratio of all possible pairwise comparisons within the evidence network for injectable on-label antibiotic regimes

Supplementary material: PDF

O'Connor et al. supplementary material

O'Connor et al. supplementary material

Download O'Connor et al. supplementary material(PDF)
PDF 255.2 KB