Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-22T22:04:17.809Z Has data issue: false hasContentIssue false

Standardized Sensitivity Analysis in BCA: An Education Case Study

Published online by Cambridge University Press:  06 March 2019

Elina Pradhan*
Affiliation:
The World Bank Group, Health, Nutrition and Population Global Practice, Washington, DC 20433, USA, e-mail: [email protected]
Dean T. Jamison
Affiliation:
University of California, San Francisco, CA 94143, USA, e-mail: [email protected]
*
Rights & Permissions [Opens in a new window]

Abstract

Benefit-cost analyses of education policies in low- and middle-income countries have historically used the effect of education on future wages to estimate benefits. Strong evidence also points to female education reducing both the under-five mortality rates of their children and adult mortality rates. A more complete analysis would thus add the value of mortality risk reduction to wage increases. This paper estimates how net benefits and benefit-cost ratios respond to the values used to estimate education’s mortality-reducing impact including variation in these estimates. We utilize a ‘standardized sensitivity analysis’ to generate a range of valuations of education’s impact on mortality risks. We include alternative ways of adjusting these values for income and age differences. Our analysis is for one additional year of schooling in lower-middle-income countries, incremental to the current mean. Our analysis shows a range of benefit-cost ratios ranging from 3.2 to 6.7, and net benefits ranging from $2,800 to $7,300 per student. Benefits from mortality risk reductions account for 40% to 70% of the overall benefits depending on the scenario. Thus, accounting for changes in mortality risks in addition to wage increases noticeably enhances the value of already attractive education investments.

Type
Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© Society for Benefit-Cost Analysis 2019

1 Introduction

In 2016 the International Commission on Financing Global Education Opportunity published its report, The Learning Generation: Investing in Education for a Changing World (The International Commission on Financing Global Education Opportunity, 2016). The Commission, chaired by former UK Prime Minister Gordon Brown, utilized benefit-cost analyses (BCAs) to underpin its conclusion that a major acceleration of education is now warranted. Standard BCA methods were used to show large incremental benefits as compared to incremental costs, weighing costs of schooling, including opportunity costs of student time, against estimates of health benefits and education-related wage gain over the individual’s working lifetime (Psacharopoulos et al., Reference Psacharopoulos, Montenegro and Patrinos2017).

The Commission pointed to a diverse and substantial literature relating higher levels of education to lower levels of premature mortality, and to improved health more generally (Filmer & Pritchett, Reference Filmer and Pritchett1999; Gakidou et al., Reference Gakidou, Cowling, Lozano and Murray2010; Baird et al., Reference Baird, Garfein, McIntosh and Özler2012; Kuruvilla et al., Reference Kuruvilla, Schweitzer, Bishai, Chowdhury, Caramani, Frost and Cortez2014; Wang et al., Reference Wang, Winner, Burgert and Colston2014; Jamison et al., Reference Jamison, Murphy and Sandbu2016). The Commission requested that a team (assembled by SEEK Development in Berlin) utilize this literature to extend standard approaches to BCA in education to include explicit valuation of reasonable estimates of the impact of education on mortality. The Commission then featured the results of that assessment in the executive summary of their report. Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) report those findings – and the methods on which they are based – in detail.

A notable difficulty facing the Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) team concerned how to value small changes in mortality risk using monetary measures (derived from the revealed or stated preferences of individuals and conventionally reported as the value per statistical life, VSL). By now, a substantial empirical literature reports findings from different approaches to estimate monetary value of mortality risk reductions in low- and middle-income countries (Narain & Sall, Reference Narain and Sall2016; Viscusi & Masterman, Reference Viscusi and Masterman2017a ,Reference Viscusi and Masterman b ). That said, huge variation remains in how one might plausibly apply existing results in a broad range of contexts, particularly in low-income or high-mortality environments. The Pradhan et al. study selected reasonable values of parameters from the literature, but other analysts could have plausibly chosen different parameters. This indeterminateness limits the utility of most BCAs for two reasons:

  1. (i) It can be hard to judge how sensitive the study’s findings are to parameters chosen; and

  2. (ii) Individual BCA results cannot be easily compared across sectors and over time to generate a solid corpus of comparable findings. (This problem applies equally to the valuation of mortality risk reductions when assessing the economic burden of diseases or risk factors.)

Analysts from several governmental and international organizations and researchers have proposed varying approaches for increasing standardization. Chang et al. (Reference Chang, Horton and Jamison2018) provide a brief account of some options that have been considered. The Bill & Melinda Gates Foundation has funded development of a BCA reference case (Robinson et al., Reference Robinson, Hammitt, Jamison and Walker2019a ) to address these problems in a way broadly consistent with a cost-effectiveness reference case that the Gates Foundation had previously funded (Wilkinson et al., Reference Wilkinson, Sculpher, Claxton, Revill, Briggs, Cairns and Teerawattananon2016). This education case study was prepared to support and illustrate the development of the BCA reference case.

One suggested approach to improving credibility and comparability was that of developing a ‘standardized sensitivity analysis’ (SSA) to be reported routinely within BCAs. The analyst might choose to highlight a particular value from the SSA as the best estimate in the analysis undertaken. Or, for any of a variety of reasons, the analyst might choose to headline a different approach but to undertake the SSA as well. The SSA would both enable judgement on the robustness of the findings of the analysis and enable comparison of those findings with an accumulating literature. The value of developing a reference case lies in enabling this comparability.

Our purpose in this case study is to illustrate how SSAs might reasonably be done. The analysis assesses the costs and benefits of education investments in lower-middle-income countries (LMCs)Footnote 1 from a perspective where we estimate the economic returns to education from the value of reductions in under-five and adult mortality risks in addition to any increases in earnings. We develop a case study that starts with the Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) findings, but then reanalyse those findings using estimates of the value of mortality risk reduction that vary by income and age. An important output from Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) was assessment of the benefits of quality of education as well as years of schooling. Not surprisingly, quality proves important. For simplicity, this paper illustrates the results of the SSA using only the estimated effects of years of schooling on mortality risks.

Before proceeding to the main body of the paper, we discuss how the purposes of a BCA affect the way(s) it might most usefully be reported. Perhaps the most important and typical use of BCA is to assist with determinations of how (and whether) specific major projects or regulations should be undertaken. The present value of the net benefits (PVNBs) of options considered provides the key input to decision makers, and its calculation and reporting is a central task for the analyst.

Less often – but still importantly – the BCA’s purpose is to contribute to an evolving literature about what works (and what does not) and in general to convey how attractive certain classes of investments tend to be. The analysis reported in this paper falls squarely in this latter, evaluative category. The intention is to add to a literature that provides conclusions relevant to a broad range of contexts. Benefit-cost ratios (BCRs) can be understood as relevant to many scales and contexts thereby providing useful (if only broad brush) policy guidance. Both PVNB and the BCR require an exogenously-given discounting procedure and may be (usually are) quite sensitive to choice of procedure as we shall see later in this paper.

The economics of education literature borrows from the finance literature in generally reporting the results of its BCAs as internal rates of return (IRRs). The IRR is that value of a constant discount rate that solves the equation equilibrating the time streams of benefits and costs. (A problem is that this equation may have multiple solutions although this does not appear to be a problem in practice in the education literature.) An advantage is that the discount rate is an output from rather than an input to the IRR and, like the BCR, it shows relative attractiveness independent of scale enabling comparison of economic attractiveness across studies. However, like the BCR but unlike PVNB, the IRR gives no indication of absolute attractiveness.

A standardized sensitivity analysis serves the purpose of accumulating knowledge across studies. Hence in this paper we explore the SSA by way of BCRs and – since the topic is education (and we seek to relate to that literature) – we also report IRRs as well as PVNB.

The case study proceeds as follows. The next section describes our approach to the SSA. Following the SSA methods section, section C describes the BCA undertaken for the Brown Commission (Pradhan et al., Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018); in particular the analysis estimating BCR, PVNB and IRR in LMCs for one year of schooling incremental to the current mean of 7 years. Section D presents results of the SSA, and section E discusses the findings and study limitations.

2 Methods

Our methods begin with those standard in the economics of education literature which construct time streams over individual lifetimes of education costs and benefits, where benefits are the estimated earnings increases associated with the increment in education being considered (here one-year incremental to 7 years). We add to that the estimated value of mortality reduction in the cohort associated with that one-year increment in education. The methods discussion that follows concerns how we translate an estimated reduction in numbers of deaths into a dollar benefit. The short answer is to multiply the number of deaths estimated to be averted by the ‘value of a statistical life’ or VSL. Operationalizing that short answer in the current context is the subject of the next few pages.

We vary the value of mortality risk reductions on income and age dimensions. The first dimension is concerned with how the analysis treats variation across country income levels, based on how the ratio of the value of a unit of mortality risk reduction to gross national income (GNI) per capita (purchasing power parity (PPP) adjusted) varies with income. We report our SSA using three alternatives recommended by Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ) – (i) the ratio of VSL-to-GNI per capita remains constant at 160, using U.S. values as a starting point and an income elasticity of 1.0; (ii) the ratio of VSL-to-GNI per capita remains constant at 100, using OECD values as the starting point and an income elasticity of 1.0; and (iii) the ratio of VSL-to-GNI per capita has an income elasticity of 1.5, using the U.S. ratio of 160 as a starting point.

The first two income variants are included to facilitate comparisons with existing research that uses these alternative approaches. The third option, whichRobinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ) propose as the featured variant, reflects the expectation that the VSL-to-GNI per capita ratio will be smaller in LMCs than in a high-income country (the United States in this case), given the need to preserve more limited income for essential expenditures. These three variants demonstrate uncertainties in the VSL estimates, given that few empirical studies have been conducted in LMCs.

Application of the first two variants is straightforward. For the third variant, we calculate the ratio of VSL-to-GNI per capita starting with the formula from Hammitt and Robinson (Reference Hammitt and Robinson2011): $\mathit{VSL}=\mathit{VSL}_{r}\times (\frac{\mathit{GNI\, per\, capita}}{\mathit{GNI\, per\, capita }_{r}})^{\mathit{elasticity}}$ , where $\mathit{VSL}_{r}$ is the recommended reference value, in this case from the United States.

We reformulate this as the VSL-to-GNI per capita ratio (VSLR) $=$ VSL/GNI per capita where,

(1) $$\begin{eqnarray}\displaystyle \hspace{-7.0pt}\left(\frac{\mathit{VSL}_{\mathit{LMCs}}}{\mathit{GNI\, per\, capita}_{\mathit{LMCs}}}\right)=\left(\frac{\mathit{VSL}_{US}}{\mathit{GNI\, per\, capita}_{US}}\right)\times \left(\frac{\mathit{GNI\, per\, capita}_{LMCs}}{\mathit{GNI\, per\, capita}_{US}}\right)^{\mathit{elasticity}-1}\!. & & \displaystyle\end{eqnarray}$$

Here, $\mathit{GNI\,per\,capita}_{US}=$ 57\text{,}900$ , $\mathit{GNI\,per\,capita}_{\mathit{LMCs}}=$ 6\text{,}430,\mathit{VSL}_{\mathit{US}}=160\times $ 57\text{,}900$ , and elasticity  $=$  1.5.

Therefore, $\mathit{VSLR}_{\mathit{LMCs}}=54$ .

The second dimension is concerned with how the analysis values mortality risk reductions at different ages, and we select the two alternative approaches discussed in Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ): (i) the value does not vary with age; and (ii) the value is proportional to remaining life expectancy. The second age variant suggests estimating a constant value per statistical life year (VSLY) based on each of the population-average VSLs estimated using the approaches referenced above. The VSL is divided by undiscounted remaining life expectancy at midpoint of the approximate life expectancy at birth for the region of interest (age 35 in this case). The resulting VSLY is then multiplied by change in the future life expectancy of the population affected. Note that in the first scenario where the VSL does not vary with age, VSL is a population-average estimate that is applied to all beneficiaries of the intervention. The empirical research upon which these estimates are based relies largely on samples of working-age adults. Whether these values are appropriate for younger or older populations is uncertain (Hammitt, Reference Hammitt2007) even in high-income countries; little is known about the relationship of the VSL to age or life expectancy in LMCs. As Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ) note, although not robustly supported by available research, the second age variant of assuming a constant VSLY provides a rough proxy for the effects of age and life expectancy.

Table 1 summarizes these approaches, including three income variants combined with two age variants.

Table 1 The six outputs of a Standardized Sensitivity Analysis for LMCs a .

a Our case study is for LMCs as a group. Their per capita GNI in 2015 was $6,430 in PPP (current international $) (WDI 2017). With the income per capita of the case study region, we can fill in the relevant values of column 1 of Table 1 (since values in column 1 are independent of the age distribution of mortality changes). The outputs are the value of the benefits of the intervention as specified in (2) below. The SSA scenarios are based on recommendations from Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ).

b $L(a)$ is life expectancy at age a, and L(35) is remaining life expectancy at midpoint of the approximate life expectancy at birth for LMCs (age 35 in this case).

In addition to the SSA comparisons above, we perform a sensitivity analysis across discount rates, and for SSA scenario (3,1), we evaluate the sensitivity of the BCA estimates across a wider range of income elasticities.

More generally, if $\unicode[STIX]{x1D6FF}(a)$ deaths/year is the annual age-specific benefit of the intervention in mortality risk reduction (at age $a$ ), $y=\text{income}$ , and $\unicode[STIX]{x1D702}(a)$ is the age distribution of the population to which the intervention applies, then:

(2) $$\begin{eqnarray}\text{Value of intervention }(\text{in }$/\text{year})=\int _{0}^{\infty }\unicode[STIX]{x1D6FF}(a)\mathit{VSL}(y,a)\unicode[STIX]{x1D702}(a)\,da.\end{eqnarray}$$

3 Cost-benefit analysis of additional schooling

Analyses prior to Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) have estimated the returns to education using household and labour market survey data, and mainly focus on the private and ‘social’ returns to years of schooling in terms of earnings. IRR for education investments is the discount rate at which net present benefits of the education investments are zero. The ‘social’ IRR incorporates the full cost of schooling and pretax earnings, whereas private IRR estimates assume after-tax earnings and that the cost of schooling is borne by the government, and the only cost of schooling to the individual is the opportunity cost of time associated with attending school. Both these estimates traditionally only consider the wage benefits of increased schooling, with the private returns considering after-tax wages.

Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) expand on the traditional approach to BCAs by including health gains to increased schooling in addition to the earnings return, and estimate the PVNBs, IRRs and BCRs of investing US$1 in education in low-, lower-middle-, and upper-middle-income countries from a societal perspective. This case study presents a proposed set of standard sensitivity analysis on BCRs of an additional year of schooling in LMCs. We also updated our data sources for our analysis as compared to Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018), as tabulated in the Appendix.

The methods for BCA of additional schooling are briefly summarized below:

3.1 Benefits of additional schooling

Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) use a hierarchical linear model to estimate the impact of increased female schooling on under-five mortality, adult male mortality and adult female mortality controlling for technological progress (proxied by time-period categories) and income. Further, we allow the impact of technological progress to vary every five years, hence allowing a country-specific impact of technological progress on health. We replicate the different approaches to estimating the macro-level impact of education on health found in the literature, and choose the model with the most robust controls, resulting in an estimate that is a lower bound of the range used in the same paper and in this case study.

From these regression results, we estimate the level of reductions in (1) adult female mortality, (2) adult male mortality, and (3) under-five mortality (from mother’s education) resulting from one more year of female schooling as was done in Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018). Since the average years of schooling in LMCs is seven years, the BCR calculations estimate the benefits and costs of increasing schooling from seven years on average, to eight years per pupil.

The mortality reductions are then valued using base VSL-to-GNI per capita ratio of 160, another ratio of 100, and discount rates including 1%, 5% and 8.4% with the ratio of 160. The main analysis discounts future costs and benefits at 3%. We combine the expected health value with the earning benefit of increased schooling using smoothed age-earnings profiles received from Psacharopoulos et al. (Reference Psacharopoulos, Montenegro and Patrinos2017). The education to earnings link accounts for increased productivity, but it could also account for increased life expectancy or reduced morbidity which would also improve lifetime earnings.

Note that the impact of increasing schooling on earnings is estimated for both male and female pupils – we use the regional average increase in earnings by increasing one year of secondary schooling. The mortality effect of male education appears to be minimal. The costs in our BCA include costs for educating both male and female students.

3.2 Costs of additional schooling

The direct cost data was provided by International Commission on Financing Global Education Opportunity, which is the cost of teacher time, facilities rent and consumable items such as textbooks, and the opportunity cost of student time was derived from the age-earnings profile. The opportunity cost is the earnings forgone by the additional year of schooling, such that the earnings for the age of entry for additional year of schooling is negative. The direct cost of schooling is only incurred in the additional year; it is zero for ages higher than the age at which the additional schooling occurs. Similar to direct costs, the opportunity cost of schooling at ages higher than the age of additional year of schooling is also zero.

3.3 Health-inclusive benefits and costs of additional schooling

The health-inclusive IRR $(\mathit{hPVNR}(r_{h}))$ is the value of annual IRR $(r_{h})$ such that the health-inclusive PVNB of an additional year of schooling is zero. The education literature typically reports the results of BCAs as IRRs for two reasons. One is to avoid selecting a discount rate from the sea of alternatives. The second is that, like the BCR and unlike the PVNBs – many believe the IRR provides an easily understood and cross-intervention compatible metric of attractiveness. We also report PVNBs, because only reporting a ratio can obscure the relative magnitude of the effects.

As described above, we consider annual direct costs $c_{1}(a)$ and opportunity costs of schooling $c_{2}(a)$ , and the health (mortality risk reduction) benefits $hv(a)$ and earnings benefit $ev(a)$ when estimating the rate of return. Equation (3) gives the net present value of health-inclusive costs and benefits of an additional year of schooling for ages A through 65. Age A is the age of entry for the additional year of schooling at the mean years of schooling (7th grade), which is at 14 years for LMCs.

(3) $$\begin{eqnarray}\mathit{hPVNR}(r_{h})=\mathop{\sum }_{a=A}^{65}\frac{ev(a)+hv(a)-c_{1}(a)-c_{2}(a)}{(1+r_{h})^{a-A}}.\end{eqnarray}$$

Hence, the health-inclusive IRR is the value of $r_{h}$ where the net present value $(\mathit{hPVNR}(r_{h}))$ equals zero. Across a range of reasonable values, inclusion of the benefits from reduced mortality increases IRRs for education by over 40%. For example, in the specific calculation reported in Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) for LMCs, the estimated IRR increased from 7.0% to 9.3% when the value of mortality reduction was included.

Similarly, the BCR is estimated by applying an annual discount rate ( $r$ ) to all costs and benefits. For annual costs and benefits described above, equation (4) shows the health-inclusive BCR (hBCR) and equation (5) the health-inclusive PVNB of one additional year of schooling.

(4) $$\begin{eqnarray}\displaystyle & \displaystyle \mathit{hBCR}(r)=\frac{\displaystyle \mathop{\sum }_{a=A}^{65}[e(a)(1+r)^{A-a}+h(a)(1+r)^{A-a}]}{\displaystyle \mathop{\sum }_{a=A}^{65}[c_{1}(a)(1+r)^{A-a}+c_{2}(a)(1+r)^{A-a}]} & \displaystyle\end{eqnarray}$$
(5) $$\begin{eqnarray}\displaystyle & \displaystyle \mathit{hPVNB}(r)=\mathop{\sum }_{a=A}^{65}[\{e(a)+h(a)-c_{1}(a)-c_{2}(a)\}(1+r)^{A-a}]. & \displaystyle\end{eqnarray}$$

The details of the estimation process of benefit and cost streams are explained in supplement section A, and supplement section D details the age- and income-adjusted benefit streams used for the SSA.

4 Results of BCA for education: standardized sensitivity analysis

Table 2a shows the present dollar value of reduction in mortality risk per student due to an additional year of schooling in LMCs, with varying assumptions of the dependency of the VSL on (i) the base VSL-to-GNI per capita estimate and the income elasticity, and (ii) age of the population groups affected; table 2b shows the BCRs, IRRs and PVNBs for the same. Note that our models assume that the health benefits accrue only to females who receive additional schooling but that the wage benefits accrue to both males and females. Hence, the estimate of the dollar value of health benefits is a weighted average with the weight depending on the fraction of the educated cohort that is female. The calculations assume the cohort is 50 percent female.

We find that the present dollar value of mortality risk reduction is 180% higher if we assume the VSL-to-GNI per capita ratio is constant at 160 (an income elasticity of 1.0), as compared to when we use this U.S. ratio as the starting point and assume that VSL is income-elastic (with an elasticity of 1.5). In the first two income variant scenarios where the VSL-to-GNI per capita ratios are 160 and 100, the present dollar value of mortality reduction benefits exceeds the value of increased earnings. Additionally, if we assume that the value of mortality benefits is age-dependent, then the present dollar value of mortality reduction benefits increases by about 25%, as compared to assuming that mortality reduction benefits are independent of age.

Table 2a Present dollar value of mortality reduction benefits and increased earnings per student, in 2015 US$ a .

a Intervention is one additional year at the current mean of 7 years. Future benefits discounted at the rate of 3% per year.

b Since income is $6,430 per year, VSLR is 54 given an income elasticity of 1.5.

Our results show that using the age-adjusted VSLs rather than the population-average VSLs yields higher values of mortality reduction benefits, BCRs and IRRs, because the benefits accrue to those who are younger than the population average. Every dollar invested in schooling in LMCs would return $5.8 in earnings and reductions in under-five and adult mortality when not adjusting the VSL for age (and when assuming the ratio of VSL-to-GNI per capita is constant at 160). However, adjusting the VSLs for years of life lost, the BCR is 17% higher, at $6.7 in benefits accrued per dollar spent on schooling. We also find that adjusting VSL for income elasticity of 1.5 yields lower IRRs, BCRs and PVNB for LMCs because the income of the reference country is about 8 times higher than the GNI per capita of LMCs at $6,430.

Table 2b BCA for an additional year of education in LMCs: A standardized sensitivity analysis a .

a Intervention is one additional year at the current mean of 7 years.

b BCRs calculated using a discount rate of 3% per year.

c Since income is $6,430 per year, VSL-to-GNI per capita ratio is 54 given an income elasticity of 1.5.

d PVNB in 2015 US$.

Figure 1 presents the sensitivity of BCRs to income elasticity of VSL, using the U.S. value of 160 as the base estimate for the VSL-to-GNI per capita ratio. This scenario assumes that VSL is independent of age, and the future benefits and costs are discounted at the rate of 3%. BCRs and IRRs for LMCs decrease when we assume VSL is income elastic as the income per capita of the reference country (United States) is higher than the income per capita of LMCs. We find that the BCRs range from 2.4 to 5.8 when changing the income elasticity of VSL from 2.0 to 1.0. Note that elasticity of 2.0 is quite high given discussions and recommendations from Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ) – given that the two elasticities recommended are 1.0 and 1.5 with 1.5 recommended as the main one, we simply wanted to estimate the BCRs on the high end as well.

Figure 1 Relationship between benefit-cost ratio of an additional year of schooling and income elasticity of VSL. Note: Intervention is one additional year at the current mean of 7 years. Benefit-cost ratios are estimated for age variant 1, or the case in which VSL does not depend on age. VSL  = Value of a Statistical Life.

Table 3 PVNBs and BCRs for an additional year of schooling: Sensitivity analysis on discount rates a .

a Intervention is one additional year at the current mean of 7 years.

b PVNB in 2015 US$.

c $r=\text{annual}$ discount rate.

d Since income is $6,430 per year, VSLR is 54 given an income elasticity of 1.5.

e Since 2015 GDP per capita growth rate for LMCs was 4.2%, this discount rate reflects twice the near-term growth rate.

We also test the sensitivity of our results to four discount rates. The first is a rate of 3 percent, consistent with the International Decision Support Initiative (iDSI) Reference Case (Wilkinson et al., Reference Wilkinson, Sculpher, Claxton, Revill, Briggs, Cairns and Teerawattananon2016) recommendations as well as common practices. We also report our results for discount rate approximately twice the GDP per capita growth rate in LMCs (Table 3), motivated by the Ramsey ruleFootnote 2 (see Claxton et al., Reference Claxton, Asaria, Chansa, Jamison, Lomas, Ochalek and Paulden2019). The BCR with a discount rate twice the per capita growth rate seen in LMCs ( $r=8.4\%$ ) is three times lower than at the standard rate of 3%. Additionally, the lower discount rate of 1% might be of particular importance because we assume that for each student affected, the increase in earnings accrues from age 14 (average age of entry for the additional year of schooling) to 65 (retirement age), and the mortality risk reduction accrues over 51 years. Comparing the age-unadjusted, income variant 1 scenario across the discount rate of 1% with the standard rate of 3%, we find that the lower discount rate yields a substantially higher BCR at $9.4 in benefits for every dollar spent in schooling in LMCs – this estimate is 62% higher than the BCR estimated at 3%.

5 Discussion

BCAs in education weigh future education-associated wage increases against the current costs of providing schooling and the opportunity costs of students’ time. Female education is reliably estimated to reduce both child and adult mortality rates, and estimates reported in this paper, although at the bottom of the published range, prove quantitatively significant. The paper explores a standardized approach to valuing those mortality reductions, then adds those values to wage benefits to generate more robust BCAs for education investments. Before discussing those SSAs, it is worth making our subject and conclusions concrete. The investment we assess is to add one year to the current average of seven years of education in LMCs (as defined by the World Bank). For 10,000 students, a reasonable estimate of costs is $13 million (in 2015 US$). This increase in (female) education would, over the next half century, result in an estimated reduction in 31 deaths under age five and 64 deaths between ages 15 and 60. It would result in an (undiscounted) increase in earnings of about $60 million assuming no trend increase in wages (or, discounted at 3% per year, a $25 million increase). This is the starting point for the SSA.

This case study applies a standard sensitivity analysis that values the impact of increased education on longevity and earnings. We find that the mortality risk reduction is a sizeable fraction of the benefits of education – perhaps 40–70% of the total including increased earnings. BCRs are highly sensitive to the discount rates used and the VSL assumptions. For example, with a VSL-to-GNI per capita ratio of 160 and income elasticity 1.5, BCRs at a 1% discount rate are twice as high as the estimates at 3% discount rate, and five times higher than the estimates at 8.4%. Those caveats noted, we conclude that investing in an additional year of schooling is likely to have a BCR of greater than 2. Regardless of the SSA scenario, at least a third of the benefits result from the estimated effect of female education on the adult and under-five mortality risks.

We find that every dollar invested in schooling in LMCs would return between $3.2 to $6.7 in benefits in increased earnings and mortality risk reductions, testing the sensitivity of the BCR to differing assumptions regarding the value of mortality risk reductions and its variation by age. Zooming in on the health returns of increased schooling, the sensitivity analysis finds that the present dollar value of mortality risk reduction benefits of increasing one year of schooling ranges from $1,600 to $6,100 per student.

Another sensitivity analysis we performed was around the income elasticity of VSL. We find that the BCR decreases by 58% when we start with the U.S. VSL-to-GNI per capita ratio and change income elasticity of VSL from 1 to 2. Additionally, we find that BCR estimates are sensitive to the discount rates used – in one scenario of BCR estimation, changing the discount rate from the standard 3% to 1% results in a 62% higher BCR.

This case study estimates the direct longevity and earnings effects of increasing schooling. However, income affects health, and education affects both health and income. Further work needs to be done to estimate these indirect effects of education on health as mediated through income. Our statistical model in effect holds income constant while estimating the magnitude of education’s effect on mortality. It is this (conservative) estimate that we report. We do know, in addition, that education has an important effect on income and income has a (modest) effect on mortality. Further research should quantify all channels of education’s effects on mortality. When that research agenda has been completed, we believe our estimate will be shown to have been an underestimate, albeit a modest one. One additional question is the extent to which the VSL includes the effects of mortality risk reductions on earnings. Presumably, VSL reflects individuals’ current earnings expectations, not their expectations conditional on increased education. The interaction of these two mechanisms of education benefits while estimating a comprehensive BCR is an important area of future research.

Another limitation of the study is that we do not adjust the VSL for real income growth over time – including the increase in earnings that results from additional education and the increase that is likely to occur over time for the full population assuming economic growth.

Our BCA for incremental investment in education reflects current recommendations for valuing mortality risk reductions based on available literature, as discussed in Robinson et al. (Reference Robinson, Hammitt and O’Keeffe2019b ). Those recommendations include both alternative estimates of the population-average VSL and of the use of VSLY estimates to adjust for the age of those affected. More research in LMCs is needed to improve these estimates.

This paper estimates the impact of increasing average years of schooling in LMCs by a year. However, (i) the impact of one additional year at the primary level is likely different from the impact of an additional year at high school or in college; and (ii) the impact of increasing schooling by a year across the different countries in the lower-middle-income group could also be different – the heterogeneous impact of increased schooling while important, is beyond the scope of this study and is another noteworthy topic for future research. Additionally, sensitivity analysis around costs is also out of the scope of the study, and is another area of further research along with additional primary data collection on education costs in low- and middle-income countries.

Further sensitivity analyses could consider other parameter values – for example, varying the impact of female schooling on mortality, or to estimating the impact of schooling on both mortality and morbidity. The mortality risk reduction benefits estimated in this study constitute an underestimate of the benefits because the study (i) does not consider the impact of education on decreasing morbidity; (ii) uses the lower bound estimate of the impact of education on mortality; (iii) fails to include stillbirths averted; and (iv) fails to include a broad range of favourable social impact (for example reduced incarceration rates). Additionally, various controls and model specifications could change the regression estimate of the impact of schooling on mortality. Pradhan et al. (Reference Pradhan, Suzuki, Martínez, Schäferhoff and Jamison2018) perform this sensitivity analysis at the regression level to estimate the impact of education on mortality using different controls and specifications in the literature, and we use the lower bound of the range of those estimates in this case study. As these points in our discussion make clear, more research will, in this case as in others, add to the confidence and generality of our findings. That said, we nonetheless would judge our broad findings robust and in general conservative.

Acknowledgments

We wish to acknowledge very helpful comments from Lisa Robinson, James Hammitt, and from four discussants for the paper at a November 2017 workshop held at Harvard University – Anil Deolalikar, Lynn Karoly, Roger Perman and George Psacharopoulos. Two anonymous Journal of Benefit-Cost Analysis reviewers provided additional helpful guidance. The Bill & Melinda Gates Foundation provided financial support through a grant [OPP1160057] to the Harvard Center for Health Decision Science at the Harvard T.H. Chan School of Public Health. More information on the project is available at https://sites.sph.harvard.edu/bcaguidelines/.

The views and opinions in this case study are those of the authors and are not endorsed by the Gates Foundation or the project team or by the organizations with whom the authors are affiliated.

Supplementary material

For supplementary material accompanying this paper, please visit https://doi.org/10.1017/bca.2019.5.

Appendix

Table A1 Data sources used in the note.

Footnotes

1 As defined by the World Bank.

2 Please note that we are assuming a social rate of time preference of zero and an elasticity of the marginal utility of consumption of 2.

References

Baird, Sarah J., Garfein, Richard S., McIntosh, Craig T., and Özler, Berk. 2012. “Effect of a Cash Transfer Programme for Schooling on Prevalence of HIV and Herpes Simplex Type 2 in Malawi: A Cluster Randomised Trial.” The Lancet, 379(9823): 13201329.Google Scholar
Barro, Robert J. and Lee, Jong Wha. 2013. “A New Data Set of Educational Attainment in the World, 1950–2010.” Journal of Development Economics, 104: 184198.Google Scholar
Chang, Angela, Horton, Sue, and Jamison, Dean T.. 2018. “Benefit-Cost Analysis in Disease Control Priorities, Third Edition.” Disease Control Priorities, Third Edition (DCP3): Volume 9. Improving Health and Reducing Poverty. Washington, D.C.: The World Bank.Google Scholar
Claxton, Karl, Asaria, Miqdad, Chansa, Collins, Jamison, Julian, Lomas, James, Ochalek, Jessica, and Paulden, Michael. 2019. “Accounting for Timing when Assessing Health-Related Policies.” Journal of Benefit-Cost Analysis, 10(S1): doi:10.1017/bca.2018.29.Google Scholar
Filmer, Deon and Pritchett, Lant. 1999. “The Impact of Public Spending on Health: Does Money Matter?Social Science & Medicine, 49(10): 13091323.Google Scholar
Gakidou, Emmanuela, Cowling, Krycia, Lozano, Rafael, and Murray, Christopher J. L.. 2010. “Increased Educational Attainment and Its Effect on Child Mortality in 175 Countries between 1970 and 2009: A Systematic Analysis.” The Lancet, 376(9745): 959974.Google Scholar
Hammitt, James K. 2007. “Valuing Changes in Mortality Risk: Lives Saved versus Life Years Saved.” Review of Environmental Economics and Policy, 1(2): 228240.Google Scholar
Hammitt, James K. 2017. “Extrapolating the Value Per Statistical Life Between Populations: Theoretical Implications.” Journal of Benefit-Cost Analysis, January, 8(2): 1–11. https://doi.org/10.1017/bca.2017.13.Google Scholar
Hammitt, James K. and Robinson, Lisa A.. 2011. “The Income Elasticity of the Value per Statistical Life: Transferring Estimates between High and Low Income Populations.” Journal of Benefit-Cost Analysis, 2(1): Art. 1.Google Scholar
Jamison, Dean T., Murphy, Shane M., and Sandbu, Martin E.. 2016. “Why Has Under-5 Mortality Decreased at Such Different Rates in Different Countries?Journal of Health Economics, 48(July)): 1625.Google Scholar
Kuruvilla, Shyama, Schweitzer, Julian, Bishai, David, Chowdhury, Sadia, Caramani, Daniele, Frost, Laura, and Cortez, Rafael et al. . 2014. “Success Factors for Reducing Maternal and Child Mortality.” Bulletin of the World Health Organization, 92(7): 533544.Google Scholar
Lindhjem, H., Navrud, S., Biausque, V., and Braathen, N. A.. 2012. Mortality Risk Valuation in Environment, Health and Transport Policies. Paris: OECD.Google Scholar
Narain, Urvashi and Sall, Chris. 2016. Methodology for Valuing the Health Impacts of Air Pollution: Discussion of Challenges and Proposed Solutions. World Bank.Google Scholar
Pradhan, Elina, Suzuki, Elina M., Martínez, Sebastián, Schäferhoff, Marco, and Jamison, Dean T.. 2018. “The Effect of Education Quantity and Quality on Child and Adult Mortality: Its Magnitude and Its Value.” Disease Control Priorities, Third Edition (DCP3): Volume 8. Child and Adolescent Health and Development. Washington, D.C.: The World Bank.Google Scholar
Psacharopoulos, George, Montenegro, Claudio, and Patrinos, Harry Anthony. 2017. “Education Financing Priorities in Developing Countries.” Journal of Educational Planning and Administration, XXXI(1): 516.Google Scholar
Robinson, Lisa A., Hammitt, James K., Jamison, Dean T., and Walker, Damian G.. 2019a. “Conducting Benefit-Cost Analysis in Low- and Middle-Income Countries: Introduction to the Special Issue.” Journal of Benefit-Cost Analysis, 10(S1): doi:10.1017/bca.2019.4.Google Scholar
Robinson, Lisa A., Hammitt, James K., and O’Keeffe, Lucy. 2019b. “Valuing Mortality Risk Reductions in Global Benefit-Cost Analysis.” Journal of Benefit-Cost Analysis, 10(S1): doi:10.1017/bca.2018.26.Google Scholar
The International Commission on Financing Global Education Opportunity. 2016. The Learning Generation: Investing in Education for a Changing World.Google Scholar
United Nations, Department of Economic and Social Affairs, Population Division. 2017. World Population Prospects: The 2017 Revision, DVD Edition.Google Scholar
Viscusi, W. Kip. 2015. “The Role of Publication Selection Bias in Estimates of the Value of a Statistical Life.” American Journal of Health Economics, 1(1): 2752.Google Scholar
Viscusi, W. Kip and Masterman, Clayton. 2017a. “Anchoring Biases in International Estimates of the Value of a Statistical Life.” Journal of Risk and Uncertainty, 54(2): 103128.Google Scholar
Viscusi, W. Kip and Masterman, Clayton J.. 2017b. “Income Elasticities and Global Values of a Statistical Life.” Journal of Benefit-Cost Analysis, 8(2): 226250.Google Scholar
Wang, Wenjuan, Winner, Michelle, Burgert, Clara, and Colston, Josh. 2014. “Influence of Service Readiness on Use of Facility Delivery Care: A Study Linking Health Facility Data and Population Data in Haiti.” DHS Working Papers No. 114. Rockville, Maryland, USA: ICF International. http://dhsprogram.com/pubs/pdf/WP114/WP114.pdf.Google Scholar
Wilkinson, Thomas, Sculpher, Mark J., Claxton, Karl, Revill, Paul, Briggs, Andrew, Cairns, John A., and Teerawattananon, Yot et al. . 2016. “The International Decision Support Initiative Reference Case for Economic Evaluation: An Aid to Thought.” Value in Health, 19(8): 921928.Google Scholar
World Bank. 2017. World Development Indicators. World Bank Publications.Google Scholar
Figure 0

Table 1 The six outputs of a Standardized Sensitivity Analysis for LMCsa .

Figure 1

Table 2a Present dollar value of mortality reduction benefits and increased earnings per student, in 2015 US$a .

Figure 2

Table 2b BCA for an additional year of education in LMCs: A standardized sensitivity analysisa .

Figure 3

Figure 1 Relationship between benefit-cost ratio of an additional year of schooling and income elasticity of VSL. Note: Intervention is one additional year at the current mean of 7 years. Benefit-cost ratios are estimated for age variant 1, or the case in which VSL does not depend on age. VSL  = Value of a Statistical Life.

Figure 4

Table 3 PVNBs and BCRs for an additional year of schooling: Sensitivity analysis on discount ratesa .

Figure 5

Table A1 Data sources used in the note.

Supplementary material: File

Pradhan and Jamison supplementary material

Pradhan and Jamison supplementary material 1

Download Pradhan and Jamison supplementary material(File)
File 50.1 KB