Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-25T09:02:02.505Z Has data issue: false hasContentIssue false
  • English
  • Français

Evaluating the Talent Search TRIO program: A Benefit-Cost Analysis and Cost-Effectiveness Analysis1

Published online by Cambridge University Press:  20 November 2015

A. Brooks Bowden  and
Clive Belfield
A. Brooks Bowden*
Affiliation:
Center for Benefit Cost Studies of Education, Teachers College, Columbia University, Box 184, 525 W.120th St., New York, NY 10027, USA, e-mail: [email protected]
Clive Belfield
Affiliation:
Department of Economics, Queens College, City University of New York, Flushing, NY 11379, USA, e-mail: [email protected]
*
*e-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Talent Search was created to improve high school completion and college enrollment for disadvantaged students. Since the program’s inception in 1967, there has not been a valid study on its economic value. In this paper, we perform a full economic evaluation, yielding direct information on the value of Talent Search and highlighting key methodological issues relating to economic evaluations of education programs. We provide rigorous estimates of social costs using the ingredients method. Using prior estimates of impacts from Constantine et al. [(2006). Study Of The Effect of The Talent Search Program On Secondary And Postsecondary Outcomes In Florida, Indiana And Texas: Final Report From Phase II of The National Evaluation. Washington, DC: U.S. Department of Education Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service], we perform a cost-benefit analysis based on new estimates of shadow prices. Finally, to examine site-specific differences in impacts and costs, we undertake cost-effectiveness analysis and derive confidence intervals that illustrate key sensitivity issues. Regarding costs, we find significant resource use beyond federal funding amounts; but we also find that the present value benefits of Talent Search almost certainly exceed the present value of costs by a substantial margin. With regard to cost-effectiveness, we find significant differences across sites and extremely wide confidence intervals. We conclude with an outline of key research issues that need to be addressed to enhance future economic evaluations in educational settings with wide site-specific variation.

Keywords

benefit-cost analysiscost-effectiveness analysiscostsefficiencyhuman capitalrate of return
Type
Articles
Information
Journal of Benefit-Cost Analysis , Volume 6 , Issue 3 , Fall 2015 , pp. 572 - 602
Copyright
© Society for Benefit-Cost Analysis 2015 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Agan, Amanda(2013). Disaggregating The Returns To College. Working paper, Princeton University.Google Scholar
Altonji, Joseph G., Blom, Erica & Meghir, Costas (2012). Human Capital Investments: High School Curriculum, College Major, and Careers. Annual Review of Economics, 4, 185–223.Google Scholar
Autor, David H. (2014). Skills, Education, and the Rise of Earnings Inequality Among the “Other 99 Percent”. Science, 344, 843.Google Scholar
Avery, Christopher & Turner, Sarah (2012). Student Loans: Do College Students Borrow Too Much – Or Not Enough? The Journal of Economic Perspectives, 26, 165–192.Google Scholar
Baum, Sandy, Ma, Jennifer & Payea, Kathleen (2010). Education Pays 2010: The Benefits of Higher Education for Individuals and Society. College Board Advocacy and Policy Center.Google Scholar
Belfield, Clive R. (2014). How Can Cost-Benefit Analysis Help Create Public Value? In Crosby, B., Bryson, J. M. & Bloomberg, L. (Eds.), Public Value: Approaches to Discerning, Measuring and Assessing the Public Sphere, Public Values and the Creation of Public Value (pp. 97–110). Washington, DC: Georgetown University Press.Google Scholar
Belfield, Clive R. & Levin, Henry M. (2007). The Price We Pay: The Economic and Social Consequences of Inadequate Education. Washington, DC: The Brookings Institution.Google Scholar
Belfield, Clive R. & Levin, Henry M. (2015). Guiding the Development and Use of Cost-Effectiveness Analysis in Education. Journal of Research on Educational Effectiveness, 8, 400–418.Google Scholar
Briggs, Andrew H., O’Brien, Bernie J. & Blackhouse, Gordon (2002). Thinking Outside the Box: Recent Advances in the Analysis and Presentation of Uncertainty in Cost-Effectiveness Studies. Annual Review of Public Health, 23, 377–401.CrossRefGoogle ScholarPubMed
Carneiro, Pedro, Heckman, James J. & Vytlacil, Edward J. (2011). Estimating Marginal Returns to Education. American Economic Review, 101, 2754–2781.Google Scholar
Carrell, Scott E. & Hoekstra, Mark (2014). Are School Counselors an Effective Education Input? Economics Letters, 125, 66–69.CrossRefGoogle Scholar
Carroll, Stephen & Erkut, Emre (2009). The Benefits to Taxpayers from Students’ Educational Attainment. Santa Monica, CA: RAND Education.Google Scholar
Constantine, Jill M., Seftor, Neil S., Martin, Emily S., Silva, Tim & Myers, David (2006). Study of The Effect of The Talent Search Program On Secondary And Postsecondary Outcomes In Florida, Indiana And Texas: Final Report From Phase II Of The National Evaluation. Washington, DC: U.S. Department of Education Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service.Google Scholar
Dale, Stacy & Krueger, Alan B.(2011). Estimating the return to college selectivity over the career using administrative earnings data. NBER Working Paper 17159.Google Scholar
Durlak, Joseph & DuPre, Emily. (2008). Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation. American Journal of Community Psychology, 41, 327–350.Google Scholar
Gottlob, Brian J.(2007). The High Cost of Failing to Reform Public Education in Texas. Washington, DC: Working paper, Milton and Rose D. Friedman Foundation.Google Scholar
Gray, Alastair M., Clarke, Philip M., Wolstenholme, Jane L. & Wordsworth, Sarah (2011). Applied Methods of Cost-effectiveness Analysis in Health Care. Oxford, England: Oxford University Press.Google Scholar
Harrington, Winston, Morgenstern, Richard D. & Nelson, Peter (2000). On the Accuracy of Regulatory Cost Estimates. Journal of Policy Analysis and Management, 19, 297–322.3.0.CO;2-X>CrossRefGoogle Scholar
Harris, Douglas N. (2009). Toward Policy-Relevant Benchmarks for Interpreting Effect Sizes Combining Effects with Costs. Educational Evaluation and Policy Analysis, 31, 3–29.Google Scholar
Harris, Douglas N. (2013). Applying Cost-effectiveness Analysis to Higher Education. In Kelly, A. & Carey, K. (Eds.), Stretching the Higher Education Dollar: How Innovation Can Improve Access, Equity, and Affordability (pp. 45–66). Cambridge, MA: Harvard Education Press.Google Scholar
Harris, Douglas N.(2014). Strengthening Federal Access Programs to Meet 21st Century Needs: A Look at TRIO and GEAR UP. Testimony to the U.S. Senate, Health, Education, Labor and Pensions Committee.Google Scholar
Harris, Douglas, Nathan, Alan & Marksteiner, Ryne(2014). The upward bound access program 50 years later: evidence from a national randomized trial. WISCAPE working paper.Google Scholar
Haskins, Ron & Rouse, Cecilia E.(2013). Time for Change: A New Federal Strategy to Prepare Disadvantaged Students for College. Future of Children Policy Brief. Retrieved April 19, 2013, from http://futureofchildren.org/futureofchildren/publications/docs/23_01_PolicyBrief.pdf.Google Scholar
Hollands, Fiona, Bowden, A. Brooks, Belfield, Clive R., Levin, Henry M., Cheng, Henan, Shand, Robert, Pan, Yilin & Hanisch-Cerda, Barbara (2014). Cost-Effectiveness Analysis of Interventions that Improve High School Completion. Educational Evaluation and Policy Analysis, 36, 307–326.Google Scholar
Hoxby, Caroline & Avery, Christopher (2013). The Missing “One-Offs”: The Hidden Supply of High-Achieving, Low Income Students. Brookings Papers on Economic Activity,1–50; Spring.Google Scholar
Hsu, Yung-chen, Chan, Tsu & Hale, Margaret(2006). An Interim Report on the Talent Search Program: 2002-03 and 2003-04, With Select Data From 2000-02. Washington, DC: U.S. Department of Education Office of Postsecondary Education.Google Scholar
Karoly, Lynn (2012). Toward Standardization Of Benefit-Cost Analysis Of Early Childhood Interventions. Journal of Benefit-Cost Analysis, 3, 1–43.Google Scholar
Knapp, Laura G., Kelly-Reid, Janice E. & Ginder, Scott A.(2011). Enrollment in Postsecondary Institutions, Fall 2009; Graduation Rates, 2003 & 2006 Cohorts; and Financial Statistics, Fiscal Year 2009 (NCES 2011-230). U.S. Department of Education. Washington, DC: National Center for Education Statistics.Google Scholar
Levin, Henry M. (1975). Cost-Effectiveness Analysis in Evaluation Research. In Guttentag, M. & Struening, E. L. (Eds.), Handbook of Evaluation Research (Vol. 2, pp. 89–122). Thousand Oaks, CA: Sage Publications.Google Scholar
Levin, Henry M. (2001). Waiting for Godot: Cost-effectiveness Analysis in Education. In Light, R. (Ed.), New Directions for Evaluation (pp. 55–68). San Francisco, CA: Jossey-Bass.Google Scholar
Levin, Henry M. (2013). Cost-Effectiveness Evaluation in Education. In Alkin, Marvin (Ed.), Evaluation Roots: A Wider Perspective of Theorists’ Views and Influences (2nd ed.) (pp. 180–188). Thousand Oaks, CA: Sage Publications.Google Scholar
Levin, Henry M. & McEwan, Patrick J. (2001). “Thousand Oaks, CA”. Cost-Effectiveness Analysis: Methods and Applications. (2nd ed.). Sage Publications.Google Scholar
Long, David A., Mallar, Charles & Thornton, Craig (1981). Evaluating the Benefits and Costs of Job Corps. Journal of Policy Analysis and Management, 1, 55–76.Google Scholar
Maxfield, Myles, Cahalan, Margaret, Silva, Tim, Humphrey, Justin & Thomas, Melissa(2000). Evaluation of the Federal Talent Search Program: Phase II and Phase III Feasibility Report. Washington, DC: U.S. Department of Education Office of Planning, Evaluation and Policy Development, Policy and Program Studies Service.Google Scholar
McLaughlin, Milbrey W. (2005). Listening and Learning From The Field: Tales of Policy Implementation and Situated Practice. In Lieberman, A. (Ed.), The Roots of Educational Change: International Handbook of Educational Change (pp. 58–72). Netherlands: Springer.Google Scholar
Oreopoulos, Philip & Petronijevic, Uros (2013). Making College Worth It: A Review of the Returns to Higher Education. The Future of Children, 23, 41–65.Google Scholar
Polsky, Daniel, Glick, Henry A., Willkie, R. & Schulman, K. (1997). Confidence Intervals For Cost-Effectiveness Ratios: A Comparison Of Four Methods. Health Economics, 6, 243–252.Google Scholar
Rouse, Cecilia Elena (2007). The Labor Market Consequences of an Inadequate Education. In Belfield, Clive & Levin, Henry M. (Eds.), The Price We Pay: The Economic and Political Consequences of Inadequate Education. Washington, DC: Brookings Institution Press.Google Scholar
Seftor, Neil S., Mamun, Arif & Schirm, Allen(2009). The Impacts of Regular Upward Bound on Postsecondary Outcomes Seven to Nine years After Scheduled High School Graduation. Final report. U.S. Department of Education. Washington, DC: Policy and Program Studies Service.Google Scholar
Trostel, Philip (2010). The Fiscal Impacts of College Attainment. In Research in Higher Education (Vol. 51, pp. 220–247).Google Scholar
U.S. Department of Education (2006). WWC Intervention Report, Talent Search. U.S. Department of Education. Washington, DC: Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.Google Scholar
U.S. Department of Education. (2014). 50th Anniversary of the Federal TRIO Programs: Celebrating 50 Years of Providing Hope and Opportunity for Success.Google Scholar
National Center for Educational Statistics. (2013). The Condition of Education, 2013. U.S. Department of Education, Washington, DC, 2013-045.Google Scholar
U.S. Department of Education, National Center for Education Statistics (NCES). (2014). The Condition of Education 2014 (NCES 2014-083), Public School Expenditures.Google Scholar
Webber, Douglas A. (2014). The Lifetime Earnings Premia of Different Majors: Correcting for Selection Based on Cognitive, Noncognitive, and Unobserved Factors. Labour Economics, 28, 14–23.Google Scholar
Zerbe, Richard O., Tyler, Scott & Garland, Nancy (2013). Principles and Guidelines for Benefit-Cost Analysis. In Zerbe, Richard O. & Scott, Farrow (Eds.), Principles for Benefit Cost Analysis. Northampton, MA: Edward Elgar.Google Scholar