Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-26T11:07:49.025Z Has data issue: false hasContentIssue false

Evaluating HTA principles

Published online by Cambridge University Press:  13 October 2010

Peter J. Neumann
Affiliation:
Director, Center for the Evaluation of Value & Risk, in Health, Institute for Clinical Research and Health Policy Studies, 800 Washington Street, Tufts Medical Center, #063, Professor, Tufts University School of Medicine, Boston, Massachusetts 02111 Email: [email protected]
Michael F. Drummond
Affiliation:
Professor, Health Economics, Centre for Health Economics, University of York, Alcuin A Block, Heslington, York YO10 5DD, United Kingdom Email: [email protected]
Bengt Jonsson
Affiliation:
Professor, Department of Economics, Stockholm School of Economics, 65, Sveavagen, Stockholm, SE 11383 Sweden Email: [email protected]
Bryan R. Luce
Affiliation:
Senior Vice President, Department of Science Policy, United BioSource Corporation, 7101 Wisconsin Avenue, Suite 600, Bethesda, Maryland 20817 Email: [email protected]
J. Sanford Schwartz
Affiliation:
Leon Hess Professor of Medicine, Health Management & Economics, Departments of Medicine and Health Care Management, School of Medicine and the Wharton School, University of Pennsylvania, Blockley Hall Suite #1120, Philadelphia, Pennsylvania 19104 Email: [email protected]
Uwe Siebert
Affiliation:
Chair Professor of Public Health (UMIT), Department of Public Health, Medical Decision Making and Health Technology Assessment, UMIT – University for Health Sciences Medical Informatics and Technology, Eduard Wallnoefer Center I, Hall i.T., Austria, A-6060, Adjunct Professor, Department of Health Policy and Management, Harvard School of Public Health, 677 Huntington Avenue, Boston, Massachusetts 02115 Email: [email protected]
Sean D. Sullivan
Affiliation:
Professor, Pharmaceutical Outcomes Research and Policy Program, University of Washington, 1959 NE Pacific Avenue, Box 357630, Seattle, Washington 98195 Email: [email protected]
Rights & Permissions [Opens in a new window]

Extract

Thank you for the opportunity to respond to the letter by Gibson and Little. The authors raise several points that require a response. First, they claim that we inaccurately characterized the DERP/Washington State Medicaid agency, and did not appreciate that the DERP and the Washington State Medicaid agency have different missions. On the contrary, however, we fully recognized that DERP's mission is to conduct systematic reviews and not to make recommendations, whereas Washington State uses the reviews in making recommendations for their Medicaid enrollees. We specifically noted in the study that “Washington Medicaid is one of fourteen participants in the DERP. DERP researchers conduct health technology assessments for drug classes. Participants in the DERP, such as the Washington Medicaid program, retain local authority for interpreting DERP reports and for decision making regarding which drugs to pay for.” We chose to analyze DERP/Washington State as a single entity for our exercise because we were interested in analyzing the link between the HTA conducted and the decisions that follow them.

Type
LETTERS TO THE EDITOR
Copyright
Copyright © Cambridge University Press 2010

To the Editor:

Thank you for the opportunity to respond to the letter by Gibson and Little. The authors raise several points that require a response. First, they claim that we inaccurately characterized the DERP/Washington State Medicaid agency, and did not appreciate that the DERP and the Washington State Medicaid agency have different missions. On the contrary, however, we fully recognized that DERP's mission is to conduct systematic reviews and not to make recommendations, whereas Washington State uses the reviews in making recommendations for their Medicaid enrollees. We specifically noted in the study that “Washington Medicaid is one of fourteen participants in the DERP. DERP researchers conduct health technology assessments for drug classes. Participants in the DERP, such as the Washington Medicaid program, retain local authority for interpreting DERP reports and for decision making regarding which drugs to pay for.” We chose to analyze DERP/Washington State as a single entity for our exercise because we were interested in analyzing the link between the HTA conducted and the decisions that follow them.

Second, Gibson and Little state that we applied our principles in an ad hoc way and should have labeled it as a commentary. In fact, we stated clearly and prominently in the abstract of the article and in text itself that our piece was intended as a commentary. Moreover, we emphasized that our study was intended as a first-blush effort to analyze the support and use of the Key Principles for HTA, and that our focus was on uptake and use of the Principles, rather than a verdict or report card on the HTA entities evaluated. We emphasized that our goal was to advance the practice of HTA and to stimulate informed discussion through an extended and interactive process. Indeed, we view the Gibson and Little letter, despite their criticism, as a symbol of some success in this regard. In addition, several of the other organizations featured in the study contacted us directly with positive feedback, even if they did not agree with all of our observations. In some cases, our study provoked a debate about the key principles within these organizations.

Third, regarding whether the DERP/Washington State supports certain principles, such as explicitly characterizing uncertainty or considering issues of generalizability and transferability, we stick to our judgments, but recognize, as we did in our study, that there is room for debate on such matters. Our study acknowledges that there is subjectivity in our evaluations and that other researchers or the agencies themselves may be more or less strict about whether a particular principle has been supported or implemented. In some cases, we judged our assessments to be more or less straightforward, while in others the evaluation required greater discretion, and caused considerable debate within the group.

Fourth, we agree with Gibson and Little that work on validation of the key principles is warranted. We stressed in our study that in the future researchers might also consider how to undertake formal benchmarking exercises. We stated that it would be useful to pre-specify and quantify more precisely the criteria for achieving a positive verdict on support and use of the principles, and that some principles will lend themselves more readily to such benchmarking than others.

Finally, regarding any use of our study by industry lobbyists in Oregon and Washington, none of us had any involvement in, nor prior awareness of, those efforts.