Hostname: page-component-586b7cd67f-rdxmf Total loading time: 0 Render date: 2024-11-22T21:39:00.331Z Has data issue: false hasContentIssue false
  • English
  • Français

DEFINING THE RELEVANT OUTCOME MEASURES IN MEDICAL DEVICE ASSESSMENTS: AN ANALYSIS OF THE DEFINITION PROCESS IN HEALTH TECHNOLOGY ASSESSMENT

Published online by Cambridge University Press:  31 May 2017

Esther Jacobs ,
Sunya-Lee Antoine ,
Barbara Prediger ,
Edmund Neugebauer  and
Michaela Eikermann
Esther Jacobs
Affiliation:
Institute for Research in Operative Medicine, Faculty of Health - School of Medicine, Witten/Herdecke University Institute for Biometrics and Epidemiology, German Diabetes Center (DDZ), Leibniz Center for Diabetes Research at Heinrich-Heine-University Dü[email protected]
Sunya-Lee Antoine
Affiliation:
Institute for Research in Operative Medicine, Faculty of Health - School of Medicine, Witten/Herdecke University
Barbara Prediger
Affiliation:
Institute for Research in Operative Medicine, Faculty of Health - School of Medicine, Witten/Herdecke University
Edmund Neugebauer
Affiliation:
Institute for Research in Operative Medicine, Faculty of Health - School of Medicine, Witten/Herdecke University Brandenburg Medical School, Campus Neuruppin
Michaela Eikermann
Affiliation:
Medical Advisory Service of the German Social Health Insurance (MDS)
Get access Rights & Permissions [Opens in a new window]

Abstract

Background: Defining relevant outcome measures for clinical trials on medical devices (MD) is complex, as there is a large variety of potentially relevant outcomes. The chosen outcomes vary widely across clinical trials making the assessment in evidence syntheses very challenging. The objective is to provide an overview on the current common procedures of health technology assessment (HTA) institutions in defining outcome measures in MD trials.

Methods: In 2012–14, the Web pages of 126 institutions involved in HTA were searched for methodological manuals written in English or German that describe methods for the predefinition process of outcome measures. Additionally, the institutions were contacted by email. Relevant information was extracted. All process steps were performed independently by two reviewers.

Results: Twenty-four manuals and ten responses from the email request were included in the analysis. Overall, 88.5 percent of the institutions describe the type of outcomes that should be considered in detail and 84.6 percent agree that the main focus should be on patient relevant outcomes. Specifically related to MD, information could be obtained in 26 percent of the included manuals and email responses. Eleven percent of the institutions report a particular consideration of MD related outcomes.

Conclusions: This detailed analysis on common procedures of HTA institutions in the context of defining relevant outcome measures for the assessment of MD shows that standardized procedures for MD from the perspective of HTA institutions are not widespread. This leads to the question if a homogenous approach should be implemented in the field of HTA on MD.

Keywords

Health technology assessmentClinical trialsComparative effectiveness researchMedical devicesOutcome measures
Type
Assessments
Information
International Journal of Technology Assessment in Health Care , Volume 33 , Issue 1 , 2017 , pp. 84 - 92
Copyright
Copyright © Cambridge University Press 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

1. Storz-Pfennig, P, Schmedders, M, Dettloff, M. Trials are needed before new devices are used in routine practice in Europe. BMJ. 2013;346:f1646.Google Scholar
2. Eikermann, M, Gluud, C, Perleth, M, et al. Commentary: Europe needs a central, transparent, and evidence based regulation process for devices. BMJ. 2013;346:f2771.Google Scholar
3. Vincent, F, Aikaterini, A, Safer, more effective and innovative medical devices. European Commisssion press release. 2012;IP/12/1011.Google Scholar
4. McCulloch, P. The EU's system for regulating medical devices. BMJ. 2012;345:e7126.Google Scholar
5. Clarke, M. Standardising outcomes for clinical trials and systematic reviews. Trials. 2007;8:39.Google Scholar
6. Williamson, PR, Altman, DG, Blazeby, JM, et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13:132.Google Scholar
7. Healthcare Improvement Scotland. Process for the production of Health Technology Assessments (HTAs). 2011. Glasgow: Healthcare Improvement Scotland (HIS).Google Scholar
8. Goodman, CS. HTA 101: Introduction to Health Technology Assessment. 2014. Bethesda, MD: National Library of Medicine (US).Google Scholar
9. Agency for Quality and Accreditation in Health Care. The Croatian Guideline for Health Technology Assessment Process and Reporting, 1st edition 2011. http://aaz.hr/sites/default/files/hrvatske_smjernice_za_procjenu_zdravstvenih_tehnologija.pdf (assessed 03.09.2016).Google Scholar
10. Agency for Healthcare Research and Quality. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. 2014 [cited AHRQ Publication No. 10(14)-EHC063-EF. https://effectivehealthcare.ahrq.gov/ehc/products/60/318/CER-Methods-Guide-140109.pdf (assessed 03.09.2016).Google Scholar
11. Bochenek, T, Golicki, D, Kaczor, M, et al. Guidelines for conducting Health Technology Assessment (HTA), Version 2.1. 2009. http://wwwold.aotm.gov.pl/assets/files/wytyczne_hta/2009/Guidelines_HTA_eng_MS_29062009.pdf (assessed 03.09.2016).Google Scholar
12. Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies: Canada, 3rd edition. 2006. https://www.cadth.ca/media/pdf/186_EconomicGuidelines_e.pdf (accessed 03.09.2016).Google Scholar
13. Centre for Reviews and Dissemination. CRD's guidance for undertaking reviews in health care 2009. https://www.york.ac.uk/media/crd/Systematic_Reviews.pdf (assessed 03.09.2016).Google Scholar
14. Kristensen, FB, Sigmund, H. Health Technology Assessment Handbook, Version 1.0, Danish Centre for Health Technology Assessment (DACEHTA), National Board of Health (NBoH), 2008. http://www.sst.dk/~/media/ECAAC5AA1D6943BEAC96907E03023E22.ashx (accessed 03.09.2016).Google Scholar
15. Ekkernkamp, M, Lühmann, D, Raspe, H. Methodenmanual für „HTA Schnellverfahren“ und Exemplarisches „Kurz-HTA“: Die Rolle der quantitativen Ultraschallverfahren zur Ermittlung des Risikos für osteoporotische Frakturen. Band 34 von Health technology assessment: Schriftenreihe des Deutschen Instituts für Medizinische Dokumentation und Information im Auftrag des Bundesministeriums für Gesundheit und Soziale Sicherung, 2003. http://portal.dimdi.de/de/hta/hta_berichte/hta034_bericht_de.pdf (accessed 03.09.2016).Google Scholar
16. Secretariat of Science Technology and Strategic Inputs Department of Science and Technology. Methodological Guidelines: Health Technology Assessment Appraisals. 2009. http://bvsms.saude.gov.br/bvs/publicacoes/methodological_guidelines_technology_assessment_appraisals.pdf (accessed 03.09.2016).Google Scholar
17. Fröschl, B, Bornschein, B, Brunner-Ziegler, S, et al. Methodenhandbuch für Health Technology Assessment Version 1.2012. 2012. http://www.goeg.at/cxdata/media/download/berichte/methodenhandbuch_publikationsfassung.pdf (accessed 03.09. 2016).Google Scholar
18. Health Information and Quality Authority. Guidelines for Evaluating the Clinical Effectiveness of Health Technologies in Ireland 2011. http://www.hiqa.ie/category/publication-category/health-technology-assessment (accessed 04.09.2012).Google Scholar
19. Health Information and Quality Authority. Guidelines for the Economic Evaluation of Health Technologies in Ireland. 2010. https://www.hiqa.ie/category/publication-category/health-technology-assessment (accessed 04.09.2012).Google Scholar
20. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Allgemeine Methoden. Entwurf für Version 4.2 vom 18.06.2014. 2014. https://www.iqwig.de/download/IQWiG_Methoden_Entwurf-fuer-Version-4-2.pdf (accessed 03.09.2016).Google Scholar
21. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Allgemeine Methoden zur Bewertung von Verhältnissen zwischen Nutzen und Kosten. 2009. https://www.iqwig.de/download/Methodik_fuer_die_Bewertung_von_Verhaeltnissen_zwischen_Kosten_und_Nutzen.pdf (accessed 03.09.2016).Google Scholar
22. Desomer, A, VandeVoorde, C, DeLaet, C, et al. KCE Process Book. 2012. KCE Reports VOLC. D/2012/10.273/xx. http://processbook.kce.fgov.be/ (accessed 10.02.2016).Google Scholar
23. Gartlehner, G, Wild, C, Felder-Puig, R. (Internes) Manual Abläufe und Methoden. 2007. http://eprints.hta.lbg.ac.at/713/3/HTA-Projektbericht_06_(2.Auflage).pdf (accessed 03.09.2016).Google Scholar
24. Wild, C, Gartlehner, G, Zechmeister, I, et al. Externes Manual. Selbstverständnis und Arbeitsweise. Teil 1. 2007. http://eprints.hta.lbg.ac.at/714/1/HTA-Projektbericht_003.pdf (accessed 03.09.2016).Google Scholar
25. Medical Services Advisory Committee, Guidelines for the Assessment of Diagnostic Technologies. 2005. Medical Services Advisory Committee (MSAC).Google Scholar
26. The National Institute for Health and Care Excellence. Guide to the methods of technology appraisal. 2013. https://www.nice.org.uk/process/pmg9/chapter/foreword (accessed 03.09.2016).Google Scholar
27. The National Institute for Health and Care Excellence. Methods for the development of NICE public health guidance (third edition). 2012. https://www.nice.org.uk/process/pmg4/chapter/introduction (accessed 03.09.2016).Google Scholar
28. The National Institute for Health and Care Excellence. Diagnostics Assessment Programme manual. 2011. https://www.nice.org.uk/Media/Default/About/what-we-do/NICE-guidance/NICE-diagnostics-guidance/Diagnostics-assessment-programme-manual.pdf (accessed 03.09.2016).Google Scholar
29. NHS Quality Improvement Scotland. SIGN 50 - A Guideline Developer's Handbook. 2011. http://www.sign.ac.uk/pdf/sign50nov2011.pdf (accessed 01.03.2017).Google Scholar
30. Haute Autorité de Santé. Rapid Assessment Method for Assessing Medical and Surgical Procedures. 2007. http://www.has-sante.fr/portail/upload/docs/application/pdf/rapid_assessment_method_eval_actes.pdf (accessed 03.09.2016).Google Scholar
31. Medical Services Advisory Committee. Funding for new medical technologies and procedures: Application and assessment guidelines. 2005. Canberra: Medical Services Advisory Committee (MSAC).Google Scholar
32. Siebert, M, Clauss, LC, Carlisle, M, et al. Health technology assessment for medical devices in Europe. What must be considered. Int J Technol Assess Health Care. 2002;18:733–740.Google Scholar
33. McCulloch, P, Altman, DG, Campbell, WB, et al. No surgical innovation without evaluation: the IDEAL recommendations. Lancet. 2009;374:1105–1112.CrossRefGoogle ScholarPubMed
34. Ergina, PL, Cook, JA, Blazeby, JM, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374:1097–1104.Google Scholar
35. Ibargoyen-Roteta, N, Gutierrez-Ibarluzea, I, Rico-Iturrioz, R, et al. The GRADE approach for assessing new technologies as applied to apheresis devices in ulcerative colitis. Implement Sci. 2010;5: 48.Google Scholar
36. Demotes-Mainard, J, Kubiak, C. A European perspective–The European clinical research infrastructures network. Ann Oncol. 2011;22 (Suppl 7):vii44–vii49.Google Scholar
37. Advancing and strengthening the methodological tools and policies relating to the application and implementation of Health Technology Assessment (ADVANCE HTA). HTA and medical devices. http://www.advance-hta.eu/wp5.php (accessed: 10.02.2016).Google Scholar
38. University for Health Sciences and Medical Informatics and Technology on behalf of EUnetHTA Joint Action 2. Guideline therapeutic medical devices. 2015. https://eunethta.fedimbo.belgium.be/sites/5026.fedimbo.belgium.be/files/WP7-SG3-JA2-GL-therap_medical_devices.pdf (accessed 04.09.2016).Google Scholar
39. Schnell-Inderst, P, Mayer, J, Lauterberg, JS, et al. Health technology assessment of medical devices: What is different? An overview of three European projects. Z Evid Fortbild Qual Gesundhwes. 2015;109:309–318.Google Scholar
Supplementary material: File

Jacobs supplementary material

Jacobs supplementary material 1

Download Jacobs supplementary material(File)
File 47.4 KB