Historically, many Health Technology Assessment (HTA) bodies were developed with a focus on addressing rapidly rising drug costs and the unique need to evaluate each drug as a de novo entity. The degree to which the unique needs for evaluating technologies vis a vis drugs are reflected in distinct HTA methods and activity is to date understudied.

We examined HTA's reviews of two technologies: WATCHMAN™, a device to reduce the risk of stroke in certain patients and Alair™, a procedure-based treatment for severe asthma. Both technologies have been extensively reviewed by HTA bodies and payers in many countries. These HTA reviews are compared to a convenience sample of these HTA's bodies reviews of drugs and qualitative differentiators between these two categories explored.

The differences and similarities (for example, in rigor and necessity of evidence) between US Section 510(k) clearances, US premarket approval (PMA), and US new drug application (NDA) regulatory pathways have not been clearly understood by HTA or reflected in their methodologies employed. Additionally, emergent methodologies such as Bayesian statistical analyses may encounter challenges within technologies reviews. HTA bodies may not be cognizant of development timelines or the timelines of comparators. Finally, HTA bodies may overestimate device adoption rates.

The differences in evidence requirements for regulatory approval between US 510(k), US PMA, and US NDA pathways have not been reflected in different methodological approaches within HTA bodies reviews. Opportunities and novel methods are needed for HTA bodies to derive imputed comparisons between technologies that may have inherently incongruent timelines. Finally, HTA bodies could benefit from methods to more accurately estimate projected adoption curves. Challenges exist using frameworks, paradigms, and methodologies initially established for, and commonly used for, pharmaceuticals on device evaluations; leaders of HTA methods can improve the situation by providing guidance and recommendations for more appropriate HTA methods to evaluate devices.