Health Technology Assessment (HTA) is a multidisciplinary activity that systematically examines different dimensions related to the direct and indirect consequences of health technologies when implemented in healthcare systems. HTA is developed by multidisciplinary teams in order to cover all the mentioned dimensions. However, the quality of the processes produced by HTA teams will depend upon the competencies that those teams will acquire and incorporate including knowledge, skills and attitudes (1). The aim of this research was to determine how well these dimensions and competencies are covered in HTA academic Masters degree courses and manuals.

We analyzed what had been done in terms of competencies definition in HTA: how it has been reflected; theoretically and according to the authors, and how competencies can be structured; know-how and values. We explored HTA manuals and HTA academic Masters degree courses. We searched in Google with specific terms: building capacities, HTA, programs, Masters, diplomas. We used the HTAi vortal and the information related to courses (for example Masters degrees) and HTA agencies and network webpages for programs. The inclusion criteria were formal programs that describe HTA capacity building and not partial teaching of certain aspects of HTA and we excluded non-recognized institutions, or where there was no description of the programs or lack of detail regarding objectives and competencies to be achieved.

We found 105 courses or programs and analyzed 8 reports and 3 manuals. The main challenges that we faced were: that information was difficult to retrieve, not similarly structured, difficulties to find key information in webpages, no program description at all in some cases and the need to contact institutions staff or register as a student to receive the information and finally, it was difficult to obtain contact details of key people. We structured the information on competencies in knowledge, skills and attitudes.

The analyzed Masters degree courses and manuals did not cover all of the dimensions of HTA analysis in an equal and standardized way. The ethical, legal, social and organizational aspects were lacking in some of the programs, while, on the contrary, clinical and economic aspects were substantially included. On the basis of the information retrieved it would be good to define core competencies for HTA.

We evaluated the early impact of a new hospital-based health technology assessment (HB-HTA) program, called Smart Innovation, at the University of Washington Medical Center (UWMC).

We compared the UWMC's utilization trends for two surgical procedures to control hospitals by evaluating the difference before and after adoption decisions: (i) a new filter for transcatheter aortic valve replacement (TAVR) procedures that treat aortic valve stenosis and (ii) microwave ablation (MWA) for treating hepatocellular carcinoma. We used descriptive statistics to assess the difference between the UWMC and controls for TAVR and MWA procedures and multivariate difference-in-differences (DID) analyses to test for statistical significance.

The UWMC experienced a 10 percent reduction in TAVR procedures compared with controls following the implementation of the TAVR Sentinel filter. The DID regression model indicated a 1.5 reduction in the number of TAVR procedures per quarter at the UWMC between the pre- and post period, which was not statistically significant (p-value: .87). The UWMC experienced a 51 percent reduction in utilization when compared with controls for MWA procedures in the pre- and post periods. The DID model for MWA indicated an 18.8 decrease in utilization per quarter during the study period for the UWMC, which was statistically significant (p-value: .0007). For MWA procedures, the UWMC experienced a $647,658 dollar reduction in total costs in the post period compared with controls.

When the UWMC used HB-HTA methods for technology adoption, there was a reduction in utilization and total costs when compared with controls; however, when the UWMC adopted a new technology without using HB-HTA methods, there was no difference in utilization.

Consideration of ethical, legal, and social issues plus patient values (ELSI+) in health technology assessment (HTA) is challenging because of a lack of conceptual clarity and the multi-disciplinary nature of ELSI+. We used concept mapping to identify key concepts and inter-relationships in the ELSI+ domain and provide a conceptual framework for consideration of ELSI+ in HTA.

We conducted a scoping review (Medline and EMBASE, 2000–2016) to identify ELSI+ issues in the HTA literature. Items from the scoping review and an expert brainstorming session were consolidated into eighty ELSI+-related statements, which were entered into Concept Systems® Global MAX™ software. Participants (N = 38; 36 percent worked as researchers, 21 percent as academics; 42 percent self-identified as HTA experts) sorted the statements into thematic groups, and rated them on importance in making decisions about adopting technologies in Canada, from 1 (not at all important) to 5 (extremely important). We used Concept Systems® Global MAX™ software to create and analyze concept maps with four to sixteen clusters.

Our final ELSI+ map consisted of five clusters, with each cluster representing a different concept and the statements within each cluster representing the same concept. Based on the concepts, we named these clusters: patient preferences/experiences, patient quality of life/function, patient burden/harm, fairness, and organizational. The highest mean importance ratings were for the statements in the patient burden/harm (3.82) and organizational (3.92) clusters.

This study suggests an alternative approach to ELSI+, based on conceptual coherence rather than academic disciplines. This will provide a foundation for incorporating ELSI+ into HTA.

To facilitate moving from research findings to conclusions when conducting systematic reviews (SRs) and health technology assessments (HTAs), evidence grading systems (EGSs) have been developed to assess the quality of bodies of evidence and communicate (un)certainty about the effects of evaluated technologies. Use of EGSs has become an essential step in conducting SRs and HTAs and those relying on review conclusions should be aware of EGSs’ potential limitations.

This study aims to identify EGSs used in SR and HTA practice, and summarize findings on their inter-rater reliability (IRR). Relevant sources were searched to identify EGSs used in recently published SRs and IRR studies of available EGSs. Members of the International Network of Agencies for Health Technology Assessment were surveyed regarding their current approaches.

Preliminary results indicate that only two conceptually similar EGSs are currently used by several organizations in SR and HTA practice: (i) the Grading of Recommendations Assessment, Development and Evaluation (GRADE) and (ii) the Agency for Healthcare Research and Quality Evidence-based Practice Center Program (AHRQ-EPC). Both approaches emphasize a structured and transparent method. However, results from published IRR studies suggest there is a risk for variability in their application due to researchers’ diverse levels of training and experience in using them, and the complexity and heterogeneity of evidence in SRs.

Validated EGSs can play a critical role in whether and how research findings are eventually translated into practice. However, our results indicate a low level of uptake of EGSs in HTA practice. Both currently used EGSs are susceptible to misuse that allows different researchers to grade the same body of evidence differently, and their performance has not been robustly explored in terms of IRR. If these results stand up to replication, one cannot rely on conclusions of published SRs, which has implications for the decisions they inform.

Health state utilities measured by the generic multi-attribute utility instruments (MAUIs) differ. Empirical evidence suggests that some MAUIs are more sensitive than others in reflecting the quality of life (QoL) of patients in particular disease areas. Additionally, in order to estimate utilities based on cancer-specific health-related quality of life instruments (CSQoLs), a number of mapping functions have emerged. Although it is common practice to apply a CSQoL instead of a MAUI in clinical trials, CSQoL cannot be used to estimate utility values for economic evaluations. Mappings based on MAUIs that are not sensitive to changes in cancer patients’ QoL may result in misleading approximations of utilities that could affect allocation of resources. The study objective is to explore the validity and sensitivity of the major MAUIs to variation in the QoL measured by cancer-specific instruments. We aimed to investigate (i) the sensitivity of the general MAUIs scores to changes in the CSQoL, and (ii) whether particular dimensions of the general instrument are more sensitive.

A two stage systematic literature review is conducted. First, an update of the review done by McTaggart-Cowan et al. (2013) on the mapping methods used to determine utilities from cancer-specific instrument. Second, an analysis of studies that measure the relationship between CSQoLs and general MAUIs.

The literature suggests that differences exist between MAUIs in their capacity to capture the QoL dimensions of the CSQoLs. Additionally, the main challenge to build an appropriate mapping function for deriving utilities values from CSQoL is the definition of an appropriate methodology that (i) responds to the distribution of the selected sample and (ii) can successfully be validated in additional samples.

In the context of health technology assessment and cost effectiveness analysis, it is crucial to carefully select and report the CSQoL and MAUI involved in the estimation of the additional benefits. Policy makers need to be awarded of the sensitivity of the instruments to changes in QoL in relation to the CSQoL dimensions QoL.

The Hospital de Clínicas de Porto Alegre (HCPA), a public teaching hospital, has a Hospital-based Health Technology Assessment (HB-HTA) unit to support the decision-making process on technology incorporation, rationalization or disinvestment. In 2017, the plastic adhesive drape was standardized at HCPA for use in cardiovascular, digestive, orthopedic, and neurological surgery for the purpose of preventing surgical site infection (SSI). This study evaluated whether the plastic adhesive drape technology is more effective than the no adhesive drapes in the surgical procedures in which it is used in the HCPA, so as to support the medical board's decision regarding the rationalization of use.

The primary outcome was the surgical site infection rate (SSI). Searches were performed in PubMed, Cochrane and national and international health agencies: World Health Organization (WHO), National Institute for Health and Care Excellence (NICE), Centers for Disease Control and Prevention (CDC), Society for Healthcare Epidemiology of America (SHEA), Brazilian National Commission for the Incorporation of Technologies (CONITEC) and Brazilian National Health Surveillance Agency (ANVISA) databases. The search strategy combined terms related to the technology and types of surgery in which it is used in the HCPA. The quality of the included studies was assessed. Additionally, data on technology utilization and costs in the hospital were analyzed.

Technology assessment followed AdHopHTA project recommendations. Data from the hospital showed that the technology has been used in fifteen surgical specialties, different from the proposed incorporation, with a progressive increase in consumption from 2017 to 2018. The literature review included a systematic review with seven clinical trials, which concluded that the plastic adhesive drape lacks benefits, with potential for increased risk of SSI. The evidence was of moderate quality.

The expenses associated with the use of the technology were considered unjustified as it is not reimbursed by the Brazilian Ministry of Health and its disinvestment was recommended. The Medical Board approved the disinvestment of the technology based on the evidence found by the HB-HTA unit, and the medical staff complied with the decision.