Patient Blood Management (PBM) describes a multidisciplinary approach that strives to optimize patients own blood and has been reported to reduce blood components utilization while achieving improved patient outcomes and reduced healthcare costs. The aim of this study was to evaluate the public health and economic impact related to the implementation of a nationwide PBM program in Portugal.

A decision-model comparing two scenarios (“current clinical practice” and “with PBM implementation”) was used to estimate the PBM impact including hospital-assisted patients from the following therapeutic areas: surgery (orthopaedic, cardiac and urologic), cardiology, oncology, gastrointestinal bleeding, abnormal uterine bleeding, hemodialysis, inflammatory bowel disease and pregnancy. Model inputs were obtained from Portuguese national health databases and literature review. The public health impact was measured in life years (LY) gained, disability-adjusted life years (DALY) reduction, hospital length of stay (LOS) and 30-day readmission rate reduction. The economic value was expressed in total and hospitalization costs savings.

A total of 384,704 patients were eligible for PBM strategies. We estimated that a one year nationwide PBM implementation could avoid 594 premature deaths, representing a gain of 1,481 LY and a reduction of 3,660 DALYs relative to the current paradigm. An 8.4 percent and 37.3 percent reduction in length of stay and 30-day readmission rate are expected, respectively. This corresponds to EUR70.4 million savings in hospitalization costs. Although PBM closer monitoring would imply additional physician visits and medicines use, leading to EUR24.1 million in additional expenditure, in this population the overall PBM implementation can generate net savings of more than EUR67.7 million per year (6.3 percent reduction of public expenditure).

The implementation of a nationwide PBM in Portugal may represent a great public health impact, especially in decreased mortality and disability, with substantial public expenditure reduction.

There is an increasing interest in divesting activities, giving rise to several initiatives both academic and governmental to identify and address one of the problems of health systems. In 2013 the Spanish Atlas of Variability in Clinical Practice (VPM) in collaboration with the Spanish Network of Health Technology Assessment (HTA) Agencies started a project with the purpose of providing elements to support a national strategy aimed at minimizing the use of doubtful procedures in the Spanish National Health System (1).

The identification, selection and definition of low added value procedures and the determination of the most cost-effective alternatives were carried out jointly between the AtlasVPM group and the HTA agencies of Andalusia (AETSA), Catalonia (AQUAS), Galicia (Avalia-t), Basque Country (Osteba), Madrid (UETS) and Aragon (IACS). The process consisted of the following phases: (i) Literature review; (ii) Preliminary list of procedures of dubious value; (iii) Analysis of feasibility and construction of the indicators (variability); and (iv) Empirical validation of the defined indicators. Different lists and sources of evidence were used to identify the procedures and evidence that support their low-value.

The synthesis of the evidence gave rise to an initial list of fifty-nine procedures of doubtful value that could be classified as: obsolete or outdated procedures in comparison to more effective / cost-effective alternatives (n = 31), procedures of doubtful value when used outside their main indication (n = 17) and procedures for which the evidence around effectiveness was still insufficient (n = 11). With the advice of clinical experts and coders, the original list was reduced to seventeen procedures and after some adjustments to thirteen.

Identifying procedures of low-added value is a complex task and is context dependent. Literature could be useful to identify a preliminary list but the analysis of the clinical practice, its variability and reasons that justify it are required to determine which procedures are good candidates for disinvestment.

Malaria remains the number one cause of morbidity and mortality in Ghana. Since 1961, several malaria control strategies have been adopted, some of which were discontinued due to funding. In spite of the numerous malaria control strategies in place, its prevalence continues to rise. Priority setting using economic evidence has been proven to ensure efficient use of resources in a cost-effective manner (1). This study, therefore, sought to examine economic evaluation studies conducted on malaria in Ghana and their influence on malaria control policies.

A systematic search was conducted in databases including Medline and Embase to identify relevant Malaria economic evaluation studies conducted in Ghana up to December 2016. Malaria control policies formulated in Ghana over the years were also reviewed. The economic studies were examined alongside the policies to establish their influence on them.

A total of eight studies were identified, all of which were conducted in response to a global directive on malaria control and funded by international agencies. All studies were cost-effective; five evaluating preventive measures and the remaining evaluating treatment. The studies used different methodological approaches, rendering the comparison between alternatives impossible.

Most malaria control initiatives are funded by international agencies, hence its abandonment when funding ceases. Although the majority of economic studies addressed some of these policies, none of them directly influenced their adoption. These policies were rather influenced by global malaria control initiatives. Also, malaria chemoprophylaxis; demonstrated as cost-effective by three studies, is not on the Ghana malaria control policy (2,3).

To ensure sustainability of malaria control strategies and subsequently reduce its prevalence, Ghana must invest financially into economic analysis for formulating and implementation of these policies. Also, the use of economic evidence by policy makers can be promoted, should researchers adopt a methodological guideline for its conduct that ensures comparability of results.

The Da Vinci surgical system is classified as a type “A” medical device in China; the procurement plan of which is regulated by the National Health and Family Planning Commission (NHFP). Between 2010 to 2015, there were thirty-four Da Vinci surgical robots purchased, and installed in thirty tertiary public hospitals across the country. In order to generate context-specific evidence and support further capital funding decisions, the NHFP commissioned a Health Technology Assessment (HTA) of Da Vinci surgical robots, with a focus on real use of the technology in those tertiary public hospitals.

Nine hospitals were selected to collect real word data between 2013 to 2015. Using a cross-sectional survey, data of all robotic surgical cases were collected and described. The unit costs of the robotic surgery were estimated from activity based costing. We also collected cases of prostatectomy (427 versus 421) and hysterectomy (247 versus 105) using the robotic system and laparoscope respectively, and then compared hospital fees and effectiveness during hospitalization. Simulation of the budget impact on health insurance in Shanghai City over the next 5 years was also performed.

A full HTA was conducted based on real data from nine public hospitals in the central and eastern region. Based on a systematic review methodology, we appraised evidence on safety, effectiveness and cost-effectiveness of the Da Vinci surgical robot. Data on technology use, clinical management, and pricing and payment were collected through a cross-sectional survey and interviews of hospital managers, surgeons and nurses. We designed a cohort study on cost-effectiveness of Da Vinci-assisted prostatectomy and hysterectomy, comparing Da Vinci-assisted and laparoscopic prostatectomy (427 vs 421) and Da Vinci-assisted and laparoscopic hysterectomy (247 versus 105). Ethics and inequity issues were discussed based on patient interviews. A budget impact analysis was performed based on scenario mapping of promoting Da Vinci-assisted prostatectomy in Shanghai City over a 5-year timeline.

Due to a lack of evidence on long-term clinical effectiveness and high impact on public finances, the Da Vinci robotic robot should not be procured in large numbers in China. For equipment purchasing the government should strengthen regulations and require the public hospitals to collect more evidence.

South Africa is in the process of providing comprehensive health insurance to all its citizens, thus paving the pathway for Health Technology Assessment (HTA) to play a significant role in provision of safe and effective healthcare. The National Department of Health (DoH) has a published framework and Health Technology Act and strategies since the 1990s to improve health outcomes, and service and delivery of care. The purpose of this study is to explore challenges faced in the implementation of the framework and policies.

The study will be based on review and analysis of health technology policies and legislations introduced in South Africa since the 1990s. These documents are available from the DoH archive. The review from this grey literature was supplemented by information collected from a self-completion questionnaire, which was distributed to key stakeholders. Respondents were identified by direct contact with ministries of health and professional bodies, and included health professionals from the public and private healthcare sector, for example, practitioners, experts from hospitals, and industry representatives. The questionnaire addressed issues pertaining to decision making regarding health service delivery and the status of HTA in the country.

The framework lays out the strategy to facilitate appropriate utilization of health technologies and includes among others, an HTA section. Fragmented use of HTA or parts thereof has been observed in the public and private health care sector. Furthermore, the respondents pointed out that decisions on health technology can be political, institutional or professionally driven whereas they all agreed that a formal and institutional implementation of HTA would improve healthcare service.

The goal to achieve universal health care provides an excellent window of opportunity for formal use of HTA in policy- and decision-making. However, (i) the inadequate number of trained professionals and education and training opportunities (ii) lack of awareness and understanding of the principles of HTA and its impact on the improvement of health care are among the many challenges faced by the system. It has also been observed that national and regional champions can act as change agents and would have a snowball effect.

In 2007, the National Healthcare Institute (ZIN) initiated conditional financing (CF) of expensive hospital drugs as an example of conditional reimbursement schemes (CRS). CF is a 4-year procedure encompassing initial HTA assessment (T = 0) followed by additional data collection via outcomes research (separately assessing appropriate use & cost-effectiveness in routine practice) and re-assessment (T = 4). This study aims to review performance and experiences with CF in the Netherlands to date.

All dossiers for drugs that underwent the full CF procedure were reviewed. Using a standardized data abstraction form, two researchers independently extracted information on procedural, methodological and decision-making aspects (that is, related to implemented outcomes research, evidence assessment and appraisal). A scoring algorithm was used to assess all three aspects.

Fourty-seven candidates were nominated for CF; fourty-four underwent T = 0 assessments and eleven T = 4 assessments. The procedure extended beyond 4 years for 10/11 candidates. For the eleven candidates, applicants clearly defined study designs and data collection methods for outcomes research proposals addressing 16/22 research questions posed in T = 0 reports. ZIN provided discussion points and recommendations regarding research proposals for 18/22 research questions. Applicants implemented recommendations fully in 8/22 cases and partially in 12/22. Sufficient data was available at T = 4 to answer 15/22 research questions posed at T = 0. However, discussion points remained regarding implemented outcomes research for all eleven candidates at T = 4. ZIN advised to continue reimbursement for nine candidates and to stop reimbursement for two. For six of the nine candidates, reimbursement was continued on the basis of conditions relating to additional evidence generation beyond T = 4.

Theoretically, CF provides a valuable option for enabling quick but conditional access to medicines in the Netherlands. However, procedural, methodological and decision-making considerations related to scheme design and implementation may affect its value in decision-making practice.

Whereas Health Technology Assessments (HTAs) by the National Institute for Health and Care Excellence (NICE) rely heavily on cost utility analysis, HTAs by the German Institute for Quality and Efficiency in Health Care (IQWiG) and the Federal Joint Committee (GBA) focus on an assessment of comparative effectiveness, rejecting a cost per quality-adjusted life year benchmark. The present study aimed to explore the differential impact of methodological choices by NICE and IQWiG/GBA on HTA outcomes.

We extracted data from all GBA decisions between January 2011 (when early benefit assessments were implemented) and April 2015 (cut-off date for the present study), as well as all single technology appraisals (STAs) by NICE published during the same period. We compared early benefit assessment results by IQWiG/GBA and by NICE overall, and by additional criteria including therapeutic area, clinical and incremental cost effectiveness, and patient-relevant endpoints.

During the study period, NICE issued guidance for 88 technologies (with 125 subgroups). GBA completed 105 appraisals (with 226 subgroups). We identified thirty-seven matched condition-intervention pairs; of these, twenty-four were evaluated differently by NICE and GBA. NICE recommended twenty-nine of thirty-seven interventions (78 percent), whereas GBA confirmed additional benefit for 21/37 only (57 percent; p< .05, two-tailed chi-square test). By therapeutic area, NICE was more likely to evaluate interventions for metabolic and cardiovascular disorders favorably, whereas IQWiG/GBA appraisals were more favorable for treatments of hematological and oncological diseases. Results including all HTAs were consistent with those for matched pairs.

Our results suggest that, overall, NICE tends to evaluate new interventions more favorably than IQWiG/GBA. However, our analysis revealed conspicuous differences by therapeutic area. The results are consistent with the hypothesis that different methodological choices may lead to systematic differences in decision making. It seems plausible that the observed differences reflect, at least in part, differences in underlying value judgments.

Evaluation of “value for money” is an important component of Health Technology Assessments (HTAs). It is often conceptualized as “cost effectiveness” or cost per (quality-adjusted) life year gained. Whether used in isolation or alongside further drivers of social value (such as priority for younger or more severely impaired patient groups, or for access to effective treatment, even if costly), for example within a multi-criteria decision analysis framework, any reference “value of a statistical life year” (VSLY) should be supported by empirical data capturing the preferences of the population(s) in question. Here we report results based on a systematic review of relevant European economic studies, which were published during the last two decades, that is, from 1995 to 2015.

Our literature search (using the EconBiz and EconLit databases, supplemented by an analysis of relevant reviews) identified fourty-one European studies providing original data, yielding a total of fourty-eight average estimates for the value of a statistical life (VSL, or fatality prevented). We classified studies by methodology, for example, revealed preference (RP) or stated preference (contingent valuation, CV; discrete choice experiment, DCE) approach. We transformed VSL estimates into VSLY expressed in year 2014 Euros, using the life expectancy of the populations studied, a real discount rate of 3 percent, the national Consumer Price Index (CPI) for inflating, and purchasing power parities for currency conversion. We calculated confidence intervals by means of nonparametric bootstrapping.

The median VSLY was EUR158,000 (for RP studies, EUR218,000; DCE, EUR188,000; CV, EUR143,000); we did not identify studies using the human capital approach. Our VSLY estimates showed large heterogeneity, both by methodology and regional origin; thus the differences that we observed did not reach statistical significance.

Our results suggest that the empirical willingness-to-pay for a statistical life year might be substantially higher than benchmarks currently used by the international HTA community.

Program budgeting marginal analysis (PBMA) accommodates economic analysis, multi-stakeholder inputs, values, needs and perspectives within one framework in order to determine optimal use of available resources to deliver the highest ‘health value’. Two pilot PBMA projects in two different services were conceived and completed in a Welsh Health Board (HB) as ‘proof of concept’ methodology for robust prioritization decisons and for improving quality of patient care, outcomes and experience. The pilots were essential to enable development of a ‘bespoke’ PBMA process for the HB to implement.

The PBMA methods were based on methods and criteria for successful PBMAs reported in the literature. Project teams and stakeholder communities supported the PBMAs which were executed over a 12 -18 month period between 2013–15. Group decision support methods were used to facilitate meetings and decision making. Formal interviews with project team members and informal feedback informed development of the final PBMA framework.

Identifying the costs and resources attributable to services and those that could be moved around services was challenging. Evidence of outcomes and ‘health value’ was more easily available. One PBMA pilot recommended that some modest service reorganization and quality improvement could be made within budget but no substantial improvement/decommissioning could be undertaken. The other pilot agreed a disinvestment decision on the basis of evidence and reallocated the resources to a higher value service. The HB commissioning team found the information from the PBMA ‘journey’ as useful as the recommendations. A PBMA framework for the HB was devised.

A ‘Prudent PBMA’ framework trimmed back to the critical essentials enables success criteria to be met. PBMA is to be adopted as a ‘way of working’ to operationalize resource reallocation and disinvestment in the ‘real world’ of Welsh healthcare commissioning.

Some countries have distinct pathways for drugs for rare diseases (DRDs) (1). In May 2014, the Canadian Agency for Technologies in Health (CADTH) rejected the option of a separate review pathway for DRDs, reiterating that “pharmacoeconomic analyses are critical for all types of drugs”. While the gap between positive recommendations for common and rare drugs may have narrowed, the rejection for DRDs is still proportionally much higher (2). The default has been to provincially negotiate drug access, for patient populations, subgroups or individuals. Still not wishing to create a separate pathway, in March 2016, CADTH produced a revised evaluation framework for “uncertain clinical and pharmacoeconomic evidence” and other considerations representing “significant unmet need” including rarity and difficulty to study because of small patient population”(3). This study analyzes recommendations for DRDs following the two CADTH revisions.

Methods used were: synthesis of previously conducted analyses of CADTH recommendations for rare and non-rare drugs, primary comparative analysis of CADTH recommendations for DRDs from 2004 to 2016, and qualitative analysis of two drugs submitted for both rare and non-rare conditions: everolimus (breast cancer, pancreatic neuroendocrine tumours, and tuberous sclerosis complex) and ibrutinib (chronic lymphocytic leukemia, small lymphocytic lymphoma, and Waldenström's Macroglobulinemia).

Previous analyses found that DRDs received more negative recommendations than did non-rare drugs; both clinical and economic evidence were differentiating factors. The primary analysis provided an additional understanding of reasons for negative recommendations. There is low consistency across assessments and across the two CADTH review committees. The case studies illustrated the challenges for DRDs to overcome barriers of cost-effectiveness and certainty of clinical evidence, even with the revised framework.

This research challenges the premise that Health Technology Assessment for all drugs can result in fair and equitable recommendations for DRDs. Moreover, assessments based on “significant unmet need” do not appear to provide consistent or equitable guidelines for addressing the issues specific to rare diseases.

Several health technologies used for therapy can also be used for health enhancement. Drugs stimulating cognitive abilities are but one example. Health Technology Assessment (HTA) has not been developed for assessing enhancements. This raises the question of how HTA should address the blurred distinction between therapy and enhancement. Should we (i) carve out a distinction between therapy and enhancement and limit HTA to therapy, (ii) use HTA for both therapy and enhancement (with some modifications), or (iii) should we develop a separate health enhancement assessment (HEA)?

A literature search of the medical, philosophical, and bioethical literature was conducted for debates, arguments, and suggested solutions to the issue of therapy versus enhancement.

The same improvement in health may be therapeutic in one patient, but an enhancement in another. Moreover, both therapy and enhancement share the same goal: increased health and wellbeing. A wide range of arguments try to establish a difference between therapy and enhancement. They refer to naturalness, rehabilitation, normality, species-typical functioning/potential, disease, sustainability, and responsibility. On closer scrutiny few of these arguments do the job in bolstering the therapy-enhancement distinction. We already use a wide range of means to extend human abilities. Moreover, the therapy-enhancement distinction raises a wide range of ethical issues that are relevant for the assessment of a number of emerging health technologies.

Existing HTA methodology can address a wide range of non-therapeutic health enhancements. However, a series of broader issues related to the goal of health care and responsibility for altering human evolution may not be addressed within traditional HTA frameworks. Specific HEAs may therefore be helpful.

The Unified Health System (SUS) is based on the principle of health as a citizen's right and the state's duty, which must be guaranteed based on public policies. Although there are several legislations, lists of medicines and clinical guidelines, Brazilians who have been prescribed expensive technologies that are not part of the essential drug lists ask judges to issue court orders obliging public health managers to purchase these drugs or to provide elective medical procedures immediately. Due to the health technical inexperience from judges, prosecutors and public lawyers, a partnership has arisen for the National Committee for Health Technology Incorporation (CONITEC) to provide technical assistance to help their decision-making process. Thus the purpose of this study is to describe CONITEC's experiences in communicating with stakeholders in this process.

A case study method was used and information about the rapid reports developed by CONITEC's Executive Secretariat in response to the applicants in the period of 2012 to 2016, was retrieved from CONITEC database.

Rapid reports (2,773) about health technologies incorporation such as medicines, procedures or medical devices were produced by CONITEC during this period. Most requests covering topics as treatments for diabetes, arterial hypertension, osteoporosis, oncology and epilepsy; diseases for which there are several treatment options in SUS. The data analysis indicated that CONITEC contributed to the evidence based decision-making. On one hand, the Prosecutor's Office has been increasingly requesting information before starting lawsuits and Judiciary Power has increasingly used evidence-based technical information before deciding on the concession of injunctions; on the other hand, from 2012 to 2016 the number of requests decreased for information to State defense in lawsuits that has been already established.

There is a growing interest in technical knowledge for fair decision making that respects the current organization of the evidence-based health system.

The main difficulties encountered in the integration of ethics in Health Technology Assessment (HTA) were identified in our systematic review. In the process of analyzing these difficulties we then addressed the question of the diversity of ethical approaches (1) and the difficulties in their operationalization (2,3).

Nine ethical approaches were identified: principlism, casuistry, coherence analysis, wide reflexive equilibrium, axiology, socratic approach, triangular method, constructive technology assessment and social shaping of technology. Three criteria were used to clarify the nature of each of these approaches:

1. 1. The characteristics of the ethical evaluation

2. 2. The disciplinary foundation of the ethical evaluation

3. 3. The operational process of the ethical evaluation in HTA analysis.

In HTA, both norm-based ethics and value-based ethics are mobilized. This duality is fundamental since it proposes two different ethical evaluations: the first is based on the conformity to a norm, whereas the second rests on the actualization of values. The disciplinary foundation generates diversity as philosophy, sociology and theology propose different justifications for ethical evaluation. At the operational level, ethical evaluation's characteristics are applied to the case at stake by specific practical reasoning. In a norm-based practical reasoning, one must substantiate the facts that will be correlated to a moral norm for clearly identifying conformity or non-conformity. In value-based practical reasoning, one must identify the impacts of the object of assessment that will be subject to ethical evaluation. Two difficulties arise: how to apply values to facts and prioritize amongst conflicting ethical evaluations of the impacts?

Applying these three criteria to ethical approaches in HTA helps understanding their complexity and the difficulty of operationalizing them in HTA tools. The choice of any ethical evaluations is never neutral; it must be justified by a moral point of view. Developing tools for ethics in HTA is operationalizing a specific practical reasoning in ethics.

Randomized controlled trials (RCTs) of complex interventions are conducted in a context-specific environment. Principal trial reports, with a focus on main results, are unable to document adequately the context for an intervention, for example, word limits. Important context may be included in “sibling studies” (that is, studies conducted alongside the main trial, for example, process evaluations, and qualitative studies (1). This presentation explores (i) to what extent is it possible to use a systematic and parsimonious method to identify sibling studies and (ii) what is the potential value of yield from these studies?

The systematic CLUSTER approach (2) to follow up of index studies (Citations, Lead authors, Unpublished materials, Scholar, Theories, Early examples Related projects) has demonstrated the value of retrieved items in qualitative terms. However, the CLUSTER approach is painstaking and laborious and may be prohibitive within a time-tight Health Technology Assessment (HTA). A streamlined CLUSTER approach, using freely available Publish or Perish Software integrated with Google Scholar and Microsoft Excel, offers an economical way of building up “clusters” of study reports. A case study of a UK National Institute for Health Research (NIHR)-funded HTA on the management of medically unexplained symptoms in primary care, utilizing quantitative and qualitative research studies, is used to examine the practical application of the approach.

Systematic comparison of yield from sifting with yield from the Publish or Perish software reveals (i) major trials for which corresponding qualitative studies were not previously identified, (ii) qualitative studies identified independently from, and potentially unlinked to, associated trials, (iii) associated trial reports (for example, protocols, feasibility studies, etc), economic evaluations and systematic reviews, and (iv) commentaries and correspondence; all with the potential to enhance understanding of trial context.

The potential of the Publish or Perish-enabled CLUSTER approach to identify trials or qualitative studies, through “joining up” and mapping of clusters, potentially missed from separate quantitative/qualitative sift processes, means that it should be considered for any HTA that seeks to integrate quantitative and qualitative studies.

Multiple databases are often searched in Health Technology Assessment systematic reviews. However in rapid reviews, time and resources are limited and modifications to the search methodology may be necessary. In this retrospective study, the impact of searching fewer databases for three completed rapid reviews (i) Severe Mental Illness (SMI), (ii) Cannabis Cessation (CC), iii) Premature Ejaculation (PE) for the United Kingdom National Institute for Health Research was investigated.

The database coverage and indexing of the study references from the reviews were initially identified. The impact of fewer databases searched was then tested by (i) the number of studies that might be missed, (ii) the number of records for sifting and (iii) the overall rapid review conclusions.

A total of 178 included study references were found in the reviews (SMI n = 14 for 13 studies, CC n = 34 for 33 studies, PE n = 130 for 102 studies). Searching Medline only for SMI, Medline+Embase for CC, Medline+Embase+Cochrane Library for PE, would result in 1902 (74 percent), 466 (43 percent) and 240 (11 percent) fewer records needed to sift, respectively. There would also be a total of ten ‘would be missed’ references (SMI n = 1, CC n = 5 and PE n = 4). However, nine out of the ten references were found to have no or minimal impact on the overall findings of the reviews. The ten references were secondary reports of an included study, papers that lacked sufficient data for meta-analysis such as a conference abstract or an ongoing trial.

From the three reviews examined, limiting the search to fewer databases had no or minimal impact on the review conclusions despite the variable number of studies that would be missed and records needed to sift. More exploration during the scoping search prior to commencing the review will aid the decision on whether to limit the search to fewer databases.

Evidence about which information resources should be searched to identify economic evaluations (EEs) of healthcare interventions when conducting a systematic review (SR) predates closure of the National Health Service Economic Evaluation Database (NHS EED) and Health Economic Evaluations Database (HEED). We assessed which databases are now the best sources of EEs and identify the most efficient combination of databases, taking into account the order in which databases could be searched.

We gathered a reference set of EEs from published reviews of EEs undertaken to inform Health Technology Assessments (HTA). We calculated yield and relative recall (RR) (number of reference set records identified / total number of records in reference set) for each database, and combination of databases. We assessed the order in which databases should be searched, to identify the most efficient combination of databases to identify the reference set. We report the characteristics of records not included in any database studied and implications for identifying this type of evidence.

To date, a reference set of fifty-five EEs from seven HTAs has been processed. Embase and Scopus each yielded 53/55 records (RR .96). MEDLINE yielded 52/55 (RR .95). Embase or Scopus included all of the journal publications in the reference set; no additional unique records were provided by MEDLINE, CEA Registry, EconLit, or Science and Social Science Citation Indexes. The two records that were not identified were unpublished evidence, one of which was included in the National Institute for Health Research (NIHR) HTA database. Processing will continue until we reach the threshold of a reference set of 350 records.

Preliminary results suggest that searching two or three databases may be most efficient, provided that resources are searched using appropriate strategies. Searchers should concentrate on developing search strategies that work well in those databases to ensure adequate sensitivity, and use freed time to identify grey literature.

Health Technology Assessment (HTA) reports adaptation process is an important tool for emerging HTA agencies. INASanté (National Instance for Accreditation in Healthcare) has chosen to rely on this approach, to develop its first health intervention assessment report: comparative study of computed tomographic colonography versus standard colonoscopy for colorectal cancer screening.

Following consultations with healthcare professionals, the PICO question related to the colorectal cancer screening issue in Tunisia was determined. A literature search strategy covering 10 years (2006-2016) was carried out. Several databases including HTA on the net were explored. Then two independent reviewers conducted literature screening and realized a PRISMA flow diagram. Full text selected reports were submitted to three critical appraisal tools: PRISMA checklist, INAHTA checklist and Critical Appraisal Tools (FLC 2.0). The EUnetHTA adaptation toolkit was used to determine reports adaptability by assessing relevance, reliability and transferability. A structured study of the Tunisian context based on a qualitative data analysis was elaborated. The data synthesis and reporting were finalized with the contribution of a working group. Then an external peer review was conducted before the report dissemination.

Eighty reports were screened to finally retain four eligible. After a critical appraisal performed by two independent reviewers, two reports from the Canadian Agency for Drug and Technolgies in Healthcare and AETSA were selected to be assessed using the EUnetHTA adaptation toolkit. Regarding transferability criteria, the second report was retained. The context study has consisted in a qualitative analysis of seventeen individual interviews with healthcare professionals involved in colorectal cancer screening issues and an up to date Tunisian literature review. The final adapted report was a combination between relevant extracted data from AETSA report and synthesis of the Tunisian context analysis.

This HTA report represents a tool for policy makers to establish the appropriate colorectal cancer screening program for the Tunisian context. HTA reports adaptation process is the best way to give evidence on emerging technologies without wasting time and resources.

Although there is increased awareness of patient and public involvement (PPI) among Health Technology Assessment (HTA) organizations, evaluations of PPI initiatives are relatively scarce. Our objective as members of HTAi's Patient and Citizen Involvement Group (PCIG) was to advance understanding of the range of evaluation strategies adopted by HTA organizations and their potential usefulness.

In March 2016, a survey was sent to HTA organizations through the International Network of Agencies for Health Technology Assessment (INAHTA) and contacts of members of HTAi's PCIG. Respondents were asked about their organizational structure; how patients and members of the public are involved; whether and how PPI initiatives have been evaluated, and, if so, which facilitators and challenges to evaluation were found and how results were used and disseminated.

Fifteen programs from twelve countries responded that involved patient (14/15) and members of the public (10/15) in HTA activities. Seven programs evaluated their PPI activities, including participant satisfaction (5/7), process evaluations (5/7) and impact evaluations (4/7). Evaluation results were used to improve PPI activities, identify education and training needs, and direct strategic priorities. Facilitators and challenges revolved around the need for stakeholder buy-in, sufficient resources, senior leadership, and including patients in evaluations. Participants also provided suggestions based on their experiences for others embarking on this work, for example including patients and members of the public in the process.

We identified a small but diverse set of HTA organizations internationally that are evaluating their PPI activities. Our results add to the limited literature by documenting a range of evaluation strategies that reflect the range of rationales and approaches to PPI in HTA. It will be important for HTA organizations to draw on formal evaluation theories and methods when planning future evaluations, and to also share their approaches and experiences with evaluation.

Multiple drug resistance (MDR) intra-abdominal infections (IAIs) are associated with noteworthy direct and societal costs. Compared to previous studies, the present one takes both resistance rate and total medical costs (TMCs) into consideration, focusing on the impact of MDR on TMCs in IAIs, as well as further estimating the additional costs at a national level.

All inpatients discharged between 1 January 2014, and 31 December 2015 from a teaching hospital were included. Due to limits in budget and the large number of inpatients, the randombetween (bottom, top) function was applied to randomly select 40 percent of patients per year. Subsequently, we manually screened out 254 patients with IAIs, according to the International Classification of Disease (tenth revision) and electronic medical records. Eventually, 101 IAIs patients were included, in which 37 were infected by non-MDR bacteria and 64 by MDR bacteria. The Kruskal-wallis non-parametric test and multiple linear regression were employed to analyze the effect of single and multiple variables on TMCs.

Compared to patients with non-MDR infections, those with MDR were associated with significantly higher TMCs, higher antimicrobial costs, increased insurance, combination antimicrobial therapy, higher usage of antimicrobial agents, greater number of pathogens, longer length of stay, and longer intensive care unit stays. In addition, the average TMCs among patients with MDR were CNY131,801.17 (1USD was equal to CNY 6.227 in 2015), which were CNY 90,200.99 higher than those with non-MDR infections. If our results are generalizable to the whole country, the total attributable TMCs are estimated to be CNY37.06 billion, and the societal costs of CNY111.18 billion in 2015.

This real-world data analysis demonstrated the significant excessive burden MDR infections are posing to the current Chinese healthcare system in terms of both TMCs and healthcare resource utilization. Enhanced antimicrobial stewardship in China is necessary to curb the distribution of MDR bacteria.

Heart failure (HF) is a major public health problem worldwide and in Asia. Sacubitril/valsartan reduces cardiovascular death and hospitalizations for HF. However, decision makers need to determine whether its benefits are worth the additional costs, given the low-cost generic status of current standard of care.

Using a Markov model, we projected lifetime clinical and economic outcomes of sacubitril/valsartan versus enalapril for 66-year-old patients with HF in Singapore. Key health states included New York Heart Association (NYHA) classes; patients in each state incurred a monthly risk of hospitalization for HF and cardiovascular death. Probabilities of events were based on the PARADIGM-HF trial. The uncertain treatment effect of sacubtril/valsartan in Asian patients was modelled using a hazard ratio (HR) of 1 as upper limit in sensitivity analyses. Utilities were obtained from published literature. Local national epidemiological and cost data were applied. Analyses were conducted from the Singapore healthcare payer's perspective. Both one-way and Probabilistic Sensitivity Analyses (PSA) based on 10,000 Monte Carlo simulations were performed.

Compared to enalapril, sacubitril/valsartan was associated with an incremental cost-effectiveness ratio (ICER) of SGD74k (USD52k) per quality-adjusted life year (QALY) gained. The cost-effectiveness of sacubitril/valsartan was highly dependent on its effectiveness in reducing the risk of cardiovascular death. However, this was uncertain, particularly in the Asian subgroup, where results were not statistically significant. In sensitivity analyses using results from Asian patients, the ICERs ranged from SGD41k (USD30k) to SGD1.3 million (USD 0.94 million) per QALY gained. PSA showed the probability of sacubitril/valsartan being cost-effective was below 1 percent, 12 percent and 71 percent at thresholds of SGD20k (USD14k), SGD50k (USD36k) and SGD100k (USD 72k) per QALY gained, respectively.

Given the uncertain ICER, sacubtril/valsartan may not provide good value for money compared to enalapril in reducing cardiovascular morbidity and mortality in patients with HF at the current daily cost. Our study highlights the cost-benefit trade-off that healthcare professionals and patients face when considering HF therapy.