Background: The most effective sources to search to identify adverse effects data for medical devices are currently unknown.

Methods: The included studies from a systematic review of the safety of recombinant human bone morphogenetic protein-2 (rhBMP-2) for spinal fusion were used for analysis. For each source searched, a record was made for each relevant publication of whether it was retrieved by the search strategy used and whether it was available in the database but not retrieved. To account for multiple publications of the same study, a record was made of the relevant studies identified. The sensitivity, precision, and number needed to read were calculated as well as the minimum combination of sources to identify all the publications or studies.

Results: There were eighty-two publications (forty-nine studies) included in the systematic review. Only one article was available in a database searched but not retrieved by our search strategy. Science Citation Index (SCI) and EMBASE both achieved the highest sensitivity (62 percent), followed closely by MEDLINE/PubMED (56 percent). With the search strategies used, the minimum combination of sources needed to identify all the publications was SCI, EMBASE, CENTRAL, and either MEDLINE or PubMED, in addition to reference checking, contacting authors and an automated current awareness service. In relation to identifying all the relevant studies, the minimum combination of studies was similar with the exclusion of CENTRAL.

Conclusions: To identify all the relevant publications or studies included in this case study systematic review, several different sources needed to be searched.

Objectives: Licensing of, and coverage decisions on, new therapies should rely on evidence from patient-relevant endpoints such as overall survival (OS). Nevertheless, evidence from surrogate endpoints may also be useful, as it may not only expedite the regulatory approval of new therapies but also inform coverage decisions. It is, therefore, essential that candidate surrogate endpoints be properly validated. However, there is no consensus on statistical methods for such validation and on how the evidence thus derived should be applied by policy makers.

Methods: We review current statistical approaches to surrogate-endpoint validation based on meta-analysis in various advanced-tumor settings. We assessed the suitability of two surrogates (progression-free survival [PFS] and time-to-progression [TTP]) using three current validation frameworks: Elston and Taylor's framework, the German Institute of Quality and Efficiency in Health Care's (IQWiG) framework and the Biomarker-Surrogacy Evaluation Schema (BSES3).

Results: A wide variety of statistical methods have been used to assess surrogacy. The strength of the association between the two surrogates and OS was generally low. The level of evidence (observation-level versus treatment-level) available varied considerably by cancer type, by evaluation tools and was not always consistent even within one specific cancer type.

Conclusions: Not in all solid tumors the treatment-level association between PFS or TTP and OS has been investigated. According to IQWiG's framework, only PFS achieved acceptable evidence of surrogacy in metastatic colorectal and ovarian cancer treated with cytotoxic agents. Our study emphasizes the challenges of surrogate-endpoint validation and the importance of building consensus on the development of evaluation frameworks.

Objectives: In economic evaluations of healthcare technologies, situations arise where data are not randomized and numbers are small. For this reason, obtaining reliable cost estimates of such interventions may be difficult. This study explores two approaches in obtaining cost estimates for pregnant women screened for a fetal cardiac anomaly.

Methods: Two methods to reduce selection bias in health care: regression analyses and propensity scoring methods were applied to the total mean costs of pregnancy for women who received specialist cardiac advice by means of two referral modes: telemedicine and direct referral.

Results: The observed total mean costs of pregnancy were higher for the telemedicine group than the direct referral group (4,918 versus 4,311 GBP). The regression model found that referral mode was not a significant predictor of costs and the cost difference between the two groups was reduced from 607 to 94 GBP. After applying the various propensity score methods, the groups were balanced in terms of sizes and compositions; and again the cost differences between the two groups were smaller ranging from -62 (matching “by hand”) to 333 GBP (kernel matching).

Conclusions: Regression analyses and propensity scoring methods applied to the dataset may have increased the homogeneity and reduced the variance in the adjusted costs; that is, these methods have allowed the observed selection bias to be reduced. I believe that propensity scoring methods worked better for this dataset, because after matching the two groups were similar in terms of background characteristics and the adjusted cost differences were smaller.

Objectives: The need to consider the patient perspective in health technology assessments (HTA) has been widely recognized. In July 2012, the Finnish Medicines Agency (Fimea) published a national recommendation for integrating the patient perspective into the HTAs of pharmaceuticals. The aim of this study is to describe the development of the recommendation for integrating the patient perspective into the HTA process of pharmaceuticals in Finland.

Methods: The development of the recommendation was based on a review of international recommendations and experiences of patient and public involvement in HTA. The draft recommendation was tested in two focus group discussions (n = 7 patients) and three individual interviews among diabetes patients (type 1 or 2) using long-acting insulin treatment. The recommendation was open for public consultation in April 2012 and revised according to the comments received.

Results: Patients will be involved in multiple stages of Fimea's HTA process. The recommendation includes step-by-step instructions on how to assess the patient perspective. The main focus is on qualitative interviews, which will be conducted at the beginning of the assessments to gain information, particularly on patient preferences and values, including positive and negative outcomes important to patients and ethical and social aspects of the medicine's use.

Conclusions: The recommendation will act as a tool to integrate patients’ experiences, needs and preferences into Fimea's HTAs of pharmaceuticals.

Objectives: Health economic models are developed as part of the health technology assessment process to determine whether health interventions represent good value for money. These models are often used to directly inform healthcare decision making and policy. The information needs for the model require the use of other types of information beyond clinical effectiveness evidence to populate the model's parameters. The purpose of this research study was to explore issues concerned with the identification and use of information for the development of such models.

Methods: Three focus groups were held in February 2011 at the University of Sheffield with thirteen UK HTA experts. Attendees included health economic modelers, information specialists and systematic reviewers. Qualitative framework analysis was used to analyze the focus group data.

Results: Six key themes, with related sub-themes, were identified dealing with decisions and judgments; searching methods; selection and rapid review of evidence; team communication; modeler experience and clinical input and reporting methods. There was considerable overlap between themes.

Conclusions: Key issues raised by the respondents included the need for effective communication and teamwork throughout the model development process, the importance of using clinical experts as well as the need for transparent reporting of methods and decisions.

Background: Many jurisdictions delivering health care, including Canada, have developed guidance for conducting economic evaluation, often in the service of larger health technology assessment (HTA) and reimbursement processes. Like any health intervention, personalized medical (PM) interventions have costs and consequences that must be considered by reimbursement authorities with limited resources. However, current approaches to economic evaluation to support decision making have been largely developed from population-based approaches to therapy—that is, evaluating the costs and consequences of single interventions across single populations. This raises the issue as to whether these methods, as they are or more refined, are adequate to address more targeted approaches to therapy, or whether a new paradigm for assessing value in PM is required.

Objectives: We describe specific issues relevant to the economic evaluation of diagnostics-based PM and assess whether current guidance for economic evaluation is sufficient to support decision making for PM interventions.

Methods: Issues were identified through literature review and informal interviews with national and international experts (n = 10) in these analyses. This article elaborates on findings and discussion at a workshop held in Ottawa, Canada, in January 2012.

Results: Specific issues related to better guiding economic evaluation of personalized medicine interventions include: how study questions are developed, populations are characterized, comparators are defined, effectiveness is evaluated, outcomes are valued and how resources are measured. Diagnostics-based PM also highlights the need for analyses outside of economic evaluation to support decision making.

Conclusions: The consensus of this group of experts is that the economic evaluation of diagnostics-based PM may not require a new paradigm. However, greater complexity means that existing approaches and tools may require improvement to undertake these more analyses.

Objectives: The aim of this study was to get an overview of current theory and practice in early assessments of medical devices, and to identify aims and uses of early assessment methods used in practice.

Methods: A systematic literature review was conducted in September 2013, using computerized databases (PubMed, Science Direct, and Scopus), and references list search. Selected articles were categorized based on their type, objective, and main target audience. The methods used in the application studies were extracted and mapped throughout the early stages of development and for their particular aims.

Results: Of 1,961 articles identified, eighty-three studies passed the inclusion criteria, and thirty were included by searching reference lists. There were thirty-one theoretical papers, and eighty-two application papers included. Most studies investigated potential applications/possible improvement of medical devices, developed early assessment framework or included stakeholder perspective in early development stages. Among multiple qualitative and quantitative methods identified, only few were used more than once. The methods aim to inform strategic considerations (e.g., literature review), economic evaluation (e.g., cost-effectiveness analysis), and clinical effectiveness (e.g., clinical trials). Medical devices were often in the prototype product development stage, and the results were usually aimed at informing manufacturers.

Conclusions: This study showed converging aims yet widely diverging methods for early assessment during medical device development. For early assessment to become an integral part of activities in the development of medical devices, methods need to be clarified and standardized, and the aims and value of assessment itself must be demonstrated to the main stakeholders for assuring effective and efficient medical device development.

Objectives: The aim of this study was to describe 8-year results from post-implementation surveillance of neuroreflexotherapy (NRT), a health technology proven effective for treating neck and back pain.

Methods: Post-implementation surveillance included all patients undergoing NRT across five regions within the Spanish National Health Service (SNHS). Validated methods were used to assess pain, disability, adverse events, use of health resources, and patient satisfaction. Logistic regression models were developed to identify the variables associated with the risk of a pain episode requiring more than one NRT intervention. The number of relapses among discharged patients during the 8-year period was calculated.

Results: Between January 1, 2004, and June 30, 2012, 9,023 patients (median age: 53 years), presenting 11,384 subacute (25.2 percent) and chronic (74.8 percent), neck or back pain episodes, were discharged after receiving NRT. Spinal pain improved in 89 percent of cases, 83 percent abandoned drugs, and 0.02 percent required spine surgery. The only adverse event was skin discomfort (8.0 percent of patients). Number of patient complaints was 0, and answers to a standardized questionnaire reflected a high degree of satisfaction (response rate: 76.7 percent). Of the pain episodes, 18.9 percent required more than one NRT intervention; logistic regression models identified the variables associated with this. Over the 8-year period, the proportion of discharged patients referred for treatment due to relapse at the same level for neck, thoracic, and low back pain, was 16.4 percent, 6.5 percent, and 14.5 percent respectively.

Conclusions: Post-marketing surveillance for a non-pharmacological technology is feasible within the SNHS. These results support generalizing NRT across the entire SNHS under the current validated application conditions.

Objectives: The aim of this study was to identify individuals with expertise in ethics analysis in Canada, who might contribute to health technology assessment (HTA); to gauge these individuals’ familiarity with, and experience participating in, the production of HTA.

Methods: A contact list was developed using the Canadian Bioethics Society membership list and faculty listings of Canadian universities, bioethics centers, and health agencies. An eighteen-question email survey was distributed to potential respondents to collect data on demographic information, education and work experience in applied ethics, and involvement in HTA.

Results: The survey response rate was 52.8 percent (350/663). Respondents worked primarily in academic institutions (50.4 percent) or hospitals (15.4 percent). Many respondents (83.1 percent) had education, formal training, or work-related experience in practical ethics related to health care, with many having a doctorate (34.5 percent) or master's degree (19.0 percent). One quarter (24.5 percent; n = 87) of respondents indicated they had been involved in an analysis of ethical issues for HTA. Almost two-thirds (65.4 percent; n = 165) of those who had not previously participated in ethics analysis believed they might usefully contribute to an analysis of ethical issues in HTA. Experts who have conducted ethics analysis in HTA had more than twice the odds of having education and training in ethics and a PhD than those who might contribute to ethics analysis.

Conclusion: Many people have contributed to ethics analysis in HTA in Canada, and more are willing to do so. Given the absence of a reliable credential for ethics expertise, HTA producers should exercise caution when enlisting ethics experts.

Objectives: The aim of this study was to assess if the use of Markov modeling (MM) or discrete event simulation (DES) for cost-effectiveness analysis (CEA) may alter healthcare resource allocation decisions.

Methods: A systematic literature search and review of empirical and non-empirical studies comparing MM and DES techniques used in the CEA of healthcare technologies was conducted.

Results: Twenty-two pertinent publications were identified. Two publications compared MM and DES models empirically, one presented a conceptual DES and MM, two described a DES consensus guideline, and seventeen drew comparisons between MM and DES through the authors’ experience. The primary advantages described for DES over MM were the ability to model queuing for limited resources, capture individual patient histories, accommodate complexity and uncertainty, represent time flexibly, model competing risks, and accommodate multiple events simultaneously. The disadvantages of DES over MM were the potential for model overspecification, increased data requirements, specialized expensive software, and increased model development, validation, and computational time.

Conclusions: Where individual patient history is an important driver of future events an individual patient simulation technique like DES may be preferred over MM. Where supply shortages, subsequent queuing, and diversion of patients through other pathways in the healthcare system are likely to be drivers of cost-effectiveness, DES modeling methods may provide decision makers with more accurate information on which to base resource allocation decisions. Where these are not major features of the cost-effectiveness question, MM remains an efficient, easily validated, parsimonious, and accurate method of determining the cost-effectiveness of new healthcare interventions.

Objectives: The aim of this study was to assist in the development of a health technology assessment (HTA) program for the Ministry of Health (MOH) of the Republic of Kazakhstan

Methods: Mentoring of an initial HTA program in Kazakhstan was provided by the Canadian Society for International Health (CSIH) by means of a partnership with the Kazakhstan MOH. HTA materials, courses, and one-on-one support for the preparation of a series of initial HTA reports by MOH HTA staff were provided by a seven-member CSIH team over a 2.5-year project.

Results: Guidance documents on HTA and institutional strengthening were prepared in response to an extensive set of deliverables developed by the MOH and the World Bank. Introductory and train-the-trainer workshops in HTA and economic evaluation were provided for MOH staff members, experts from Kazakhstan research institutes and physicians. Five short HTA reports were successfully developed by staff in the Ministry's HTA Unit with assistance from the CSIH team. Challenges that may be relevant to other emerging HTA programs included lack of familiarity with some essential underlying concepts, organization culture, and limited time for MOH staff to do HTA work.

Conclusions: The project helped to define the need for HTA and mentored MOH staff in taking the first steps to establish a program to support health policy decision making in Kazakhstan. This experience offers practical lessons for other emerging HTA programs, although these should be tailored to the specific context.

Objectives: The objective of this study was to explore the degree to which databases other than MEDLINE contribute studies relevant for inclusion in rapid health technology assessments (HTA).

Methods: We determined the extent to which the clinical, economic, and social studies included in twenty-one full and four rapid HTAs published by three Canadian HTA agencies from 2007 to 2012 were indexed in MEDLINE. Other electronic databases, including EMBASE, were then searched, in sequence, to assess whether or not they indexed studies not found in MEDLINE. Assessment topics ranged from purely clinical (e.g., drug-eluting stents) to those with broader social implications (e.g., spousal violence).

Results: MEDLINE contributed the majority of studies in all but two HTA reports, indexing a mean of 89.6 percent of clinical studies across all HTAs, and 88.3 percent of all clinical, economic, and social studies in twenty-four of twenty-five HTAs. While EMBASE contributed unique studies to twenty-two of twenty-five HTAs, three rapid HTAs did not include any EMBASE studies. In some instances, PsycINFO and CINAHL contributed as many, if not more, non-MEDLINE studies than EMBASE.

Conclusions: Our findings highlight the importance of assessing the topic-specific relative value of including EMBASE, or more specialized databases, in HTA search protocols. Although MEDLINE continues to be a key resource for HTAs, the time and resource limitations inherent in the production of rapid HTAs require that researchers carefully consider the value and limitations of other information sources to identify relevant studies.

Objectives: Reporting bias potentially threatens the validity of results in health technology assessment (HTA) reports. Our study aimed to explore policies and practices of HTA agencies regarding strategies to include previously unpublished data in their assessments, focusing on requests to industry for unpublished data.

Methods: We included international HTA agencies with publicly available methods papers as well as HTA reports. From the methods papers and recent reports we extracted information on requests to industry and on searches in trial registries, regulatory authority Web sites and for conference abstracts.

Results: Eighteen HTA agencies and seventy-three reports were included. Agencies’ methods papers showed variability regarding requests to industry (requests are routinely carried out in seven cases, not mentioned in six, at the discretion of HTA authors in three, and based on manufacturer applications in two), which were reflected in the reports investigated. As reporting of requests was limited, it often remained unclear whether unpublished data had been received. Searches in trial registries, at regulatory authorities or for conference abstracts are described as a routine or optional part of the search strategy in the methods papers of 9, 11, and 8 included agencies, respectively. A total of 52 percent, 39 percent, and 16 percent of reports described searches in trial registries, at regulatory agencies, and hand searching of conference proceedings.

Conclusion: International HTA agencies currently differ considerably in their efforts to address the issue of unpublished data. Requests to industry may constitute one strategy to access and include unpublished data, while agencies can learn from each other concerning successful practice.

Objectives: Procedures and new medical devices are typically introduced into healthcare systems with limited evidence, when they might be ineffective or unsafe. Systematic data collection (“registers”) can provide valuable “real world” evidence, but difficulties in funding registers are a major obstacle. A good economic case for the value of registers would therefore be useful.

Methods: (i) Literature search on specific purposes of registers. (ii) Surveys (a) of senior clinicians involved with registers, seeking examples of beneficial outcomes, and (b) of administrators, regarding costs of running registers. (iii) A scoping exercise for possible methods to value (financially) the outputs of registers.

Results: Four main categories of beneficial outcomes from registers were identified. These were—safety and quality assurance; training and quality improvement; complementing trial evidence and reducing uncertainty; and supporting trial research. Explicit examples of all these are presented, together with information about the costs of registers. Combining these with the scoping exercise we present suggestions for a methodology of assessing the value of registers across each of the categories.

Conclusions: This study is unique in addressing methods for determining the financial value of registers, based on the amount they cost versus the financial benefits which may result from the evidence generated. Developing the suggested methods could support the case for funding new registers, by showing that their use can benefit healthcare systems through more efficient use of resources, so justifying their costs.

Background: Ethics has been part of health technology assessment (HTA) from its beginning in the 1970s, and is currently part of HTA definitions. Several methods in ethics have been used in HTA. Some approaches have been developed especially for HTA, such as the Socratic approach, which has been used for a wide range of health technologies. The Socratic approach is used in several ways, and there is a need for harmonization to promote its usability and the transferability of its results. Accordingly, the objective of this study was to stimulate experts in ethics and HTA to revise the Socratic approach.

Methods: Based on the current literature and experiences in applying methods in ethics, a panel of ethics experts involved in HTA critically analyzed the limitations of the Socratic approach during a face-to-face workshop. On the basis of this analysis a revision of the Socratic approach was agreed on after deliberation in several rounds through e-mail correspondence.

Results: Several limitations with the Socratic approach are identified and addressed in the revised version which consists of a procedure of six steps, 7 main questions and thirty-three explanatory and guiding questions. The revised approach has a broader scope and provides more guidance than its predecessor. Methods for information retrieval have been elaborated.

Conclusion: The presented revision of the Socratic approach is the result of a joint effort of experts in the field of ethics and HTA. Consensus is reached in the expert panel on an approach that is considered to be more clear, comprehensive, and applicable for addressing ethical issues in HTA.

Objectives: In many economic evaluations and reimbursement decisions, quality-adjusted life-years (QALYs) are used as a measure of benefit to assess effectiveness of novel therapies, often based on the EQ-5D 3-level questionnaire. As only five dimensions of physical and mental well-being are reflected in this tool, significant aspects of the patient experience may be missed. We evaluate the use of the EQ-5D as a measurement of clinical change across a wide range of disorders from dermatological (acne) to life-threatening (metastatic cancers).

Methods: We analyze published studies on the psychometric properties of the EQ-5D 3-level questionnaire, extracting information on the Visual Analogue Scale versus Index score, Standardized Response Mean, and Effect Size. These are compared with ranges generally accepted to represent good responsiveness in the psychometric literature.

Results: We find that only approximately one in five study populations report subjective health state valuation of patients within 5 percent of the score attributed by the EQ-5D index, and more than 40 percent of studies report unacceptable ceiling effects. In the majority of studies, responsiveness of the EQ-5D index was found to be poor to moderate, based on Effect Size (63 percent poor–moderate) and Standardized Response Mean (72 percent poor–moderate).

Conclusions: We conclude that the EQ-5D index does not adequately reflect patient health status across a range of conditions, and it is likely that a significant proportion of the subjective patient experience is not accounted for by the index. This has implications for economic evaluations of novel drugs based on evidence generated with the EQ-5D.

Objectives: When incorporating treatment effect estimates derived from a random-effect meta-analysis it is tempting to use the confidence bounds to determine the potential range of treatment effect. However, prediction intervals reflect the potential effect of a technology rather than the more narrowly defined average treatment effect. Using a case study of robot-assisted radical prostatectomy, this study investigates the impact on a cost-utility analysis of using clinical effectiveness derived from random-effects meta-analyses presented as confidence bounds and prediction intervals, respectively.

Methods: To determine the cost-utility of robot-assisted prostatectomy, an economic model was developed. The clinical effectiveness of robot-assisted surgery compared with open and conventional laparoscopic surgery was estimated using meta-analysis of peer-reviewed publications. Assuming treatment effect would vary across studies due to both sampling variability and differences between surgical teams, random-effects meta-analysis was used to pool effect estimates.

Results: Using the confidence bounds approach the mean and median ICER was €24,193 and €26,731/QALY (95%CI: €13,752 to €68,861/QALY), respectively. The prediction interval approach produced an equivalent mean and median ICER of €26,920 and €26,643/QALY (95%CI: -€135,244 to €239,166/QALY), respectively. Using prediction intervals, there is a probability of 0.042 that robot-assisted surgery will result in a net reduction in QALYs.

Conclusions: Using prediction intervals rather than confidence bounds does not affect the point estimate of the treatment effect. In meta-analyses with significant heterogeneity, the use of prediction intervals will produce wider ranges of treatment effect, and hence result in greater uncertainty, but a better reflection of the effect of the technology.

Background: Increasingly, healthcare decision makers demand quality evidence in a short timeframe to support urgent and emergent decisions related to procurement, clinical practice, and policy. Health technology assessment (HTA) producers are responding by developing innovative approaches to evidence synthesis that can be executed more quickly than traditional systematic review. These approaches, and the broader implications they bring to bear on health decision making and policy development, however, are generally neither well-understood nor well-described. This study intends to contribute to an emerging literature around methodological approaches to rapid review in HTA by outlining those developed and implemented by the Canadian Agency for Drugs and Technologies in Health (CADTH).

Methods: Since 2005, CADTH has developed and implemented a rapid review approach that synthesizes evidence to support informed healthcare decisions and policy. Rapid Response reports are tailored to the identified needs of Canadian health decision makers, representing a range of options with regard to depth, breadth, and time-to-delivery.

Results: Preliminary observations indicate that CADTH's approach to rapid evidence review is generally well-received by Canadian health decision makers; real-world case studies provide pragmatic examples of how health decision makers have used Rapid Response reports to support evidence-informed health decisions across Canada.

Conclusions: Rapid review is becoming an increasingly important approach to evidence synthesis, both within and external to the field of HTA. Transparent reporting of the methods used to develop rapid review products will be critical to the assessment of their relevance, utility and effects in a range of contexts.

Objectives: The use of value of information methods to inform trial design has been widely advocated but there have been few empirical applications of these methods and there is little evidence they are widely used in decision making. This study considers the usefulness of value of information models in the context of a real clinical decision problem relating to alternative diagnostic strategies for patients with a recent non-ST elevated myocardial infarction.

Methods: A pretrial economic model is constructed to consider the cost-effectiveness of two competing strategies: coronary angiography alone or in conjunction with fractional flow reserve measurement. A closed-form solution to the expected benefits of information is used with optimal sample size estimated for a range of models reflecting increasingly realistic assumptions and alternative decision contexts.

Results: Fractional flow reserve measurement is expected to be cost-effective with an incremental cost-effectiveness ratio of GBP 1,621, however, there is considerable uncertainty in this estimate and consequently a large expected value to reducing this uncertainty via a trial. The recommended sample size is strongly affected by the reality of the assumptions of the expected value of information (EVI) model and the decision context.

Conclusions: Value of information models can provide a simple and flexible approach to clinical trial design and are more consistent with the constraints and objectives of the healthcare system than traditional frequentist approaches. However, the variation in sample size estimates demonstrates that it is essential that appropriate model parameters and decision contexts are used in their application.

Background: Health technology reassessment (HTR) is “a structured, evidence-based assessment of the clinical, social, ethical, and economic effects of a technology currently used in the healthcare system, to inform optimal use of that technology in comparison to its alternatives.” The purpose of this study is to describe the key themes in the context of current HTR activities and propose a way forward for this newly emerging field.

Methods: Data were gathered from a workshop held as part of the 2012 Canadian Agency for Drugs and Technology in Health (CADTH) symposium. The workshop consisted of two panel presentations followed by discussion; data gathered, including presentations and rich audience discussion transcripts, were analyzed for key themes emerging in the field of HTR using constant comparative analysis.

Results: The language chosen to describe HTR will set the tone for engagement. The identification of champions at multiple levels and political will are essential. Key lessons from international experience are: disinvestment is difficult, focus on clinical areas not specific technologies, identify clear goals of the HTR agenda. Six key themes were identified to move the HTR agenda forward: emphasize integration over segregation, focus on development of HTR methods and processes, processes are context-specific but lessons must be shared, build capacity in synergistic interdisciplinary fields, develop meaningful stakeholder engagement, strengthen postimplementation monitoring and evaluation.

Conclusions: To move this field forward, we must continue to build on international experiences with a focus on developing novel methodological approaches to generating, incorporating, and implementing evidence into policy and practice.