In recent years, the GRADE system has been adopted internationally to make judgments about evidence and/or recommendations. Recently, the Spanish Network of HTA (RedETS) has promoted among its members the use of the GRADE system, especially the “Evidence to Decision” tool (EtD) where a multidisciplinary panel is involved. The objective is to describe the methodological approach with the first AQuAS experience using this methodology in HTA, focused on inclusion/exclusion of these technologies in the Spanish National Health Service (NHS) portfolio.

The standard EtD tool was used for clinical and financial decisions. Four multidisciplinary panels were constituted by relevant professionals in clinical practice and, where possible, patients. The four panels discussed on the following four interventions: in two cases, AQuAS prepared preliminary recommendations and participants provided feedback, while in the other two cases, experts received the evidence review and were asked to formulate recommendations. These recommendations were voted on and, in the case of disagreement, adapted and then voted on for a second time. Finally, any discrepancies were noted in the report. Evaluated interventions were: maxillofacial 3D-reconstruction, cataract surgery equipment, non-invasive surgery in obesity and pharmacological treatment in secondary fracture prevention.

Especially when more than one evaluative question was addressed in the HTA report the EtD and the consensus results required discussion. Consensus was fast but not immediate. Meeting length depended on the number of HTA questions and the amount of original disagreement in the recommendations. The nuances on how to write recommendations also affected the panel duration. All panels were successful in formulating the final recommendations.

Standardizing methodologies increased the homogeneity across HTA reports. The GRADE system is a feasible and useful tool because it favors transparency and rigor in drawing up recommendations on the inclusion/exclusion of technologies in the NHS portfolio. The EtD framework complements GRADE tables, which display the relevant evidence in a way that can be used by multidisciplinary groups to reach a consensual recommendation.

Although all participants received a short training video, more experience in the use of these methodologies might shorten the duration of the process and facilitate reaching consensus. Some considerations on how to overcome the difficulties and complexity of this methodological approach are discussed.