Due to the specific characteristics and challenges of mobile health (mHealth) technologies there is a need to have assessment tools based on their particularities to be used by health technology assessment (HTA) agencies and evaluation experts. In the development of a comprehensive and practical evaluation tool for the evaluation of mHealth solutions we aimed to include the views and opinions of key stakeholders: health professionals, developers, hospital managers, HTA agencies, patients and general public.

Focus groups and an online modification of the Delphi technique are being used to discuss and agree on domains and criteria to be included in the mHealth assessment tool. Domains and criteria used for health apps evaluation were drawn from a literature review on the topic. The initial list includes 95 criteria grouped into the following domains: purpose of the app, privacy and security, clinical effectiveness, content of the intervention, user experience and usability, interoperability, expenses, impact on the organization, and legal and ethical aspects. Data coming from focus groups is currently being analyzed from a thematic and content analysis perspective.

Focus groups with professionals have showed that the most important domains to be considered when evaluating health apps are those related with security, user experience, and clinical effectiveness. Some criteria were considered to be mandatory (mainly regarding safety issues), on which a first step assessment should indicate whether the app ‘pass or fails’ for the subsequent throughout assessment. Focus groups with patients will provide insight on critical aspects related to the choice, use and adherence to a health app.

Insights from main stakeholders on the design of the tool for mHealth assessment are relevant and complementary between them. Next steps include (i) the agreement of criteria by using an online modification of the Delphi Technique and (ii) piloting of the tool.