To understand the importance of the preference methods criteria to stakeholders at each decision point in the Medical Product Lifecycle (MPLC) and to determine the suitability of commonly applied preference methods (Discrete Choice Experiment [DCE], swing weighting [SW], probabilistic threshold technique [PTT], Best-Worst Scaling case 1 [BWS1], Best-Worst Scaling case 2 [BWS2]) for a given decision-point.

Nineteen preference methods criteria of an existing performance matrix were incorporated in an online survey of industry, regulatory, and health technology assessment (HTA) stakeholders. All methods criteria were given a relative weight based on the SW ranking and point allocation task in the survey. Based on this relative weight and the performance matrix values, an overall suitability score was calculated for each method per critical decision point along the MPLC. Several sensitivity analyses were conducted for which the performance matrix was adapted.

In total 59 industry, 29 regulatory, and 5 HTA representatives completed the survey. In general, ‘estimating trade-offs between characteristics’, and ‘estimating weights for treatment characteristics’ were important preference method criteria throughout all MPLC decision points, while other preference method criteria were most important only for specific MPLC stages. Both BWS1 and BWS2 seem equally suitable across decision points, DCEs seem most suitable during clinical development and regulatory launch, and SW and PTT seem most suitable throughout industry decision points. Sensitivity analysis showed substantial impact of slight changes in the performance matrix.

With rapid changes in preference research, performance matrices of preference methods should continue to be re-evaluated as more and more evidence accumulates. While DCE is the most applied preference elicitation method, other methods should also be considered to address the needs of MPLC stakeholders. Development of evidence-based guidance documents for designing, conducting, and analyzing such methods could enhance their use.