In a recent article published in Politics & Gender, Michael Jankowski and Kamil Marcinkiewicz (2019) study the effects of gender quotas on the electoral performance of female candidates in open-list proportional representation (OLPR) systems. On the empirical side, their study is a critical reanalysis of the Polish case, in particular the regularities demonstrated in a 2014 study that I coauthored. We argued there that at the micro level (candidate level), the effects of quotas were somewhat “paradoxical”: following the installation of quotas, women candidates tend to perform worse relative to their male counterparts than they did during the pre-quota period. Jankowski and Marcinkiewicz claim to demonstrate that those “paradoxical” effects are minor and thus practically negligible. In this note, I argue that their conclusion is largely a result of the particular methodological choices made by these authors. These choices seem unobvious, debatable, and potentially controversial. The note concludes that we need more reflection and debate on the methodological aspects of analyzing candidates’ electoral success in complex electoral systems, such as multidistrict OLPR. This would greatly facilitate future efforts aimed at an unequivocal examination of the contentious concepts such as the notion of “paradox of gender quotas.”