When researchers design an experiment, they usually hold potentially relevant features of the experiment constant. We call these details the “topic” of the experiment. For example, researchers studying the impact of party cues on attitudes must inform respondents of the parties’ positions on a particular policy. In doing so, researchers implement just one of many possible designs . Clifford, Leeper, and Rainey (2023. “Generalizing Survey Experiments Using Topic Sampling: An Application to Party Cues.” Forthcoming in Political Behavior. https://doi.org/10.1007/s11109-023-09870-1) argue that researchers should implement many of the possible designs in parallel—what they call “topic sampling”—to generalize to a larger population of topics. We describe two estimators for topic-sampling designs: First, we describe a nonparametric estimator of the typical effect that is unbiased under the assumptions of the design; and second, we describe a hierarchical model that researchers can use to describe the heterogeneity. We suggest describing the heterogeneity across topics in three ways: (1) the standard deviation in treatment effects across topics, (2) the treatment effects for particular topics, and (3) how the treatment effects for particular topics vary with topic-level predictors. We evaluate the performance of the hierarchical model using the Strengthening Democracy Challenge megastudy and show that the hierarchical model works well.

The success of protests depends on whether they favorably affect public opinion: nonviolent resistance can win public support for a movement, but regimes counter by framing protest as violent and instigated by outsiders. The authors argue that public perceptions of whether a protest is violent shift based on the framing of the types of action and the identities of participants in those actions. The article distinguishes between three dimensions: (1) threat of harm, (2) bearing of arms and (3) identity of protesters. Using survey experiments in Israel and the United States, the study finds support for framing effects. Threat of harm has the largest positive effect on perceptions of violence and support for repression. Surprisingly, social out-groups are not perceived as more violent, but respondents favor repressing them anyway. Support for repressing a nonthreatening out-group is at least as large as support for repressing a threatening in-group. The findings link contentious action and public opinion, and demonstrate the susceptibility of this link to framing.

Traditionally, benefit-cost analyses focus on average benefits and average costs. However, heterogeneous treatment effects and/or costs are most often present, which means that there is an efficiency potential hidden in the implementation of public programs, if policies can be targeted at those who, net of costs, benefit the most. We introduce efficiency potential defined as the ratio between the net benefit achieved under perfect selection of the individuals with significant positive net benefit of program participation, and the actually realized benefits net of costs. Using data from a randomized control-trial experiment of a Danish return-to-work program combined with rich administrative records and survey data, we find that there is indeed a potential for increased efficiency. Results from the treatment literature indicate that, generally, it may be difficult to harvest the full potential. Our application corroborates this finding.