Political elites increasingly express interest in evidence-based policymaking, but transparent research collaborations necessary to generate relevant evidence pose political risks, including the discovery of sub-par performance and misconduct. If aversion to collaboration is non-random, collaborations may produce evidence that fails to generalize. We assess selection into research collaborations in the critical policy arena of policing by sending requests to discuss research partnerships to roughly 3,000 law enforcement agencies in 48 states. A host of agency and jurisdiction attributes fail to predict affirmative responses to generic requests, alleviating concerns over generalizability. However, across two experiments, mentions of agency performance in our correspondence depressed affirmative responses – even among top-performing agencies – by roughly eight percentage points. Many agencies that initially indicate interest in transparent, evidence-based policymaking recoil once performance evaluations are made salient. We discuss several possible mechanisms for these dynamics, which can inhibit valuable policy experimentation in many communities.

By exacerbating a pre-existing crisis of childcare in the United States, the COVID-19 pandemic forced many parents to renegotiate household arrangements. What shapes parents’ preferences over different arrangements? In an online conjoint experiment, we assess how childcare availability, work status and earnings, and the intra-household division of labor shape heterosexual American parents’ preferences over different situations. We find that while mothers and fathers equally value outside options for childcare, the lack of such options – a significant feature of the pandemic – does not significantly change their evaluations of other features of household arrangements. Parents’ preferences over employment, earnings, and how to divide up household labor exhibit gendered patterns, which persist regardless of childcare availability. By illustrating the micro-foundations of household decision-making under constraints, our findings help to make sense of women’s retrenchment from the labor market during the pandemic: a pattern which may have long-term economic and political consequences.

Political parties and civic organizations disseminate information to improve citizen decision making in local elections. Do citizens choose to consume such information and, if so, how does it affect their decisions? We conduct a survey experiment during a real-world local election that randomly assigns 1) political party endorsements, 2) a voter guide, 3) no information, or 4) a choice among these options. Respondents assigned to receive party endorsements and a voter guide are more likely than respondents receiving no information to choose candidates who share their policy views. When given a choice, a majority opts to receive information (including many with low levels of political interest), with most respondents preferring a voter guide. Using an instrumental variable approach, we show that the effect of information on those who choose to receive it is substantial. These results offer hope that voter education efforts can succeed despite widespread political disinterest.

Public health officials have faced resistance in their efforts to promote mask-wearing to counter the spread of COVID-19. One approach to promoting behavior change is to alert people to the fact that a behavior is common (a descriptive norm). However, partisan differences in pandemic mitigation behavior mean that Americans may be especially (in)sensitive to information about behavioral norms depending on the party affiliation of the group in question. In July–August 2020, we tested the effects of providing information to respondents about how many Americans, co-partisans, or out-partisans report wearing masks regularly on both mask-wearing intentions and on the perceived effectiveness of masks. Learning that a majority of Americans report wearing masks regularly increases mask-wearing intentions and perceived effectiveness, though the effects of this information are not distinguishable from other treatments.

During the COVID-19 pandemic, the CDC and the WHO have recommended face masks as key to reducing viral transmission. Yet, in the USA, as the first wave erupted in the Summer of 2020, one-fifth of individuals said they wore masks at most “some of the time”, and a majority said that people in their community wore masks at most “some of the time”. What strategies most effectively encourage compliance with this critical COVID-19 prevention measure? Relying on social identity theory, we experimentally assess two possible mechanisms of compliance, elite endorsement, and social norms, among a representative sample of white US-born Evangelicals, a group that has shown resistance to prevention measures. We find evidence for both mechanisms, but social norms play a remarkably important role – increasing support for mask-wearing by 6% with spillover effects on other prevention guidelines. Our findings confirm the role that appeals to norms and elite endorsements play in shaping individual behavior and offer lessons for public health messaging.

Researchers face difficult decisions about whether to ask potential moderators before or after a survey experiment. Competing concerns exist about priming respondents before the experiment and about introducing post-treatment bias. We replicate the classic “welfare” versus “assistance to the poor” survey experiment, randomly assigning respondents to be asked a battery of racial resentment questions either before or after the question wording experiment. We find little evidence that the question wording effect is different between those who are asked about racial resentment before versus after the experiment. Furthermore, we find little evidence that measured racial resentment is affected by this ordering or by the question wording treatment itself.

An increasing number of states permit dual citizenship, but there are public concerns about divided loyalties of dual citizens which might lead to intolerance of their political rights. We propose and test whether these concerns depend on the emotional versus instrumental reasons immigrants express for acquiring their second, host society citizenship. Using a survey experiment on a nationally representative sample of native-born Dutch, we find that emotional (vs. instrumental) reasons for a second citizenship lead to higher perceived host society loyalty, which is related to greater political tolerance of dual citizens. Instrumental reason for dual citizenship leads to higher perceived loyalty to the country of origin; however, this is not related to political tolerance of such dual citizens. Implications for theory and society are considered.

A substantial body of research has found biased recruitment in a variety of societal spheres. We study selection in the judiciary, a domain that has received less attention than the economic and political spheres. Our field experiment took place in the midst of a Swedish government campaign encouraging ordinary citizens to contact local parties, which are responsible for recruiting lay judges (jurors) and put themselves forward as lay judge candidates. Parties’ responsiveness to citizen requests does not seem to favor their own sympathizers, does not vary at all with signals of gender, and is only marginally affected by ethnicity and age. Given the potential importance of ideology and identity in judicial decision-making, the finding that there is little bias with respect to these factors at this first stage of the recruitment process is reassuring from the perspective of impartiality.

Much of the contemporary literature on populism focuses on its status as a “thin” ideology comprising three key components: people-centrism, anti-elitism, and anti-pluralism. Populist politicians pair this “thin” ideology with extreme positions on policy issues such as immigration or taxation (referred to as “host” or “thick” ideologies). A recent study using German samples leveraged conjoint experiments to disentangle the effects of these appeals on vote choice. The results not only showed that extreme host-ideological positions mattered more than so-called “thin” populist appeals, but also that effects of populist appeals were nearly identical among populist and non-populist voters. Our replication in the US context reaffirms both the importance of host-ideological positions and the lack of heterogeneous effects by voters’ “thin” populist attitudes. Furthermore, by uncovering some divergence from the German case (e.g. anti-elite appeals trumping people-centric appeals), we highlight the need to experimentally examine the effects of populism’s constituent components across contexts.

We hired a well-known market research firm whose surveys have been published in leading political science journals, including JEPS. Based on a set of rigorous “screeners,” we detected what appears to be exceedingly high rates of identity falsification: over 81 percent of respondents seemed to misrepresent their credentials to gain access to the survey and earn compensation. Similarly high rates of presumptive character falsification were present in panels from multiple sub-vendors procured by the firm. Moreover, we found additional, serious irregularities embedded in the data, including evidence of respondents using deliberate strategies to detect and circumvent one of our screeners, as well as pervasive, observable patterns reflecting that the survey had been taken repeatedly by a respondent or collection of respondents. This evidence offers reasons to be concerned about the quality of online nonprobability, subpopulation samples, and calls for further, systematic research.

To successfully address large-scale public health threats such as the novel coronavirus outbreak, policymakers need to limit feelings of fear that threaten social order and political stability. We study how policy responses to an infectious disease affect mass fear using data from a survey experiment conducted on a representative sample of the adult population in the USA (N = 5,461). We find that fear is affected strongly by the final policy outcome, mildly by the severity of the initial outbreak, and minimally by policy response type and rapidity. These results hold across alternative measures of fear and various subgroups of individuals regardless of their level of exposure to coronavirus, knowledge of the virus, and several other theoretically relevant characteristics. Remarkably, despite accumulating evidence of intense partisan conflict over pandemic-related attitudes and behaviors, we show that effective government policy reduces fear among Democrats, Republicans, and Independents alike.

A consistent finding in industrialized democracies is that having a daughter shapes parents’ attitudes and behaviors in gender-egalitarian ways. We test whether this finding travels to a young middle-income democracy where women’s rights are more tenuous: South Africa. Using a dataset of over 7,500 respondents with information on family structure, we find no discernible effect on attitudes about women’s rights or on partisan identification. We speculate that our null findings relate to opportunity: daughter effects are more likely when parents perceive economic, social, and political opportunities for women. When women’s customary status and de facto opportunities are low, as in South Africa, having a daughter may have no effect on parents’ political behavior. Our results demonstrate the virtues of diversifying case selection in political behavior beyond economically wealthy democracies.

Recent efforts to improve attitudes toward outgroups and reduce support for extremists in violent settings report mixed results. Donors and aid organizations have spent millions of dollars to amplify the voices of moderate religious figures to counter violent extremism in West Africa, the Middle East, and South Asia. Despite this investment, we know little about whether such messaging persuades the primary recruits of violent extremist organizations: at-risk youth in fragile settings. In this paper, we consider whether pro-peace religious messaging can promote social cohesion among school-age respondents in Burkina Faso. Using a survey experiment, we find little evidence that such messages affect reported attitudes or behaviors toward religious extremism and find instead that it can have the unintended effect of increasing intolerance toward ethnic others. Our findings carry lessons about the inadvertent priming of ethnic identities that can result in a backlash effect among certain societal segments.

Email can deliver mobilization messages at considerably lower cost than direct mail. While voters’ email addresses are readily available, experimental work from 2007 to 2012 suggests that email mobilization is ineffective in most contexts. Here, we use public data to reexamine the effectiveness of email mobilization in the 2016 Florida general election. Unsolicited emails sent from a university professor and designed to increase turnout had the opposite effect: emails slightly demobilizing voters. While the overall decrease in turnout amounted to less than 1 percent of the margin of victory in the presidential race in the state, the demobilizing effect was particularly pronounced among minority voters. Compared to voters from the same group who were assigned to control, black voters assigned to receive emails were 2.2 percentage points less likely to turn out, and Latino voters were 1.0 percentage point less likely to turn out. These findings encourage both campaigns and researchers to think critically about the use and study of massive impersonal mobilization methods.

Discussions around declining trust in the US media can be vague about its effects. One classic answer comes from the persuasion literature, in which source credibility plays a key role. However, existing research almost universally takes credibility as a given. To overcome the potentially severe confounding that can result from this, we create a hypothetical news outlet and manipulate to what extent it is portrayed as credible. We then randomly assign subjects to read op-eds attributed to the source. Our credibility treatments are strong, increasing trust in our mock source until up to 10 days later. We find some evidence that the resulting higher perceived credibility boosts the persuasiveness of arguments about more partisan topics (but not for a less politicized issue). Though our findings are mixed, we argue that this experimental approach can fruitfully enhance our understanding of the interplay between source trust and opinion change over sustained periods.

Overcoming vaccine hesitancy is critical to containing the COVID-19 pandemic in the United States. To increase vaccination rates, the State of Ohio launched a million dollar lottery in May 2021. Following a pre-registered analysis, we estimate the effects of Ohio’s lottery program Vax-a-Million on COVID-19 vaccination rates by comparing it to a “synthetic control” composed of eight other states. We find a statistically insignificant 1.3% decrease in the full vaccination rate in Ohio at the end of the lottery period. We investigate the robustness of our conclusion to model specifications through a multiverse analysis of 216 possible models, including longer time periods and alternative vaccination measures. The majority (88%) find small negative effects in line with the results of our pre-registered model. While our results are most consistent with a decrease in vaccination rate, they do not allow a firm conclusion on whether the lottery increased or decreased vaccine uptake.

The number of multiracial candidates seeking office is growing in an increasingly diverse America. This raises questions about how the media frame candidates with potentially complex racial backgrounds and how voters respond to these frames. We investigate the impact of media frames that emphasize race and gender attributes using survey experiments on Kamala Harris—the first Black woman and first Asian woman vice president. Our findings are mixed. In a survey experiment conducted after her nomination, headlines emphasizing different elements of Harris’s race or gender had no impact on public attitudes. In an experiment conducted after Harris was inaugurated, however, headlines that cued her gender only or both her gender and her Black racial background boosted popular support. Taken together, these findings suggest that some types of identity-based cues may matter, but the effects are sensitive to experimental settings and contexts.

Political actors face a trade-off when they try to influence the beliefs of voters about the effects of policy proposals. They want to sway voters maximally, yet voters may discount predictions that are inconsistent with what they already hold to be true. Should political actors moderate or exaggerate their predictions to maximize persuasion? I extend the Bayesian learning model to account for confirmation bias and show that only under strong confirmation bias are predictions far from the priors of voters self-defeating. I use a preregistered survey experiment to determine whether and how voters discount predictions conditional on the distance between their prior beliefs and the predictions. I find that voters assess predictions far from their prior beliefs as less credible and, consequently, update less. The paper has important implications for strategic communication by showing theoretically and empirically that the prior beliefs of voters constrain political actors.

Mobile communication technologies can provide citizens access to information that is tailored to their specific circumstances. Such technologies may therefore increase citizens’ ability to vote in line with their interests and hold politicians accountable. In a large-scale randomized controlled trial in Uganda (n = 16,083), we investigated whether citizens who receive private, timely, and individualized text messages by mobile phone about public services in their community punished or rewarded incumbents in local elections in line with the information. Respondents claimed to find the messages valuable and there is evidence that they briefly updated their beliefs based on the messages; however, the treatment did not cause increased votes for incumbents where public services were better than expected nor decreased votes where public services were worse than anticipated. The considerable knowledge gaps among citizens identified in this study indicate potential for communication technologies to effectively share civic information. Yet the findings imply that when the attribution of public service outcomes is difficult, even individualized information is unlikely to affect voting behavior.