Text is a major medium of contemporary interpersonal communication but is difficult for social scientists to study unless they have significant resources or the skills to build their own research platform. In this paper, we introduce a cloud-based software solution to this problem: ReChat, an online research platform for conducting experimental and observational studies of live text conversations. We demonstrate ReChat by applying it to a specific phenomenon of interest to political scientists: conversations among co-partisans. We present results from two studies, focusing on (1) self-selection factors that make chat participants systematically unrepresentative and (2) a pre-registered analysis of loquaciousness that finds a significant association between speakers’ ideological extremity and the amount they write in the chat. We conclude by discussing practical implications and advice for future practitioners of chat studies.

Empathy has been proposed as a solution to alleviate interparty antipathy. Recent findings from the US suggest that one aspect of empathy – empathic concern – increases rather than decreases affective polarization. Perspective-taking, another aspect of empathy, has no effect on affective polarization. In this article, we describe a preregistered replication and extension of these findings in the contrasting political context of the Netherlands, to see whether this relationship generalizes beyond the US. First, using a cross-sectional nationally representative sample of 1,258 Dutch voters, we show that empathic concern indeed fuels affective polarization while at the same time we find that perspective-taking reduces it. Second, using a two-arm survey experiment (n = 438), we show that perspective-taking reduces ingroup bias, whereas empathic concern does not. Reflecting on the American and Dutch findings, we conclude that while empathic concern likely contributes to affective polarization, perspective-taking may reduce it.

Every year, Americans elect hundreds of thousands of candidates to local public office, typically in low-attention, nonpartisan races. How do voters evaluate candidates in these sorts of elections? Previous research suggests that, absent party cues, voters rely on a set of heuristic shortcuts – including the candidate’s name, profession, and interest group endorsements – to decide whom to support. In this paper, we suggest that community embeddedness – a candidate’s roots and ties to the community – is particularly salient in these local contests. We present evidence from a conjoint survey experiment on a nationally representative sample of American voters. We estimate the marginal effect on vote share of candidate attributes such as gender, race, age, profession, interest group endorsements, and signals of community embeddedness – specifically homeownership and residency duration. We find that voters, regardless of political party, have strong preferences for community embeddedness. Strikingly, the magnitude of the residency duration effect rivals that of prior political experience.

Conjoint experiments have enabled scholars to understand the preferences of citizens in a variety of political contexts. We propose a method to modify the standard text-only “box conjoint” to make the treatment higher in external validity with respect to a common target context. Citizens frequently encounter political information encoded as images and in particular in the form of politicians’ social media posts and profiles. We deploy “visual conjoint” experiments where subjects select between two images that encode the same explicit information as is standard in the box conjoint. We conduct an experiment in which we randomize the modality of a conjoint experiment where subjects evaluate the Twitter profiles of hypothetical candidates. We demonstrate that the visual conjoint more effectively encodes image-based information and social endorsement information. The visual conjoint also allows the salience of different attributes to vary naturally the way they do on social media, in contrast to the artificially enforced uniformity of the box conjoint.

This study explores the impact of vulnerability appeals during the COVID-19 pandemic using a nationally representative, preregistered survey experiment (N = 4,087) conducted in mid-2021. We explore whether providing citizens with information about the vulnerability of ethnic minority and disabled citizens to COVID-19 fosters empathy and increased support for behavioral restrictions. We observe minimal statistically significant or substantive effects, although the presence of subtle effects cannot be entirely ruled out. We identify some limited indications that individuals with disabilities exhibit increased support for restrictions when exposed to information about the vulnerability of disabled people to COVID-19, but these effects are inconsistent. Therefore, our findings provide limited evidence to confirm or rule out that using vulnerability appeals alone is effective for influencing public attitudes toward behavioral restrictions. The findings point toward avenues for future research, including a closer examination of heterogeneous responses to public health messaging among population subgroups.

As survey experiments have become increasingly common in political science, some scholars have questioned whether inferences about the real world can be drawn from experiments involving hypothetical, text-based scenarios. In response to this criticism, some researchers recommended using realistic, context-heavy vignettes while others argue that abstract vignettes do not generate substantially different results. We contribute to this debate by evaluating whether incorporating contextually realistic graphics into survey experiment vignettes affects experimental outcomes. We field three original experiments that vary whether respondents are shown a realistic graphic or a plain text description during an international crisis. In our experiments, varying whether respondents are shown realistic graphics or plain text descriptions generally yields little difference in outcomes. Our findings have implications for survey methodology and experiments in political science – researchers may not need to invest the time to develop contextually realistic graphics when designing experiments.

This article investigates the effect of priming the existence of corrupt connections to the bureaucracy and of trusted references on the demand for intermediary services. We performed an experimental survey with undergraduate students in Caracas, Venezuela. Participants are presented with a hypothetical situation in which they need to obtain the apostille of their professional degrees in order to migrate and are considering whether to hire an intermediary (“gestor”) or not. The survey randomly reveals the existence of an illicit connection between the gestor and the bureaucracy and whether a trusted individual referred the intermediary. Our findings are not consistent with the “market maker” hypothesis that revealing the existence of illicit connections increases demand. Consistent with the view that trust is a key element in inherently opaque transactions, we find that the demand for intermediaries is price inelastic when gestores are referred by trusted individuals.

Opposition in autocracies often uses negativism against the regime to frame its principal message. This study is the first to experimentally evaluate the effectiveness of a negative campaign on a regime candidate’s vote share. For the field experiment conducted during the 2013 Moscow mayoral election, we published a newspaper criticizing the incumbent mayor. We distributed approximately 130,000 copies near the entrances of 20 stations on four randomly selected metro lines one month prior to the election. We found that the incumbent’s vote share was 1.7 percentage points lower at the voting stations where the newspaper was distributed. These votes go to other candidates who address issues raised by the negative campaign. Anti-regime campaigning does not suppress turnout or increase disapproval voting.

What are the psychological mechanisms of racial “dog whistles” in American politics? Literature on race priming in American politics argues when race is primed implicitly, racial biases influence political evaluations, but when race is made salient, individuals can use controlled processing to inhibit automatic biases and abide by egalitarian norms. However, the neural mechanisms underlying these processes have yet to be examined directly. In a 2 × 2 within-groups experiment using functional magnetic resonance imaging, we examine these neural mechanisms. We find brain areas associated with conflict detection, evaluative processing, and controlled processing are more active when race is primed explicitly rather than implicitly, as expected, although we do not find substantial brain activation associated with automatic responses to be more active during implicit than explicit primes. Results are discussed in terms of understanding how racial cues influence political evaluations while considering America’s ever-changing racial norms.

Unethical behavior among US judges, including sexual misconduct and other forms of discriminatory behavior, is becoming increasingly publicized. These controversies are particularly concerning given the important role judges play in shaping policy pertaining to individual rights. We argue that types of misconduct serve as a signal to the public about potential threats judges may pose to people, particularly groups of people who are marginalized. We use a survey experiment that introduces a judge who has engaged in misconduct to measure if the type of misconduct will influence attitudes on whether the judge poses a threat to the rights of women, racial minorities, and ethnic minorities. Interestingly, we find that judges accused of discriminatory misconduct toward one group are viewed as a threat to rights across the board and are seen as less able to rule fairly on matters pertaining to marginalized people more generally.

Many international organizations (IOs) rely on voluntary contributions from member states and private actors to fund their operations. Donations from individuals are a significant and increasing income source for these IOs, who rely on marketing strategies such as celebrity endorsement, in the form of Goodwill Ambassadors, to help raise funds. Little is known, however, about the effectiveness of this strategy in the context of IOs although intuition from literatures in marketing and psychology suggests that celebrity endorsement should be effective. We conduct a survey experiment to investigate the effectiveness of Goodwill Ambassadors and, contrary to expectations, find no average effect of celebrity endorsement on donations to, and interest in, IOs and only limited effects among certain sub-groups. We speculate that the context of IOs makes it harder to generate the type of connection between celebrity and cause necessary to make endorsement effective and suggest that further investigation is needed.

Recent research suggests that a strong identity attachment to leisure activity affects the hobbyists’ political preferences and behavior. This paper further evaluates the claim that hobbyists – in this case, gamers – react differently to political stimuli that directly involve their hobby of choice. Using original survey experiment data, this paper shows that gamers become more interested in foreign trade policy when presented in the context of video games. This finding indicates that even seemingly apolitical identities matter in framing political behavior. Aspects of hobbyist identities seep into political attitudes, even if preferences in the strictest meaning of the word may take longer to form.

Education is widely believed to predict attitudes toward immigration, but what causal relationship underlies this descriptive pattern? This research employs three distinct natural experiments and considers genetic factors to triangulate this relationship: Study 1 analyses discordant monozygotic twins; Study 2 assesses the impact of a Swedish education reform; and Study 3 analyses dizygotic twins with the use of a polygenic index for education, a DNA-based measure for genetic predispositions toward education. The results indicate that education does modestly promote open views toward immigration (Study 1), yet the reform’s effect remains uncertain (Study 2). Study 3 offers direct evidence of the effects of genetic predispositions and suggests that genetics related to education may influence attitudes beyond achieved educational attainment. These findings confirm the positive impact of education while pointing to the combined influence of genetic and social pathways in shaping immigration attitudes.

What shapes voter perceptions of election outcomes? Recent disputes in Malawi and Kenya highlight the vulnerability of local vote counts to accusations of malfeasance, which often generate negative public perceptions of vote reliability. Election monitoring in these countries is thought to crucially affect both the quality of the election and voters’ perceptions of the same. To date, most research on this topic has focused on the effect of non-partisan electoral observers. However, in many countries, two other interest groups also monitor the vote-counting process: political party agents and government election officials. Does the presence of these actors also affect voter perceptions of election integrity? To answer this question, I conducted a conjoint experiment in Malawi and Kenya in which voters evaluate the reliability of vote counts from hypothetical polling stations where the presence of party agents, non-partisan observers, and election officials is varied. I find that the presence of each of these groups does indeed shape voter perceptions: voters are more likely to view vote counts as reliable when they are co-signed by a party agent, election official, or non-partisan observer. Further, these preferences persist regardless of the voters’ own party affiliation or trust in electoral institutions.

Research on policy shifts has found that repositioning can be costly as it affects candidates’ perceived honesty, reliability, and competence. It remains unclear, however, whether a politician’s gender affects perceptions of repositioning. Research on gender stereotypes has found that while male politicians are viewed as more competent, decisive, and displaying strong leadership, female politicians are believed to be more honest. Applying expectancy-violation theory, I test the hypothesis that the reputational cost of repositioning is more pronounced for female politicians in a preregistered survey experiment fielded on a large convenience sample in Flanders, Belgium (n = 6,957). I find that while frequent repositioning is evaluated negatively, the negative effect of repositioning is not more pronounced for female candidates than for male candidates on most outcome measures.

As many American states have considered policies consistent with democratic backsliding in recent years, political elites and scholars have speculated on the consequences of these policies for political behavior. We examine the effect of backsliding policies on Americans’ preferences over leisure travel destinations; because vacationing is transitory, this focus allows us to isolate the role of individuals’ democratic predispositions and values in preference formation from the implications of these policies on their self-interest that they would experience from living under those policies themselves. Through pre-registered conjoint and vignette survey experiments, we find that Americans, and especially Democrats, express less interest in vacationing in states that recently adopted backsliding policies. Our results spotlight an accountability mechanism by which Americans may sanction backsliding states, though the modest magnitude of these sanctions – less than 1% of backsliding states’ gross domestic products – may not deter backsliding behavior on their own.

Presidents possess vast authority over policies and outcomes. Recent studies suggest the public checks this unilateralism through expressive opinions and political participation. We reevaluate this accountability link with a preregistered panel survey that incorporates a number of design and conceptual improvements over existing experimental studies. Our findings reveal a more complex relationship between presidential actions and public opinion. We find no evidence that the public reacts negatively to unilateralism – and some evidence they react positively. Respondents, however, may punish an incumbent for failing to implement the proposed policy change. While such a result suggests that the public can hold presidents accountable, we close by discussing how a lack of information likely renders this check moot.

Survey experiments often yield intention-to-treat effects that are either statistically and/or practically “non-significant.” There has been a commendable shift toward publishing such results, either to avoid the “file drawer problem” and/or to encourage studies that conclude in favor of the null hypothesis. But how can researchers more confidently adjudicate between true, versus erroneous, nonsignificant results? Guidance on this critically important question has yet to be synthesized into a single, comprehensive text. The present essay therefore highlights seven “alternative explanations” that can lead to (erroneous) nonsignificant findings. It details how researchers can more rigorously anticipate and investigate these alternative explanations in the design and analysis stages of their studies, and also offers recommendations for subsequent studies. Researchers are thus provided with a set of strategies for better designing their experiments, and more thoroughly investigating their survey-experimental data, before concluding that a given result is indicative of “no significant effect.”

Scholars of International Organizations (IOs) increasingly use elite surveys to study the preferences and decisions of policymakers. When designing these surveys, one central concern is low statistical power, because respondents are typically recruited from a small and inaccessible population. However, much of what we know about how to incentivize elites to participate in surveys is based on anecdotal reflections, rather than systematic evidence on which incentives work best. In this article, we study the efficacy of three incentives in a preregistered experiment with World Bank staff. These incentives were the chance to win an Amazon voucher, a donation made to a relevant charity, and a promise to provide a detailed report on the findings. We find that no incentive outperformed the control group, and the monetary incentive decreased the number of respondents on average by one-third compared to the control group (from around 8% to around 5%).

What are the relative contributions of stereotypes about the race and deservingness of welfare recipients to Americans’ opinions on welfare? A recent study employing a conjoint-experimental method finds that Americans’ stereotypes of welfare recipients as undeserving drive negative attitudes toward welfare, while stereotypes of welfare recipients as Black have little effect. However, this finding may be produced by the measure of welfare attitudes that includes questions implicating deservingness. We implement a conceptual replication of that study using different measures of welfare policy opinions that directly ask respondents about spending, both on welfare generally and on specific welfare programs. We show that when support for welfare is measured using the spending questions, stereotypes about race are significantly associated with opposition to welfare. These results have important implications for the debate on Americans’ opposition to welfare programs, as well as for the measurement of policy opinions in surveys.