Hostname: page-component-cd9895bd7-p9bg8 Total loading time: 0 Render date: 2024-12-23T05:19:37.645Z Has data issue: false hasContentIssue false

Playing with words: Do people exploit loaded language to affectothers’ decisions for their own benefit?

Published online by Cambridge University Press:  01 January 2023

Valerio Capraro*
Affiliation:
Middlesex University London, United Kingdom
Andrea Vanzo
Affiliation:
Artificialy SA, Switzerland
Antonio Cabrales
Affiliation:
Universidad Carlos III de Madrid, Spain
Rights & Permissions [Opens in a new window]

Abstract

We report on three pre-registered studies testing whether people in the positionof describing a decision problem to decision-makers exploit this opportunity fortheir benefit, by choosing descriptions that may be potentially beneficial forthemselves. In Study 1, recipients of an extreme dictator game (where dictatorscan either take the whole pie for themselves or give it entirely to thereceiver) are asked to choose the instructions used to introduce the game todictators, from six different instructions known from previous research toaffect dictators’ decisions. The results demonstrate that some dictatorgame recipients tend to choose instructions that make them more likely toreceive a higher payoff. Study 2 shows that people who choose descriptions thatmake them more likely to receive a higher payoff indeed believe that they willreceive a higher payoff. Study 3 shows that receivers are more likely thandictators to choose these self-serving descriptions. In sum, our work suggeststhat some people choose descriptions that are beneficial to themselves; we alsofound some evidence that deliberative thinking and young age are associated withthis tendency.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
The authors license this article under the terms of the Creative Commons Attribution 3.0 License.
Copyright
Copyright © The Authors [2022] This is an Open Access article, distributed under the terms of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

1 Introduction

Recent work has shown that people’s decisions in economic experiments involving prosocial behavior depend not only on the monetary consequences that the available actions bring about but also on the specific words that are used to describe these actions, especially when the words activate moral concerns. For example, Reference Eriksson, Strimling, Andersson and LindholmEriksson et al. (2017) found that rejection rates in the ultimatum game depend on the label used to describe the rejection option: people are less likely to reject low offers when the rejection option is labeled as “payoff reduction” compared to when it is labeled as “costly punishment”; moreover, this effect could be explained by the moral judgments associated with the available actions. Reference Capraro and RandCapraro and Rand (2018) found that decisions in a trade-off game (where decision-makers get to decide between an equal and an efficient allocation of money) are affected by the words used to describe the available actionsFootnote 1; again, this effect was explained by differences in moral judgments. A similar finding was reported by Reference Capraro and VanzoCapraro and Vanzo (2019) using an “extreme” dictator game. Specifically, they randomly assigned participants to one of six extreme dictator game frames. In all frames, the dictator was informed that there was a certain amount of money available for themself and the recipient. The dictator could decide between two options: to allocate all the money to themself, or to allocate all the money to the recipient. The six frames differed on the wording used to describe such options, which were meant to trigger moral concerns. In the steal frame, the self-regarding allocation explicitly presented the words “steal the money”, whereas the other-regarding allocation used the words “don’t steal the money”. The take, the demand, the give, the donate, and the boost frames were analogue. Results showed that participants assigned to the steal frame were the most likely to implement the other-regarding allocation, whereas participants assigned to the boost frame were the least likelyFootnote 2; once again, this effect could be explained by the moral judgments associated with the available actions. Reference Chang, Chen and KrupkaChang et al. (2019) also found that dictator game giving depends on the words used to describe the available actions: politically framed words interact with participants’ political orientation to determine changes in norms and decisions. Finally, Reference Mieth, Buchner and BellMieth et al. (2021) found that the rate of cooperation in the prisoner’s dilemma changes if the available options are described using non-neutral, morally loaded, words, as “I cooperate” and “I cheat”.

Now, if decision-makers’ choices are affected by the words being used to describe the available actions, it is possible that people in the position of describing a decision problem to decision-makers exploit this opportunity for their benefit, by choosing descriptions that may potentially favor themselves. In this article we study this issue. We believe this to be an important question from the practical viewpoint, as, in several real life situations, people are indeed in the position of describing a decision problem to a decision maker. The same group of activists may be labeled as terrorists or freedom-fighters depending on the impact the provider of information wants to elicit from the receiver (Reference GanorGanor, 2002).

In this article, we capture the core of this issue by taking the mirror image of the methodology introduced by Reference Capraro and VanzoCapraro and Vanzo (2019). Specifically, in Study 1 recipients of an extreme dictator game are asked to choose the frame used to introduce the game to dictators, among steal, demand, take, donate, give, boost, as above. If recipients do not exploit the opportunity to choose the frame to affect the dictators’ decisions, each frame will be selected following the uniform distribution. Conversely, if instead some recipients exploit the opportunity for their benefit, then the frame that they believe to be most likely associated with the other-regarding allocation will be chosen more frequently. From Reference Capraro and VanzoCapraro and Vanzo (2019), we know that this frame is the steal frame. Therefore, assuming that a significant proportion of those recipients, those who wants to exploit the chance to choose the frame for their benefit, have correct beliefs about which frame gives rise to the maximum rate of other-regarding behavior, we obtain our primary (and pre-registered) hypothesis:

Hypothesis 1. Recipients are more likely to choose the steal frame than what one would expect from uniformly random choice.

An important remark is due at this stage. As said above, Reference Capraro and VanzoCapraro and Vanzo (2019) also found that people assigned to the boost frame were the least likely to implement the other-regarding allocation. However, this does not allow us to logically conclude that, in Study 1, we will observe that recipients choose the boost frame less frequently than the other frames. An alternative is indeed possible, at least in principle. Assume that there are two classes of people: (i) those who choose the frame uniformly at random and (ii) those who choose the steal frame. In this case, we would observe all frames to be chosen equally often, apart from the steal frame, which would be chosen more often than the other frames. Therefore, the only hypothesis that we can deduce from Reference Capraro and VanzoCapraro and Vanzo (2019) is Hypothesis 1.

Coming back to this hypothesis, while we expect it to be confirmed in our experiment, we do not expect that all recipients choose the steal frame. It is likely that individual characteristics are associated with the probability of choosing this frame. Which characteristics? Among the basic demographic variables, we may expect gender and age to play a role, because they are known to be associated with dictator game decisions: several meta-analyses have shown that women tend to be more altruistic than men (Reference EngelEngel, 2011; Reference Brañas-Garza, Capraro and Rascon-RamirezBrañas-Garza et al. 2018; Reference Rand, Brescoll, Everett, Capraro and BarceloRand et al. 2016) and that older people tend to be more altruistic than younger people (Reference EngelEngel, 2011). Therefore, these demographic characteristics could be associated with the probability of choosing the steal frame.

Apart from demographic characteristics, we reasoned that other two individual factors might be associated with the probability of choosing the steal frame. One is deliberative thinking: understanding that the frame can be used to affect dictators’ decisions might require a non-negligible amount of deliberation. The other one is strategic sophistication: understanding that the frame can be strategically used to affect dictators’ decisions could require some amount of strategic sophistication. To measure deliberative thinking, we used the Cognitive Reflection Test (CRT; Reference FrederickFrederick, 2005). To measure strategic sophistication, we used the 11–20 task (Reference Arad and RubinsteinArad & Rubinstein, 2012). We refer to the Method section for detailed descriptions of these tasks.

We conducted a first session of Study 1 to test Hypothesis 1 and to explore the effect of gender, age, deliberative thinking, and strategic sophistication. We pre-registered Hypothesis 1 and, as secondary analyses, we pre-registered that we would explore the effect of gender, age, deliberative thinking, and strategic sophistication (see https://aspredicted.org/ux4h3.pdf). Hypothesis 1 was immediately confirmed. Moreover, we found some evidence, although weak, of an effect of deliberative thinking, such that participants with higher CRT scores were more likely to use the steal frame. Therefore, we conducted another session (pre-registered at: https://aspredicted.org/ru8fz.pdf) with the goal of replicating Hypothesis 1 and, additionally, of testing the following pre-registered hypothesis:

Hypothesis 2. Recipients with higher scores in the CRT are more likely to choose the steal frame.

Hypothesis 1 was successfully replicated. As for Hypothesis 2, we did not find strong evidence that higher scores in the CRT are associated with the probability of choosing the steal frame.

Note that Hypothesis 1 does not imply that receivers choose the steal frame strategically in order to increase the likelihood to receive a higher payoff. It is possible that receivers are more likely to choose the steal frame because of some other, possibly non-strategic, reasons (e.g., because they like the steal frame). To rule out this possibility, we conducted two additional studies, providing two pieces of evidence in support of our interpretation that some receivers choose the steal frame strategically to increase the probability to receive a higher payoff. Specifically, in Study 2 we test the following pre-registered hypothesis:

Hypothesis 3. Receivers who choose the steal frame are more likely than receivers who choose the boost frame to believe that they will get the higher payoff.

In Study 3 we test the following pre-registered hypothesis:

Hypothesis 4. Receivers are more likely than dictators to choose the steal frame.

Both these hypotheses were confirmed by the results. Furthermore, in Studies 2–3, we found support also for Hypothesis 2.

2 Study 1

2.1 Method

Participants, based in the USA at the time of the experiment, were recruited on Amazon Mechanical Turk (AMT; Reference Arechar, Gächter and MollemanArechar, Gächter & Molleman, 2018; Reference Paolacci and ChandlerPaolacci & Chandler, 2014; Reference Paolacci, Chandler and IpeirotisPaolacci, Chandler & Ipeirotis, 2010). After entering their TurkID and accepting the informed consent, they were told that they would be playing a game involving two participants, Participant A and Participant B, and an amount of money ($0.50). They were informed that there were two available options, Option 1 and Option 2. Option 1 allocates the whole amount to Participant A, Option 2 allocates the whole amount to Participant B. Then, they were informed that the role of Participant B is to decide the wording used to present Option 1 and Option 2 to Participant A, and that the role of Participant A is to decide between Option 1 and Option 2, as presented using the wording decided by Participant B. We clarified that Participant A will not be made aware that Participant B chose the descriptions of the options; Participant A will only play the game as described by Participant B, without ever knowing where these descriptions come from. Participants were then asked five comprehension questions to make sure that they understood the game. We automatically excluded participants that failed one or more comprehension questions. These participants received the participation fee ($0.50), but no additional bonus. Participants were informed of this exclusion criterion at the beginning of the survey. All participants who passed the comprehension questions were informed that they would be playing as Participant B (to compute their payoff, we matched them with participants in the experiment reported by Reference Capraro and VanzoCapraro and Vanzo (2019), which were treated as Participants A - see below for further details). Participants were reminded about their role and that of Participant B. Then, they were shown six possible descriptions of Option 1 and Option 2:

Option 1 = Participant A steals all the money from Participant B

Option 2 = Participant A does not steal all the money from Participant B

Option 1 = Participant A takes all the money from Participant B

Option 2 = Participant A does not take all the money from Participant B

Option 1 = Participant A demands all the money from Participant B

Option 2 = Participant A does not demand all the money from Participant B

Option 1 = Participant A does not give all the money to Participant B

Option 2 = Participant A gives all the money from Participant B

Option 1 = Participant A does not donate all the money to Participant B

Option 2 = Participant A donates all the money from Participant B

Option 1 = Participant A does not boost Participant B with all the money

Option 2 = Participant A boost Participant B with all the money

These descriptions were shown in random order.Footnote 3 Participants made their decision by ticking on their preferred pair of descriptions.

After making their decision, participants played the 11–20 game to measure strategic sophistication (Reference Arad and RubinsteinArad & Rubinstein, 2012). In this game, participants are randomly matched to play a game against another participant. Each participant requests an amount of money between 11 and 20 cents. Each participant receives the amount they request, plus an additional 20 cents if they ask for exactly one cent less than the other participant. This game was incentivized. The strategic structure of this game makes it particularly suitable to measure participants’ strategic sophistication using Level-k theory (Reference Stahl, Wilson and W.Stahl & Wilson, 1994). Choosing 20 is intuitively appealing and is the instinctive choice when choosing a sum of money between 11 cents and 20 cents; it also guarantees the highest certain payoff, while avoiding strategic thinking. For these reasons, choosing 20 can be considered a Level-0 strategy (Reference Arad and RubinsteinArad & Rubinstein, 2012). Now note that choosing 19 is the best response to choosing 20; moreover, choosing 19 is also the best response to the uniformly random choice. Therefore, choosing 19 can be considered as a Level-1 strategy. Similarly, choosing 18 can be considered as a Level-2 strategy, and so on (Reference Arad and RubinsteinArad & Rubinstein, 2012).

After the 11–20 game, participants took a 3-item Cognitive Reflection Test (CRT; Reference FrederickFrederick, 2005). Each item consists of a question characterized by the fact that an intuitive but wrong answer immediately comes to mind; and one has to engage in deliberation in order to override this intuitive and wrong answer and find out the correct one. We changed the original CRT, while preserving the fundamental structure, in order to avoid participants giving the right answer only because they are familiar with the test. The number of correct solutions is taken as a measure of deliberation. Previous work found that scores in the CRT correlate with scores in the Need for Cognition test (Reference Pennycook, Cheyne, Koehler and FugelsangPennycook et al., 2016).

After the CRT, participants answered a standard demographic questionnaire, at the end of which they received the completion code needed to submit the survey and receive their bonus. The bonus for the dictator game decision was computed as follows. Remember that all participants in this study played in the role of Participant B. Each Participant B was then paired with a Participant A who played in Reference Capraro and VanzoCapraro & Vanzo (2019), that was randomly selected among all participants who played in the frame chosen by Participant B. The bonus for the 11–20 task was computed by randomly pairing the participants in this experiment. All decisions involving money were incentivized.

2.2 Results

2.2.1 Participants

We recruited N = 557 participants.Footnote 4 After excluding, as pre-registered, those who failed one or more comprehension questions and those with duplicate TurkIDs and IP addresses, we remain with N = 332 participants (193 males, 135 females, 4 prefer not to say; mean age = 39.35 (SD = 11.72); 173 participants in session 1 and 159 participants in session 2). An exclusion rate of 40% is in line with similar studies on AMT (Horton et al., 2010).

2.2.2 Test of Hypothesis 1

The distributions of decisions do not differ between the two sessions (Kolmogorov-Smirnov: combined D = 0.079, p = 0.680). We thus start by reporting the analysis of the two sessions together, and then we discuss the robustness of the results across sessions. Figure 1 reports the frequencies of participants choosing each frame. If participants were to choose uniformly at random, we would observe each frame chosen with a frequency of 1/6. The horizontal line in the figure reports this uniform frequency. The figure clearly shows that the observed distribution is different from the uniform distribution. Hypothesis 1 states that people choose the steal frame more frequently than one would expect from uniformly random choice. To test this hypothesis, we use a one-sample t-test to compare the observed frequency of each frame with the theoretical frequency assuming uniformly random choice, that is 1/6. In doing so, we find that the steal frame is chosen more often than one would expect from uniformly random choice (t = 4.58, p < 0.001). We note that Hypothesis 1 is confirmed also if we analyze the two sessions separately (session 1: t = 4.25, p < 0.001; session 2: t = 2.12, p = 0.017).

Figure 1: Frequencies of participants choosing each frame. The horizontal line, corresponding to 1/6, denotes the frequency of people who would choose any frame if they were to choose uniformly at random. Error bars stand for the standard errors of the means.

Although not pre-registered, we also look at the other frames. The boost and the demand frames are chosen less frequently than one would expect from uniformly random choice (boost: t = –4.35, p < 0.001; demand: t = –4.11, p < 0.001); the donate, the take and the give frames are chosen with a frequency that is not significantly different from the one expected from uniformly random choice (all p’s > 0.09). All these results hold also if we analyze the sample by splitting session 1 and session 2, except for the donate frame, that appears to be chosen more frequently than one would expect from uniformly random choice in session 2 (t = 1.78, p = 0.038), but not in session 1 (t = 0.02, p = 0.491).

2.2.3 Test of Hypothesis 2

As a secondary pre-registered hypothesis, we had that participants with higher CRT are more likely to choose the steal frame. We pre-registered that we would test this hypothesis using a logistic regression predicting the “steal dummy”, which takes value 1 if a participant chooses the steal frame and 0 otherwise. In doing so, we find that the hypothesis is not supported (b = 0.199, p = 0.304). The results are similar when we add controls on gender, age, and strategic sophistication (b = 0.221, p = 0.265). We find only an effect of age such that older people are less likely to choose the steal frame (b = –0.039, p = 0.002). One limitation of this analysis is that it collapses together all frames but the steal frame. To address this, we conducted a multinomial logistic regression predicting the frame decision as a function of CRT score, treating the steal frame as a reference frame. The results show that people who choose the boost frame tend to score lower to the CRT than people who choose the steal frame (b = –0.792, p = 0.015). All other p’s > 0.1.Footnote 5

3 Study 2

Study 1 shows that receivers are more likely to choose the steal frame than one would expect from random choice. This, however, does not imply that receivers choose the steal frame because they want to maximise their payoff. It is possible that they choose the steal frame because they prefer this frame for some other reasons. In the next two studies, we therefore provide two additional pieces of evidence in support of our interpretation. We show that receivers who choose the steal frame are aware of the fact that this frame is more likely to give them a higher payoff (Study 2) and that they would not choose the steal frame if they were to choose the frame as dictators (Study 3).

3.1 Methods

Study 2 is identical to Study 1, with two key differences: (i) after the decision, we also asked participants: “Now that you have chosen the wording of the options as they are presented to Participant A, which option do you think Participant A will implement?” Available answers were: “Option 1 (allocate the money to her/himself)” / “Option 2 (allocate the money to you”); (ii) participants could choose only among the steal frame and the boost frame. We used only these frames in order to increase statistical power.Footnote 6 Specifically, we choose these frames for two reasons. First, from Study 1, we know that the boost frame is the least chosen frame. Second, from Reference Capraro and VanzoCapraro and Vanzo (2019), we know that the boost frame is also the frame that gives rise to the least amount of altruistic behavior. Therefore, choosing these frames allows us to increase sample size by frame and, at the same time, maintain the effect size as high as possible, and therefore increase statistical power. As in Study 1, we included five comprehension questions. Only participants who responded to all comprehension questions correctly were allowed to proceed with the experiment and make the actual decisions. After making their decisions, participants take the CRT and, finally, a standard demographic questionnaire. Compared to Study 1, we dropped the 11–20 task, since it was not correlated with the decision. After the demographic questionnaire, participants receive the completion code needed to claim for their bonus on AMT. As in Study 1, the bonuses were computed by matching the frame decisions of the current participants with the choices made in the corresponding frame collected by Reference Capraro and VanzoCapraro and Vanzo (2019). Our pre-registered hypothesis is that the participants who choose the steal frame expect, on average, a higher amount than participants who choose the boost frame. The design, the hypothesis, the analysis, and the sample size are pre-registered at: https://aspredicted.org/blind.php?x=ti728n.

3.2 Results

3.2.1 Participants

We recruited N = 224 participants. After excluding, as pre-registered, those who failed one or more comprehension questions and those with duplicate TurkIDs and IP addresses, we remain with N = 162 participants (79 males, 81 females, 2 prefer not to say; mean age = 41.48 (SD = 12.46)).

3.2.2 Test of the Hypothesis 3

As hypothesized, receivers who chose the steal frame were more likely than receivers who chose the boost frame to expect that dictators implement the altruistic option (50% vs. 25%, Wilcoxon rank-sum: z = 3.23, p = 0.001). See Figure 2.Footnote 7

Figure 2: Frequencies of receivers believing that the dictator will be altruistic, by frame.

4 Study 3

Study 2 shows that receivers who choose the steal frame are more likely than receivers who choose the boost frame to expect a higher payoff. This result, however, does not mean that these receivers choose the steal frame because they expect a higher payoff. It is possible that they choose the steal frame for some other, non-strategic, reason (e.g., because they like the word “steal”). To rule out this alternative, in Study 3 we compare the frame choice of receivers with that of dictators. If people choose the steal frame for non-strategic reasons, then we would observe that dictators are as likely as receivers to choose the steal frame. If, by contrast, the choice of the frame is strategic, we would observe that receivers are more likely than dictators to choose the steal frame.

4.1 Methods

Participants were randomly divided between two conditions. The receiver condition is identical to Study 2, but without the measure of beliefs, that is, participants played as receivers in the dictator game and had to choose the description of the available options; as in Study 2, the only available options were the boost frame and the steal frame. In the dictator condition, participants had to choose the frame as dictators; again, the only available options were the boost and the steal frame. In order to not influence participants’ decisions, dictators (receivers) were not informed that receivers (dictators) were also choosing the frame. After making their decision, participants took the CRT and, finally, a standard demographic questionnaire, at the end of which they received the completion code needed to claim for their bonus. The bonuses were computed by matching dictators with receivers, according to the frames they chose; in case this procedure led to a one-to-multiple matching, we implemented the average decision, which guarantees that the payment mechanism is incentive-compatible (Reference Capraro and BarceloCapraro & Barcelo, 2021). Our pre-registered hypothesis is that dictators are more likely than receivers to choose the steal frame. The design, the hypothesis, the analysis, and the sample size were pre-registered at: https://aspredicted.org/blind.php?x=yc6zu5.

4.2 Results

4.2.1 Participants

We recruited N = 225 participants. After excluding, as pre-registered, those who failed one or more comprehension questions and those with duplicate TurkIDs and IP addresses, we remain with N = 177 participants (87 males, 88 females, 1 prefers not to say, 1 did not respond; mean age = 40.58 (SD = 13.13)).

4.2.2 Test of the Hypothesis 4

As hypothesized, the proportion of receivers who choose the steal frame is significantly higher than the proportion of dictators who choose the steal frame (50% vs. 30.5%; Wilcoxon rank-sum: z = 2.575, p = 0.010). See Figure 3.

Figure 3: Proportions of dictators and receivers choosing the steal frame.

5 Additional analysis

As an additional, non pre-registered analysis, we also check the effect of deliberative thinking, gender, and age, on receivers’ decision to choose the steal frame vs. the boost frame, in Studies 2–3. We pool together the data of these studies but, as a robustness check, we control for the study. In line with Hypothesis 2 and with Study 1, we find that deliberative thinking is associated with the probability of choosing the steal frame over the boost frame (logit regression: coeff = 0.234, p =0.039; probit regression: coeff = 0.146, p = 0.038). This result holds also when adding controls on gender, age, and study (logit: coeff = 0.244, p = 0.038; probit: coeff = 0.151, p = 0.038). Moreover, in line with Study 1, we do find an age effect: younger receivers are significantly more likely to choose the steal frame (all p’s < 0.03).

6 Discussion

We have reported three pre-registered experiments testing whether dictator game recipients, when given the opportunity to choose the words used to describe the dictator game to dictators, tend to choose words that are more likely to benefit themselves. Study 1 showed that receivers tend to choose words that, in an earlier experiment, led to higher donations. Study 2 found that receivers who choose these words indeed expect a higher payoff. Study 3 found that dictators and receivers choose different words, suggesting a strategic reason behind the choice of the words.

This contribution has practical and theoretical implications. From a practical perspective, there are many real-life situations in which a person has the opportunity to decide which words to use to present a decision problem to a decision-maker. In this case, this person may exploit this opportunity for their benefit. We captured the core of this situation by means of an “extreme” dictator game in which recipients have the opportunity to choose the words used to present the game to dictators, without the dictators being informed of this. Our results show that, at least in this idealized situation, some people indeed choose words that benefit themselves. Study 3 also allows us to estimate the proportion of people choosing the frame strategically, by looking at the difference between the percentage of receivers who choose the steal frame and the percentage of dictators who choose the steal frameFootnote 8, which appears to be relatively small, 20%. This result suggests that choosing the frame strategically in order to maximize one’s payoff may not be the typical strategy that people apply in real life.

From a theoretical perspective, our results cannot be explained by standard theories of social preferences, which assume that the utility of an action is a function of the monetary outcomes associated with that action (Reference Fehr and SchmidtFehr & Schmidt, 1999; Reference Bolton and OckenfelsBolton & Ockenfels, 2000; Reference Engelmann and StrobelEngelmann & Strobel, 2004): since all frames considered in this paper are identical from the perspective of monetary outcomes, social preference models predict that dictator game recipients are indifferent between the frames. Our results, however, provide evidence that some recipients are aware of the fact that dictators’ actions depend on the words used to describe the available actions, and strategically choose the description that is more likely to maximize their monetary payoff. Therefore, our results call for new models of preferences that take into account also the words used to describe the available actions (Bjorndhal, Halpern & Pass, 2013; Reference Capraro and PercCapraro & Perc, 2021). One potential explanation for our results is that people are aware that morally loaded words may activate self-image, moral preferences for doing what one thinks to be the right thing (Reference Capraro and RandCapraro & Rand, 2018; Reference Capraro and VanzoCapraro & Vanzo, 2019; Reference Chang, Chen and KrupkaChang et al. 2019; Reference Eriksson, Strimling, Andersson and LindholmEriksson et al. 2017; Reference Mieth, Buchner and BellMieth et al. 2021; Reference Tappin and CapraroTappin & Capraro, 2018). If people are aware of this “power of moral words”, then they may choose words that are aligned with their social value orientation: for example, selfish receivers may choose words that induce dictators to be altruistic, while selfish dictators may choose words that make their selfish behavior justifiable. This effect could be formalized by assuming that the instructions of a decision problem carry the moral value of the available actions and of the context in which the decision is being made, and that the utility function of decision makers somehow depends also on the instructions, via their moral value. However, a mechanistic model linking quantitatively language to decisions is still missing (Reference Capraro and PercCapraro & Perc, 2021).

The second contribution of our work regards the individual characteristics of participants who are more likely to choose frames that maximize their monetary payoff. Our results provide some evidence of an effect of deliberative thinking. This may indicate that deliberation makes people more likely to realize that they can use words to affect dictators’ decisions. Previous research shows that deliberative thinking does not seem to be associated with altruistic behavior in dictator games (Reference Rand, Brescoll, Everett, Capraro and BarceloRand et al. 2016; Reference Fromell, Nosenzo and OwensFromell et al. 2020). Our results suggest that, some of these deliberative people (likely those who are not altruistic) decide to exploit the opportunity and choose the steal frame, while others decide not to exploit the opportunity and choose one of the other frames. Indeed, it is important to note that not all people who realize that words can be used to affect dictators’ decisions actually choose the steal frame: if it had been so, then, in Study 1, we would have observed a peak of decisions in the steal frame, while all other frames would have been chosen with equal frequency. This is not what Study 1 suggests: the boost and the demand frames are chosen far less frequently than the other frames. Our results also provide evidence of an effect of age, such that younger people are more likely to choose the steal frame. However, it is possible that this is simply due to the fact that younger people tend to be more selfish in the dictator game (Reference EngelEngel, 2011).

The fact that dictator game recipients are most likely to choose the steal frame and least likely to choose the boost frame in Study 1 perfectly mirror the results of Reference Capraro and VanzoCapraro and Vanzo (2019), who reported that dictators assigned to the steal frame are the most likely to implement the other-regarding decision, whereas those assigned to the boost frame are the least likely. However, there are also some mismatches between the results of Study 1 and those reported by Capraro and Vanzo. The clearest mismatch regards the demand frame. Capraro and Vanzo found that dictators assigned to the demand frame are far more likely to implement the other-regarding allocation than those assigned to the boost frame, and as likely to implement the other-regarding allocation as those assigned to the donate, the give, and the take frames. However, Study 1 shows that recipients are far less likely to choose the demand frame than the give, the take, and the donate frames, and they are equally likely to choose the demand and the boost frames. This mismatch might be due to a mismatch between beliefs and actual behavior, such that recipients believe that dictators assigned to the demand frame are less altruistic than they actually are.

Another somewhat unexpected result is that receivers in Study 2 and 3 are almost equally likely to choose the steal frame as they are to choose the boost frame (54% vs. 46%, two-sample t-test, p = 0.124). However, it is important to note that this does not mean that receivers are choosing the frame uniformly at random. The fact that receivers who choose the steal frame tend to be younger and more deliberative, besides believing they will receive more, than those who choose the boost frame, suggests that they do so for strategic reasons. The fact that, in contrast with Study 1, Study 2 and 3 find no a statistical difference in the proportion of receivers who choose the boost frame vs. the steal frame might be due to a combination of factors, including low statistical power as well as the fact that the use of only two frames may decrease the room for statistical changes and increase random error, because receivers are forced to choose only between the extreme frames.

As any experimental work, this one has some limitations. First, in our experiments, dictators were not informed that recipients had the chance to choose the words used to present the game. It is likely that making the choice of the frame common knowledge would change the results. On the one hand, dictators who receive the steal frame might feel that they are being manipulated and this might lead them to retaliate negatively, and thus make them more self-regarding, instead of more other-regarding. On the other hand, recipients might anticipate this logic and this might bring them to avoid choosing the steal frames. Therefore, it is possible that what we found to be the most frequent choice in Study 1 (the steal frame) would become the least common one. At the same time, recipients may still try to affect dictators’ behavior by choosing frames that they believe to be associated with more other-regarding allocations, but that are not perceived to be manipulative. In sum, in case the frame choice is common knowledge the behavior of recipients and dictators might be very nuanced and far less than obvious. For this reason, we believe this to be an interesting venue for future research.

A second limitation concerns the stakes. As most experiments conducted online, we also used small stakes. Although these stakes are proportioned to the amount of time that participants spend on the experiment, one may wonder whether these results extend to decisions involving higher stakes. Previous work suggests that dictator game decisions collected on AMT are comparable to those collected in the lab. For example, Reference Brañas-Garza, Capraro and Rascon-RamirezBrañas-Garza et al. (2018) reported a mega-analysis of more than 3,500 dictator game observations with small stakes on AMT and found an average giving (30.8%) very close to the one found by Reference EngelEngel (2011) in his meta-analysis of 616 laboratory experiments (28.3%). However, there is some evidence of a weak stake-effect, such that people may become less altruistic at very high stakes (Reference Larney, Rotella and BarclayLarney, Rotella & Barclay, 2019). Moreover, it is likely that people also deliberate more as stakes increase. Therefore, it is possible that our results change at very high stakes. Exploring this is another interesting direction for future work.

A third limitation of our work is that we used an extreme dictator game rather than a standard dictator game. We made this design choice in order to be able to derive our main hypothesis (Hypothesis 1) starting from the results of Reference Capraro and VanzoCapraro and Vanzo (2019) and, ultimately, because in the case of an extreme dictator game it is easy to write instructions that, across conditions, differ only for just a few words. However, a downside of this design choice is that we cannot say whether our results extend to the standard dictator games, or to other economic games where language has been shown to play a role. We hope that future research can investigate the boundary conditions of the effect revealed in this paper.

In sum, this work demonstrates that some dictator game recipients, when given the opportunity to choose the words being used to introduce the dictator game, tend to choose words that make them more likely to receive a higher payoff. We found some evidence that deliberative thinking and young age are associated with this tendency.

Appendix: Experimental Instructions

Main task (choose the frame of the dictator game)

The game you will be playing involves two participants, Participant A and Participant B, and an amount of money (50c).

There are two available options:

  • Option 1 allocates the whole amount to Participant A;

  • Option 2 allocates the whole amount to Participant B.

The role of Participant B is to decide the words that will be used to present Option 1 and Option 2 to Participant A.

The role of Participant A is to decide between Option 1 and Option 2, as presented using the words decided by Participant B.

IMPORTANT: Participant A will not be aware that Participant B is choosing the descriptions of the options. Participant A will only play the game as described by Participant B, without ever knowing where these descriptions come from.

No deception is used. Participant A and Participant B will be paid according to Participant A’s decision.

Here are some questions to ascertain that you understand the rules. Remember that you have to answer all of these questions correctly in order to get the completion code. If you fail any of them, the survey will automatically end. If this happens, please submit your HIT using your TurkId at the place of the completion code, so that we can still pay you the 50c participation fee. Note, however, that, in this case, you will not receive any additional money.

Which option maximises Participant A’s gain? (Available answers: Option 1/Option2)

Which option maximises Participant B’s gain? (Available answers: Option 1/Option2)

Is Participant A aware of the fact that Participant B is choosing the description of the options? (Available answers: Yes/No/Not specified)

What is the role of Participant A? (Available answers: Choose between Option 1 and Option 2/Choose the words used to describe Option 1 and Option 2/Neither of the two)

What is the role of Participant B? (Available answers: Choose between Option 1 and Option 2/Choose the words used to describe Option 1 and Option 2/Neither of the two)

(The next screen was shown only to participants who responded correctly to all the comprehension questions. Those who failed one or more comprehension questions were automatically excluded from the survey.)

You passed all the comprehension questions.

It is now time to make your decision.

You are Participant B. This means that your role is to decide the words that will be used to describe Option 1 and Option 2 to Participant A. Remember that Participant A will then choose between the descriptions of Option 1 and Option 2 that you have chosen, and that you will be paid according to Participant A’s decision.

Remember that Participant A will not be informed that the descriptions of the two options come from a predetermined set of descriptions. Participant A will simply be shown the rules of the game with the labels “Option 1” and “Option 2” replaced by your descriptions.

Which wording of Option 1 and Option 2 would you choose?

Option 1 = Participant A steals all the money from Participant B

Option 2 = Participant A does not steal all the money from Participant B

Option 1 = Participant A takes all the money from Participant B

Option 2 = Participant A does not take all the money from Participant B

Option 1 = Participant A demands all the money from Participant B

Option 2 = Participant A does not demand all the money from Participant B

Option 1 = Participant A does not give all the money to Participant B

Option 2 = Participant A gives all the money from Participant B

Option 1 = Participant A does not donate all the money to Participant B

Option 2 = Participant A donates all the money from Participant B

Option 1 = Participant A does not boost Participant B with all the money

Option 2 = Participant A boost Participant B with all the money

(Participants could tick on their preferred pair of choices. These options were displayed in random order.)

11–20 task

You are randomly matched to play a game against another participant.

In the game, both of you request an amount of money between 11 and 20 cents.

Each participant will receive the amount s/he requests, plus an additional 20 cents if s/he asks for exactly one cent less than the other participant.

What amount of money do you request? (Available answers: 11 cents/12 cents/13 cents/14 cents/15 cents/16 cents/17 cents/18 cents/19 cents/20 cents)

Cognitive Reflection Test

A postcard and a pen cost 150 cents in total. The postcard costs 100 cents more than the pen. How many cents does the pen cost? (A text box was provided, where participants could write their answer.)

If it takes 3 nurses 3 minutes to measure the blood pressure of 3 patients, how long would it take 300 nurses to measure the blood pressure of 300 patients? (A text box was provided, where participants could write their answer.)

Sally is making some tea. Every hour, the concentration of the tea doubles. If it takes 8 hours for the tea to be ready, how many hours would it take for the tea to reach half of the final concentration? (A text box was provided, where participants could write their answer.)

Footnotes

Financial support by Comunidad de Madrid, under grants EPUC3M11 (V PRICIT)and H2019/HUM-589, is gratefully acknowledged.

2 Somewhat related is the literature comparing the dictator game in the give vs take frame (Swope et al. 2008; Reference Dreber, Ellingsen, Johannesson and RandDreber, Ellingsen, Johannesson & Rand, 2013; Reference Krupka and WeberKrupka & Weber, 2013; Reference Grossman and EckelGrossman and Ecker, 2015; Reference HalvorsenHalvorsen, 2015; Reference Hauge, Brekke, Johansson, Johansson-Stenman and SvedsäterHauge, Brekke, Johansson, Johansson-Stenman & Svedsäter, 2016; Reference Goerg, Rand and WalkowitzGoerg, Rand & Walkowitz, 2019). In this stream of literature, the two frames do not only differ in the words used to describe the actions, but also in where the endowment is initially allocated: in the give frame, it is initially allocated to the dictator; in the take frame, it is initially allocated to the recipient, or split between the dictator and the recipient. These experimental works showed mixed results, providing no clear evidence that one frame gives rise to more prosociality than the other. Consistent with these mixed results, also Reference Capraro and VanzoCapraro and Vanzo (2019) reported no statistical difference between their give and take frames. The two approaches are related because it is likely that the words used to describe the available actions generate a continuous endowment effect (Reference Reb and ConnollyReb & Connolly, 2007).

3 The frames are identical to those already used by Reference Capraro and VanzoCapraro and Vanzo (2019). These frames were chosen using the SentiWordNet lexical resource introduced by Reference Baccianella, Esuli and SebastianiBaccianella et al. (2010). This lexical resource divides the English vocabulary in “synsets” (i.e., sets of synonyms) according to their sentiment polarity (Reference Pang and LeePang & Lee, 2004; Reference Liu, Cao, Lin, Huang and ZhouLiu et al., 2007; Reference Vanzo, Croce and BasiliVanzo et al., 2014). We chose six synsets defined by words that describe well actions in an extreme dictator game: steal#1 = “take without the owner’s consent”; take#8 = “take into one’s possession”; demand#1 = “request urgently and forcefully”; give#3 = “transfer possession of something concrete or abstract to somebody”; donate#1 = “give to a charity or good cause”; and boost#2 = “be beneficial to”. Moreover, these synsets are approximately symmetric in terms of their sentiment polarity: two of them (donate and boost) have non-zero positivity and zero negativity, two of them (steal and demand) have non-zero negativity and zero positivity, and two of them (take and give) are fully neutral, i.e., their positivity and negativity are both zero.

4 Note that this number is higher than the pre-registered sample size (400 participants for the two sessions combined), because it also includes participants who get excluded during the survey because they fail one or more comprehension questions: these participants are not counted by Amazon Mechanical Turk, because they do not reach the end of the survey, but they are present in the datafile downloaded from Qualtrics. The pre-registered sample size corresponds to the number of participants as counted by Amazon Mechanical Turk, because this is the only number that we can actually control a priori.

5 These results were robust to including controls on sex, age, and strategic sophistication.

6 We also conducted a pilot with all the frames. The results were in the expected direction, but, due to insufficient statistical power, in some cases we did not reach statistical significance. For example, the frequency of Participants B who expected altruistic behavior from Participant A, among those who had chosen the boost frame, was 0.32, compared to 0.62 among those who had chosen the steal frame. Despite this large numerical difference, the p-value was above 0.1.

7 Although not pre-registered, we also report that receivers tended to choose the steal frame more often than the boost frame (56% vs 44%, which correspond to 90 vs. 72 participants), although the difference was not statistically significant (two-sample t-test, p = 0.079). The lack of statistical significance may be due to a combination of low statistical power and the use of two frames only, which may have reduced the room for statistical differences and may have added random noise due to forcing receivers to choose between the two most extreme frames. Also putting together Study 2 and Study 3, the trend was confirmed (54% vs. 46%), but it still was not significant (p = 0.124).

8 Note that this difference contains two potentially distinct classes of people: those who, as receivers, choose the steal frame in order to affect the dictator’s choice; and those who, as dictators, choose the boost frame in order to justify their future selfish behavior in the dictator game. (Indeed, we do find a trend suggesting that dictators who choose the boost frame may be less likely to implement the altruistic allocation than those who choose the steal frame; 12% vs. 23%, p = 0.158.) Although both these classes of people choose the frame that favors themselves the most, they need not be the same class of people.

References

Arad, A., & Rubinstein, A. (2012). The 11–20 money request game: A level-k reasoning study. American Economic Review, 102, 35613573.10.1257/aer.102.7.3561CrossRefGoogle Scholar
Arechar, A. A., Gächter, S., & Molleman, L. (2018). Conducting interactive experiments online. Experimental Economics, 21, 99131.10.1007/s10683-017-9527-2CrossRefGoogle ScholarPubMed
Baccianella, S., Esuli, A., & Sebastiani, F. (2010). Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In LREC (Vol. 10, No. 2010, pp. 22002204).Google Scholar
Bolton, G. E., & Ockenfels, A. (2000). ERC: A theory of equity, reciprocity, and competition. American Economic Review, 90, 166193.10.1257/aer.90.1.166CrossRefGoogle Scholar
Brañas-Garza, P., Capraro, V., & Rascon-Ramirez, E. (2018). Gender differences in altruism on Mechanical Turk: Expectations and actual behaviour. Economics Letters, 170, 1923.10.1016/j.econlet.2018.05.022CrossRefGoogle Scholar
Capraro, V., & Barcelo, H. (2021). Punishing defectors and rewarding cooperators: Do people discriminate between genders?. Journal of the Economic Science Association. 10.1007/s40881-021-00099-4CrossRefGoogle Scholar
Capraro, V., Jordan, J. J., & Tappin, B. M. (2021). Does observability amplify sensitivity to moral frames? Evaluating a reputation-based account of moral preferences. Journal of Experimental Social Psychology, 104103. 10.1016/j.jesp.2021.104103CrossRefGoogle Scholar
Capraro, V., & Perc, M. (2021). Mathematical foundations of moral preferences. Journal of the Royal Society Interface, 18, 20200880.10.1098/rsif.2020.0880CrossRefGoogle ScholarPubMed
Capraro, V., & Rand, D. G. (2018). Do the right thing: Experimental evidence that preferences for moral behavior, rather than equity or efficiency per se, drive human prosociality. Judgment and Decision Making, 13, 99111.10.1017/S1930297500008858CrossRefGoogle Scholar
Capraro, V., Rodriguez-Lara, I., & Ruiz-Martos, M. J. (2020). Preferences for efficiency, rather than preferences for morality, drive cooperation in the one-shot Stag-Hunt Game. Journal of Behavioral and Experimental Economics, 86, 101535.CrossRefGoogle Scholar
Capraro, V., & Vanzo, A. (2019). The power of moral words: Loaded language generates framing effects in the extreme dictator game. Judgment and Decision Making,14, 309317.10.1017/S1930297500004356CrossRefGoogle Scholar
Chang, D., Chen, R., & Krupka, E. (2019). Rhetoric matters: A social norms explanation for the anomaly of framing. Games and Economic Behavior, 116, 158178.10.1016/j.geb.2019.04.011CrossRefGoogle Scholar
Dreber, A., Ellingsen, T., Johannesson, M., & Rand, D. G. (2013). Do people care about social context? Framing effects in dictator games. Experimental Economics, 16(3), 349371.10.1007/s10683-012-9341-9CrossRefGoogle Scholar
Engel, C. (2011). Dictator games: A meta study. Experimental Economics, 14, 583610.10.1007/s10683-011-9283-7CrossRefGoogle Scholar
Engelmann, D., & Strobel, M. (2004). Inequality aversion, efficiency, and maximin preferences in simple distribution experiments. American Economic Review, 94, 857869.10.1257/0002828042002741CrossRefGoogle Scholar
Eriksson, K., Strimling, P., Andersson, P. A., & Lindholm, T. (2017). Costly punishment in the ultimatum game evokes moral concern, in particular when framed as payoff reduction. Journal of Experimental Social Psychology, 69, 5964.10.1016/j.jesp.2016.09.004CrossRefGoogle Scholar
Fehr, E., & Schmidt, K. M. (1999). A theory of fairness, competition, and cooperation. Quarterly Journal of Economics, 114, 817868.10.1162/003355399556151CrossRefGoogle Scholar
Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic Perspectives, 19, 2542.10.1257/089533005775196732CrossRefGoogle Scholar
Fromell, H., Nosenzo, D., & Owens, T. (2020). Altruism, fast and slow? Evidence from a meta-analysis and a new experiment. Experimental Economics, 23, 9791001.CrossRefGoogle Scholar
Ganor, B. (2002). Defining terrorism: Is one man’s terrorist another man’s freedom fighter?. Police Practice and Research, 3, 287304.CrossRefGoogle Scholar
Goerg, S. J., Rand, D., & Walkowitz, G. (2019). Framing effects in the prisoner’s dilemma but not in the dictator game. Journal of the Economic Science Association, 112.Google Scholar
Grossman, P. J., & Eckel, C. C. (2015). Giving versus taking for a cause. Economics Letters, 132, 2830.CrossRefGoogle Scholar
Halvorsen, T. U. (2015). Are dictators loss averse?. Rationality and Society, 27, 469491.10.1177/1043463115605302CrossRefGoogle Scholar
Hauge, K. E., Brekke, K. A., Johansson, L. O., Johansson-Stenman, O., & Svedsäter, H. (2016). Keeping others in our mind or in our heart? Distribution games under cognitive load. Experimental Economics, 19(3), 562576.10.1007/s10683-015-9454-zCrossRefGoogle Scholar
Horton, J. J., Rand, D. G., & Zeckhauser, R. J. (2011). The online laboratory: Conducting experiments in a real labor market. Experimental Economics, 14(3), 399425.CrossRefGoogle Scholar
Huang, L., Lei, W., Xu, F., Yu, L., & Shi, F. (2019). Choosing an equitable or efficient option: A distribution dilemma. Social Behavior and Personality, 47, 110.Google Scholar
Huang, L., Lei, W., Xu, F., Liu, H., Yu, L., Shi, F., & Wang, L. (2020). Maxims nudge equitable or efficient choices in a Trade-Off Game. PloS ONE, 15, e0235443.CrossRefGoogle ScholarPubMed
Krupka, E. L., & Weber, R. A. (2013). Identifying social norms using coordination games: Why does dictator game sharing vary?. Journal of the European Economic Association, 11, 495524.10.1111/jeea.12006CrossRefGoogle Scholar
Larney, A., Rotella, A., & Barclay, P. (2019). Stake size effects in ultimatum game and dictator game offers: A meta-analysis. Organizational Behavior and Human Decision Processes, 151, 6172.10.1016/j.obhdp.2019.01.002CrossRefGoogle Scholar
Liu, J., Cao, Y., Lin, C. Y., Huang, Y., & Zhou, M. (2007). Low-quality product review detection in opinion summarization. In Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL) (pp. 334342).Google Scholar
Mieth, L., Buchner, A., & Bell, R. (2021). Moral labels increase cooperation and costly punishment in a Prisoner’s Dilemma game with punishment option. Scientific Reports, 11, 10221.CrossRefGoogle Scholar
Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science, 23(3), 184188.10.1177/0963721414531598CrossRefGoogle Scholar
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on amazon mechanical turk. Judgment and Decision Making, 5, 411419.10.1017/S1930297500002205CrossRefGoogle Scholar
Pang, B., & Lee, L. (2004). A sentimental education: Senti- ment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the 42nd annual meeting on association for computational linguistics (p. 271).CrossRefGoogle Scholar
Pennycook, G., Cheyne, J. A., Koehler, D. J., & Fugelsang, J. A. (2016). Is the cognitive reflection test a measure of both reflection and intuition?. Behavior Research Methods, 48, 341348.10.3758/s13428-015-0576-1CrossRefGoogle Scholar
Rand, D. G., Brescoll, V. L., Everett, J. A., Capraro, V., & Barcelo, H. (2016). Social heuristics and social roles: Intuition favors altruism for women but not for men. Journal of Experimental Psychology: General, 145, 389396.CrossRefGoogle Scholar
Reb, J., & Connolly, T. (2007). Possession, feelings of ownership, and the endowment effect. Judgment and Decision Making, 2, 107114.10.1017/S1930297500000085CrossRefGoogle Scholar
Stahl, II, Wilson, D. O., & W., P. (1994). Experimental evidence on players’ models of other players. Journal of Economic Behavior & Organization, 25, 309327.CrossRefGoogle Scholar
Tappin, B. M., & Capraro, V. (2018). Doing good vs. avoiding bad in prosocial choice: A refined test and extension of the morality preference hypothesis. Journal of Experimental Social Psychology, 79, 6470.CrossRefGoogle Scholar
Vanzo, A., Croce, D., & Basili, R. (2014). A context-based model for sentiment analysis in twitter. In Proceedings of coling 2014, the 25th international conference on computational linguistics: Technical papers (pp. 23452354).Google Scholar
Figure 0

Figure 1: Frequencies of participants choosing each frame. The horizontal line, corresponding to 1/6, denotes the frequency of people who would choose any frame if they were to choose uniformly at random. Error bars stand for the standard errors of the means.

Figure 1

Figure 2: Frequencies of receivers believing that the dictator will be altruistic, by frame.

Figure 2

Figure 3: Proportions of dictators and receivers choosing the steal frame.

Supplementary material: File

Capraro et al. supplementary material

Capraro et al. supplementary material 1
Download Capraro et al. supplementary material(File)
File 98.8 KB
Supplementary material: File

Capraro et al. supplementary material

Capraro et al. supplementary material 2
Download Capraro et al. supplementary material(File)
File 52.2 KB
Supplementary material: File

Capraro et al. supplementary material

Capraro et al. supplementary material 3
Download Capraro et al. supplementary material(File)
File 56.8 KB