Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-05T13:10:06.180Z Has data issue: false hasContentIssue false

Islamic State's Terrorist Attacks Disengage Their Supporters: Robust Evidence from Twitter

Published online by Cambridge University Press:  31 January 2022

Joan Barceló*
Affiliation:
New York University-Abu Dhabi, Abu Dhabi, United Arab Emirates
Elena Labzina
Affiliation:
Microsoft, Commercial Software Engineering, Zurich, Switzerland
*
*Corresponding author. Email: [email protected]

Abstract

This article responds to Hansen's (2022) comment on the use of social media data to evaluate the effects of terrorist attacks on related online behavior. Hansen casts doubts on our previous finding that terrorist attacks disengage supporters of terrorist groups. The author speculates that this result might not hold when considering the bias introduced by the timing of Twitter account suspensions. We contend that this critique is deficient in several respects. First, Hansen speculates about a possible bias, yet no empirical evidence is offered to support this claim. Second, the author largely ignores our discussion of the role of Twitter account suspensions and our measures of Twitter suspension efforts and Anonymous reporting activity to alleviate this concern. In this article, rather than engaging in a qualitative debate on the amount of bias, we make two contributions. First, we offer an empirical investigation of the fragility of our previous finding to the presence of omitted variable bias. Once we account for Twitter suspension activities, we find that an extreme, unlikely amount of confounding is required to alter the estimated effect of terrorist attacks on disengagement. Second, we employ sequential g-estimation to calculate the average controlled direct effect of terrorist attacks on disengagement after controlling for two intermediate confounders: Twitter suspension behavior and Anonymous reporting activities. The estimated average controlled direct effect indicates that Islamic State's terrorist attacks significantly reduced followers in Islamic State-related Twitter accounts after de-mediating this effect from Twitter suspension efforts and Anonymous reporting activities. Further, we show that this average controlled direct effect is robust to a massive, and implausible, violation of the sequential unconfoundedness assumption. Overall, these analyses show that the timing of Twitter account suspensions, as well as any other confounder, is extremely unlikely to alter our conclusion: Islamic State's terrorist attacks disengage their supporters. We conclude this article by offering guidance on how to address practical challenges in political science research using social media data.

Type
Response
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Acharya, A, Blackwell, M, and Sen, M (2016) Explaining causal findings without bias: detecting and assessing direct effects. American Political Science Review 110(3), 512.CrossRefGoogle Scholar
Alonso, R (2011) Why do terrorists stop? Analyzing why ETA members abandon or continue with terrorism. Studies in Conflict & Terrorism 34(9), 696716.CrossRefGoogle Scholar
Barberá, P and Rivero, G (2015) Understanding the political representativeness of Twitter users. Social Science Computer Review 33(6), 712729.CrossRefGoogle Scholar
Barberá, P et al. (2015) Tweeting from left to right: is online political communication more than an echo chamber? Psychological Science 26(10), 15311542.CrossRefGoogle ScholarPubMed
Barceló, J and Labzina, E (2020) Do Islamic State's deadly attacks disengage, deter, or mobilize supporters? British Journal of Political Science 50(4), 15391559.CrossRefGoogle Scholar
Barceló, J and Labzina, E (2021) Replication Data for: “Islamic State's Terrorist Attacks Disengage Their Supporters: Robust Evidence from Twitter,” https://doi.org/10.7910/DVN/B02HVQ, Harvard Dataverse, V1.CrossRefGoogle Scholar
Berger, JM and Perez, H (2016) The Islamic State's Diminishing Returns on Twitter: How Suspensions Are Limiting the Social Networks of English-Speaking ISIS Supporters. George Washington University. Available from https://bit.ly/3AYxO6KGoogle Scholar
Bjørgo, T (2011) Dreams and disillusionment: engagement in and disengagement from militant extremist groups. Crime, Law and Social Change 55(4), 277285.CrossRefGoogle Scholar
Cinelli, C and Hazlett, C (2020) Making sense of sensitivity: extending omitted variable bias. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 82(1), 3967.CrossRefGoogle Scholar
Cinelli, C, Ferwerda, J, and Hazlett, C (2020) Sensemakr: Sensitivity Analysis Tools for OLS in R and Stata. Working paper. Available from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3588978CrossRefGoogle Scholar
Fischer-Preßler, D, Schwemmer, C, and Fischbach, K (2019) Collective sense-making in times of crisis: connecting terror management theory with Twitter user reactions to the Berlin terrorist attack. Computers in Human Behavior 100, 138151.CrossRefGoogle Scholar
Garcia, D and Rimé, B (2019) Collective emotions and social resilience in the digital traces after a terrorist attack. Psychological Science 30(4), 617628.CrossRefGoogle ScholarPubMed
Hansen, T (2022) The perils of estimating disengagement effects of deadly terrorist attacks utilizing social media data. British Journal of Political Science. doi: 10.1017/S000712342100017X.CrossRefGoogle Scholar
Huang, X et al. (2020) Twitter reveals human mobility dynamics during the COVID-19 pandemic. PloS One 15(11), e0241957.CrossRefGoogle ScholarPubMed
Jones, NM and Silver, RC (2020) This is not a drill: anxiety on Twitter following the 2018 Hawaii false missile alert. American Psychologist 75(5), 683.CrossRefGoogle ScholarPubMed
Mellon, J and Prosser, C (2017) Twitter and Facebook are not representative of the general population: political attitudes and demographics of British social media users. Research & Politics 4(3), 2053168017720008.CrossRefGoogle Scholar
Mitts, T (2019) From isolation to radicalization: anti-Muslim hostility and support for ISIS in the West. American Political Science Review 113(1), 173194.CrossRefGoogle Scholar
Montgomery, JM, Nyhan, B, and Torres, M (2018) How conditioning on posttreatment variables can ruin your experiment and what to do about it. American Journal of Political Science 62(3), 760775.CrossRefGoogle Scholar
Novet, J (2015) One app maker has shut down almost 80 secret channels used by ISIS to communicate. Business Insider, November 18. https://www.businessinsider.com/telegram-cracks-down-on-isis-related-channels-2015-11Google Scholar
Reinares, F (2011) Exit from terrorism: a qualitative empirical study on disengagement and deradicalization among members of ETA. Terrorism and Political Violence 23(5), 780803.CrossRefGoogle Scholar
Zeitzoff, T (2011) Using social media to measure conflict dynamics: an application to the 2008–2009 Gaza conflict. Journal of Conflict Resolution 55(6), 938969.CrossRefGoogle Scholar
Supplementary material: Link

Barceló and Labzina Dataset

Link