Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-22T19:25:46.523Z Has data issue: false hasContentIssue false

9 - Field Research Methods

from Part II - Basic Design Considerations to Know, No Matter What Your Research Is About

Published online by Cambridge University Press:  12 December 2024

By
Sherry Jueyu Wu  and
Rebecca Littman
Edited by
Harry T. Reis ,
Tessa West  and
Charles M. Judd
Harry T. Reis
Affiliation:
University of Rochester, New York
Tessa West
Affiliation:
New York University
Charles M. Judd
Affiliation:
University of Colorado Boulder
Get access

Summary

Field research refers to research conducted with a high degree of naturalism. The first part of this chapter provides a definition of field research and discusses advantages and limitations. We then provide a brief overview of observational field research methods, followed by an in-depth overview of experimental field research methods. We discuss randomization schemes of different types in field experimentation, such as cluster randomization, block randomization, and randomized rollout or waitlist designs, as well as statistical implementation concerns when conducting field experiments, including spillover, attrition, and noncompliance. The second part of the chapter provides an overview of important considerations when conducting field research. We discuss the psychology of construal in the design of field research, conducting non-WEIRD field research, replicability and generalizability, and how technological advances have impacted field research. We end by discussing career considerations for psychologists who want to get involved in field research.

Keywords

field researchfield experimentsresearch methodologynaturalismresearch designgeneralizabilitycausal inferencepractical guidance
Type
Chapter
Information
Handbook of Research Methods in Social and Personality Psychology , pp. 193 - 218
Publisher: Cambridge University Press
Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Angrist, J. D., Imbens, G. W., and Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91(434), 444–455.CrossRefGoogle Scholar
Arnett, J. (2008). The neglected 95%: Why American psychology needs to become less American. American Psychologist, 63, 602–614.CrossRefGoogle ScholarPubMed
Aronow, P. M., and Samii, C. (2017). Estimating average causal effects under general interference, with application to a social network experiment. Annals of Applied Statistics, 11, 1912–1947.CrossRefGoogle Scholar
Astuti, R., and Bloch, M. (2010). Why a theory of human nature cannot be based on the distinction between universality and variability: Lessons from anthropology. Behavioral and Brain Sciences, 33(2–3), 83–84.CrossRefGoogle Scholar
Berger, J., Meredith, M., and Wheeler, S. C. (2008). Contextual priming: Where people vote affects how they vote. Proceedings of the National Academy of Sciences, 105(26), 8846–8849.CrossRefGoogle ScholarPubMed
Beshears, J., Dai, H., Milkman, K. L., and Benartzi, S. (2021). Using fresh starts to nudge increased retirement savings. Organizational Behavior and Human Decision Processes, 167, 72–87.CrossRefGoogle ScholarPubMed
Blair, G., Littman, R., and Paluck, E. L. (2019). Motivating the adoption of new community-minded behaviors: An empirical test in Nigeria. Science Advances, 5(3), eaau5175.CrossRefGoogle Scholar
Blair, G., and McClendon, G. (2021). Conducting experiments in multiple contexts. Advances in Experimental Political Science, 411–428.CrossRefGoogle Scholar
Blair, G., Weinstein, J. M., Christia, F., Arias, E., Badran, E., Blair, R. A., … Wilke, A. M. (2021). Community policing does not build citizen trust in police or reduce crime in the global South. Science, 374(6571), eabd3446.CrossRefGoogle ScholarPubMed
Broockman, D., and Kalla, J. (2016). Durably reducing transphobia: A field experiment on door-to-door canvassing. Science, 352(6282), 220–224.CrossRefGoogle ScholarPubMed
Bruner, J. S. (1957). Going beyond the information given. Contemporary Approaches to Cognition, 1, 119–160.Google Scholar
Bullock, J., Green, D., and Ha, S. (2010). Yes, But what’s the mechanism? (Don’t expect an easy answer). Journal of Personality and Social Psychology, 98, 550–558.CrossRefGoogle ScholarPubMed
Carpenter, S. M., Menictas, M., Nahum-Shani, I., Wetter, D. W., and Murphy, S. A. (2020). Developments in mobile health just-in-time adaptive interventions for addiction science. Current Addiction Reports, 7(3), 280–290.CrossRefGoogle ScholarPubMed
Chang, E. H., Milkman, K. L., Gromet, D. M., Rebele, R. W., Massey, C., Duckworth, A. L., and Grant, A. M. (2019). The mixed effects of online diversity training. Proceedings of the National Academy of Sciences, 116(16), 7778–7783.CrossRefGoogle ScholarPubMed
Cialdini, R. B. (1980). Full-cycle social psychology. Applied Social Psychology Annual, 1, 21–47.Google Scholar
Cialdini, R. B., Demaine, L. J., Sagarin, B. J., Barrett, D. W., Rhoads, K., and Winter, P. L. (2006). Managing social norms for persuasive impact. Social Influence, 1(1), 3–15.CrossRefGoogle Scholar
Dai, H., Saccardo, S., Han, M. A., Roh, L., Raja, N., Vangala, S., Modi, H., Pandya, S., Sloyan, M., and Croymans, D. M. (2021). Behavioural nudges increase COVID-19 vaccinations. Nature, 597(7876), 404–409.CrossRefGoogle ScholarPubMed
DiNardo, J., McCrary, J., and Sanbonmatsu, L. (2006). Constructive proposals for dealing with attrition: An empirical example. Working paper, University of Michigan.Google Scholar
Dolan, P., and Galizzi, M. M. (2014). Getting policy-makers to listen to field experiments. Oxford Review of Economic Policy, 30(4), 725–752.CrossRefGoogle Scholar
Dunning, T. (2016). Transparency, replication, and cumulative learning: What experiments alone cannot achieve. Annual Review of Political Science, 19, 541–563.CrossRefGoogle Scholar
Ferraro, P. J., and Agrawal, A. (2021). Synthesizing evidence in sustainability science through harmonized experiments: Community monitoring in common pool resources. Proceedings of the National Academy of Sciences, 118(29), e2106489118.CrossRefGoogle ScholarPubMed
Gerber, A. S., and Green, D. P. (2000). The effects of canvassing, telephone calls, and direct mail on voter turnout: A field experiment. American Political Science Review, 94(3), 653–663.CrossRefGoogle Scholar
Gerber, A. S., and Green, D. P. (2012). Field Experiments: Design, Analysis, and Interpretation. W. W. Norton & Company.Google Scholar
Gerber, A. S., Huber, G. A., Doherty, D., Dowling, C. M., and Ha, S. E. (2010). Personality and political attitudes: Relationships across issue domains and political contexts. American Political Science Review, 104(1), 111–133.CrossRefGoogle Scholar
Gneezy, U., and Rustichini, A. (2000). A fine is a price. Journal of Legal Studies, 29(1), 1–17.CrossRefGoogle Scholar
Graham, J. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.CrossRefGoogle ScholarPubMed
Hansen, P. G., and Jespersen, A. M. (2013). Nudge and the manipulation of choice: A framework for the responsible use of the nudge approach to behaviour change in public policy. European Journal of Risk Regulation, 4(1), 3–28.CrossRefGoogle Scholar
Hansen, J. A., and Tummers, L. (2020). A systematic review of field experiments in public administration. Public Administration Review, 80(6), 921–931.CrossRefGoogle Scholar
Henrich, J. (2020). The Weirdest People in the World: How the West Became Psychologically Peculiar and Particularly Prosperous. Allen Lane.Google Scholar
Henrich, J., Heine, S. J., and Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83.CrossRefGoogle ScholarPubMed
Hong, L., and Page, S. E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences, 101(46), 16385–16389.CrossRefGoogle ScholarPubMed
Hudgens, M. G., and Halloran, M. E. (2008). Toward causal inference with interference. Journal of the American Statistical Association, 103(482), 832–842.CrossRefGoogle ScholarPubMed
Hussey, M. A., and Hughes, J. P. (2007). Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials, 28(2), 182–191.CrossRefGoogle ScholarPubMed
Inglehart, R., and Welzel, C. (2005). Modernization, Cultural Change, and Democracy: The Human Development Sequence. Cambridge University Press.Google Scholar
International Telecommunication Union. (2021). Facts and Figures 2021: 2.9 Billion People Still Offline (November 2021), www.itu.int/hub/2021/11/facts-and-figures-2021-2-9-billion-people-still-offline/#:~:text=An%20estimated%2037%20per%20cent,still%20never%20used%20the%20Internet.Google Scholar
James, W. (1907). Pragmatism’s conception of truth. The Journal of Philosophy. Psychology and Scientific Methods, 4(6), 141–155.Google Scholar
Kapiszewski, D., MacLean, L. M., and Read, B. L. (2015). Field Research in Political Science: Practices and Principles. Cambridge University Press.CrossRefGoogle Scholar
Keep Britain Tidy (2015). How Clean Is England? (December 2015), www.keepbritaintidy.org/sites/default/files/resources/KBT_How_Clean_Is_England_LEQSE_Report_2015.pdf.Google Scholar
King, G., Pan, J., and Roberts, M. (2013). How censorship in China allows government criticism but silences collective expression. American Political Science Review, 107(2), 326–343.CrossRefGoogle Scholar
Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., AdamsJr, R. B., Alper, S., … Sowden, W. (2018). Many labs 2: Investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443–490.CrossRefGoogle Scholar
Lewin, K. (1944/1997). Problems of research in social psychology. In Lewin, K., Resolving Social Conflicts & Field Theory in Social Science. American Psychological Association.CrossRefGoogle Scholar
Lewin, K. (1947). Frontiers in group dynamics: II. Channels of group life; social planning and action research. Human Relations, 1(2), 143–153.CrossRefGoogle Scholar
Liberman, V., Samuels, S. M., and Ross, L. (2004). The name of the game: Predictive power of reputations versus situational labels in determining prisoner’s dilemma game moves. Personality and Social Psychology Bulletin, 30(9), 1175–1185.CrossRefGoogle ScholarPubMed
Marrow, A. J. (1977). The practical theorist: The life and work of Kurt Lewin. Teachers College Press.Google Scholar
Meadon, M., and Spurrett, D. (2010). It’s not just the subjects – there are too many WEIRD researchers. Behavioral and Brain Sciences, 33(2–3), 104–105.CrossRefGoogle Scholar
Moore-Berg, S. L., Bernstein, K., Gallardo, R. A., Hameiri, B., Littman, R., O’Neil, S., and Pasek, M. H. (2022). Translating social science for peace: Benefits, challenges, and recommendations. Peace and Conflict: Journal of Peace Psychology, 28(3), 274–283.CrossRefGoogle Scholar
Nickerson, D. W. (2008). Is voting contagious? Evidence from two field experiments. American Political Science Review, 102(1), 49–57.CrossRefGoogle Scholar
Paluck, E. (2009). Reducing intergroup prejudice and conflict using the media: A field experiment in Rwanda. Journal of Personality and Social Psychology, 96, 574–587.CrossRefGoogle Scholar
Paluck, E. L., and Cialdini, R. B. (2014). Field research methods. In Judd, C. M. and Reis, H. T. (eds.) Handbook of Research Methods in Social and Personality Psychology, 2nd ed. Cambridge University Press.Google Scholar
Paluck, E. L., and Shafir, E. (2017). Chapter 6. The psychology of construal in the design of field experiment revised version, prepared following the NBER Conference on Economics of Field Experiments, organized by Esther Duflo & Abhijit Banerjee. In Banerjee, A. V. and Duflo, E. (eds.) Handbook of Economic Field Experiments, vol. 1. North-Holland.Google Scholar
Pan, J. (2019). How Chinese officials use the Internet to construct their public image. Political Science Research and Methods, 7(2), 197–213.CrossRefGoogle Scholar
Center, Pew Research (2021). Internet/broadband fact sheet (April 2021), www.pewresearch.org/internet/fact-sheet/internet-broadband.Google Scholar
Radsch, C. (2009). From cell phones to coffee: Issues of access in Egypt and Lebanon. In Sriram, C. L., King, J. C., Mertus, J. A., Martin-Ortega, O., and Herman, J. (eds.) Surviving field research: working in violent and difficult situations, Abingdon, Oxon.Google Scholar
Read, B. L., Kapiszewski, D., and MacLean, L. M. (eds.). (2015). Field research in political science: Practices and principles. In Kapiszewski, D., MacLean, L. M., and Read, B. L., Field Research in Political Science: Practices and Principles. Cambridge University Press.Google Scholar
Roberts, S. O., Bareket-Shavit, C., Dollins, F. A., Goldie, P. D., and Mortenson, E. (2020). Racial inequality in psychological research: Trends of the past and recommendations for the future. Perspectives on Psychological Science, 15(6), 1295–1309.CrossRefGoogle ScholarPubMed
Ross, L., and Nisbett, R. E. (1991). The person and the situation: Perspectives of social psychology. In Ross, L. and Nisbett, R. E., The Person and the Situation: Perspectives of Social Psychology. McGraw-Hill.Google Scholar
Rozin, P. (2009). What kind of empirical research should we publish, fund, and reward? A different perspective. Perspectives on Psychological Science, 4(4), 435–439.CrossRefGoogle ScholarPubMed
Rozin, P. (2010). The weirdest people in the world are a harbinger of the future of the world. Behavioral and Brain Sciences, 33(2–3), 108–109.CrossRefGoogle ScholarPubMed
Rubin, D. B. (2001). Using propensity scores to help design observational studies: Application to the tobacco litigation. Health Services and Outcomes Research Methodology, 2(3), 169–188.CrossRefGoogle Scholar
Rubin, D. B. (2005). Causal inference using potential outcomes. Journal of the American Statistical Association, 100(469), 322–331.CrossRefGoogle Scholar
Ruggeri, K., Većkalov, B., Bojanić, L., Andersen, T. L., Ashcroft-Jones, S., Ayacaxli, N., … Folke, T. (2021). The general fault in our fault lines. Nature Human Behaviour, 5(10), 1369–1380.CrossRefGoogle ScholarPubMed
Shadish, W. R., Cook, T. D., and Campbell, D. T. (2002). Experimental and Quasi-experimental Designs for Generalized Causal Inference. Houghton Mifflin and Company.Google Scholar
Shafer, K., and Lohse, B. (2005). How to Conduct a Cognitive Interview: A Nutrition Education Example. U.S. Department of Agriculture, National Institute of Food and Agriculture.Google Scholar
Sheely, A. (2013). Second-order devolution and administrative exclusion in the temporary assistance for needy families program. Policy Studies Journal, 41(1), 54–69.CrossRefGoogle Scholar
Silver, L. (2019). Smartphone ownership is growing rapidly around the world but not always equally (February 5, 2019). Pew Research Center, www.pewresearch.org/global/2019/02/05/digital-connectivity-growing-rapidly-in-emerging-economies.Google Scholar
Voigt, R., Camp, N. P., Prabhakaran, V., Hamilton, W. L., Hetey, R. C., Griffiths, C. M., Jurgens, D., Jurafsky, D., and Eberhardt, J. L. (2017). Language from police body camera footage shows racial disparities in officer respect. Proceedings of the National Academy of Sciences, 114(25), 6521–6526.CrossRefGoogle ScholarPubMed
Walton, G. M., and Cohen, G. L. (2011). A brief social-belonging intervention improves academic and health outcomes of minority students. Science, 331(6023), 1447–1451.CrossRefGoogle ScholarPubMed
Willis, G. (2022). Cognitive Interviewing. Sage.Google Scholar
Wood, E. J. (2009). 123 Field Research. In Boix, C. and Stokes, S. C. (eds.) The Oxford Handbook of Comparative Politics. Oxford University Press.Google Scholar
Wu, S. J., Mai, M., Zhuang, M., and Yi, F. (2024). Having a voice in your community: A large-scale field experiment on participatory decision-making in China. Manuscript submitted for publication.Google Scholar
Wu, S. J., and Paluck, E. L. (2020). Participatory practices at work change attitudes and behavior toward societal authority and justice. Nature Communications, 11(1), 2633.CrossRefGoogle ScholarPubMed
Wu, S. J., and Paluck, E. L. (2021). Designing nudges for the context: Golden coin decals nudge workplace behavior in China. Nudges and Choice Architecture in Organizations, 163, 43–50.Google Scholar
Wu, S. J., and Paluck, E. L. (2022). Having a voice in your group: Increasing productivity through group participation. Behavioural Public Policy, https://doi.org/10.1017/bpp.2022.9.CrossRefGoogle Scholar
Wu, S. J., Yuhan Mei, B., and Cervantez, J. (2022). Preferences and perceptions of workplace participation: A cross-cultural study. Frontiers in Psychology, 13, 806481.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×