Book contents
- Frontmatter
- Contents
- List of Tables
- List of Figures
- Contributors
- Acknowledgments
- INTRODUCTION
- PART I DESIGNING EXPERIMENTS
- PART II THE DEVELOPMENT OF EXPERIMENTS IN POLITICAL SCIENCE
- PART III DECISION MAKING
- PART IV VOTE CHOICE, CANDIDATE EVALUATIONS, AND TURNOUT
- PART V INTERPERSONAL RELATIONS
- PART VI IDENTITY, ETHNICITY, AND POLITICS
- PART VII INSTITUTIONS AND BEHAVIOR
- PART VIII ELITE BARGAINING
- PART IX ADVANCED EXPERIMENTAL METHODS
- 31 Treatment Effects
- 32 Making Effects Manifest in Randomized Experiments
- 33 Design and Analysis of Experiments in Multilevel Populations
- 34 Analyzing the Downstream Effects of Randomized Experiments
- 35 Mediation Analysis Is Harder Than It Looks
- AFTERWORD
- Name Index
- Subject Index
- References
32 - Making Effects Manifest in Randomized Experiments
Published online by Cambridge University Press: 05 June 2012
- Frontmatter
- Contents
- List of Tables
- List of Figures
- Contributors
- Acknowledgments
- INTRODUCTION
- PART I DESIGNING EXPERIMENTS
- PART II THE DEVELOPMENT OF EXPERIMENTS IN POLITICAL SCIENCE
- PART III DECISION MAKING
- PART IV VOTE CHOICE, CANDIDATE EVALUATIONS, AND TURNOUT
- PART V INTERPERSONAL RELATIONS
- PART VI IDENTITY, ETHNICITY, AND POLITICS
- PART VII INSTITUTIONS AND BEHAVIOR
- PART VIII ELITE BARGAINING
- PART IX ADVANCED EXPERIMENTAL METHODS
- 31 Treatment Effects
- 32 Making Effects Manifest in Randomized Experiments
- 33 Design and Analysis of Experiments in Multilevel Populations
- 34 Analyzing the Downstream Effects of Randomized Experiments
- 35 Mediation Analysis Is Harder Than It Looks
- AFTERWORD
- Name Index
- Subject Index
- References
Summary
Experimentalists want precise estimates of treatment effects and nearly always care about how treatment effects may differ across subgroups. After data collection, concern may turn to random imbalance between treatment groups on substantively important variables. Pursuit of these three goals – enhanced precision, understanding treatment effect heterogeneity, and imbalance adjustment – requires background information about experimental units. For example, one may group similar observations on the basis of such variables and then assign treatment within those blocks. Use of covariates after data have been collected raises extra concerns and requires special justification. For example, standard regression tables only approximate the statistical inference that experimentalists desire. The standard linear model may also mislead via extrapolation. After providing some general background about how covariates may, in principle, enable pursuit of precision and statistical adjustment, this chapter presents two alternative approaches to covariance adjustment: one using modern matching techniques and another using the linear model – both use randomization as the basis for statistical inference.
What Is a Manifest Effect?
A manifest effect is one we can distinguish from zero. Of course, we cannot talk formally about the effects of an experimental treatment as manifest without referring to probability: a scientist asks, “Could this result have occurred merely through chance?” or “If the true effect were zero, what is the chance that we'd observe an effect as large as this?”
- Type
- Chapter
- Information
- Cambridge Handbook of Experimental Political Science , pp. 459 - 480Publisher: Cambridge University PressPrint publication year: 2011
References
- 14
- Cited by