Book contents
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- Part V Advanced Topics for Analyzing Experiments
- 17 The Statistics behind Online Controlled Experiments
- 18 Variance Estimation and Improved Sensitivity: Pitfalls and Solutions
- 19 The A/A Test
- 20 Triggering for Improved Sensitivity
- 21 Sample Ratio Mismatch and Other Trust-Related Guardrail Metrics
- 22 Leakage and Interference between Variants
- 23 Measuring Long-Term Treatment Effects
- References
- Index
20 - Triggering for Improved Sensitivity
from Part V - Advanced Topics for Analyzing Experiments
Published online by Cambridge University Press: 13 March 2020
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- Part V Advanced Topics for Analyzing Experiments
- 17 The Statistics behind Online Controlled Experiments
- 18 Variance Estimation and Improved Sensitivity: Pitfalls and Solutions
- 19 The A/A Test
- 20 Triggering for Improved Sensitivity
- 21 Sample Ratio Mismatch and Other Trust-Related Guardrail Metrics
- 22 Leakage and Interference between Variants
- 23 Measuring Long-Term Treatment Effects
- References
- Index
Summary
Why you care: Triggering provides experimenters with a way to improve sensitivity (statistical power) by filtering out noise created by users who could not have been impacted by the experiment. As organizational experimentation maturity improves, we see more triggered experiments being run.
- Type
- Chapter
- Information
- Trustworthy Online Controlled ExperimentsA Practical Guide to A/B Testing, pp. 209 - 218Publisher: Cambridge University PressPrint publication year: 2020