Book contents
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
16 - Scaling Experiment Analyses
from Part IV - Advanced Topics for Building an Experimentation Platform
Published online by Cambridge University Press: 13 March 2020
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
Summary
Why you care: For a company to move to the later phases of experimentation maturity (“Run” or “Fly”), incorporating data analysis pipelines as part of the experimentation platform can ensure that the methodology is solid, consistent, and scientifically founded, and that the implementation is trustworthy. It also helps save teams from needing to do time-consuming ad hoc analysis. If moving in this direction, understanding the common infrastructure steps for data processing, computation, and visualization can be useful.
- Type
- Chapter
- Information
- Trustworthy Online Controlled ExperimentsA Practical Guide to A/B Testing, pp. 177 - 182Publisher: Cambridge University PressPrint publication year: 2020