Book contents
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
14 - Choosing a Randomization Unit
from Part IV - Advanced Topics for Building an Experimentation Platform
Published online by Cambridge University Press: 13 March 2020
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
Summary
Why you care: The choice of randomization unit is critical in experiment design, as it affects both the user experience as well as what metrics can be used in measuring the impact of an experiment. When building an experimentation system, you need to think through what options you want to make available. Understanding the options and the considerations to use when choosing amongst them will lead to improved experiment design and analysis.
- Type
- Chapter
- Information
- Trustworthy Online Controlled ExperimentsA Practical Guide to A/B Testing, pp. 166 - 170Publisher: Cambridge University PressPrint publication year: 2020