Boosting Experimentation Throughput & Efficiency

Abstract: 

Traditional A/B testing methods can be resource-intensive, as each experiment requires its own control group. In this talk, we introduce the concept of shared control groups in A/B testing, which allows multiple experiments to share a common control group while preserving statistical power and confidence intervals. This approach can significantly boost experimentation throughput, enabling organizations to to test more ideas in less time. We present the theoretical framework for shared control groups and demonstrate how it has helped in dramatically increasing experimentation throughput at Meta.

Bio: 

Sonam Saxena is a seasoned Product Manager with over two decades of experience in the technology sector, having contributed to leading companies such as Microsoft, Google, and Meta Platforms. At Meta, he is part of the Applied AI team and leads the AI/ML Experimentation Team, focusing on enhancing advertiser and customer outcomes through advanced AI and ML models. Sonam's expertise encompasses Experimentation, Artificial Intelligence, ML Infrastructure and advertising.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from - Youtube
Vimeo
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google