A/B testing

A/B testing workshop

This afternoon workshop at CWI will provide a tour of active topics in A/B testing, with speakers from industry deploying A/B testing methods, and academics working at the forefront of research.

A/B testing is the art of using controlled experiments to guide decision making. A/b testing is applied throughout the tech industry for developing and refining on-line services and products. Deployment of A/B testing at ever increasing scale drives the demand for testing efficiency. In response, the past decade of scientific results has brought forth a modern testing methodology, with state-of-the-art methods that optimize sample size and confidence by exploiting dynamic allocation, optional stopping and available prior knowledge.

The workshop will highlight the CWI specialties of algorithm design and statistical testing methodology, and touch on causality and deployment at scale. The workshop aims at knowledge exchange, and connecting research and industry to explore new collaborations.

The workshop is primarily targeted at executives of companies employing A/B testing, as well as interested data scientists and academics.

The preliminary program:

14.00    Christina Katsimerou (Booking.com)
Building a subpopulation-aware A/B experimentation platform at Booking
14.30    Peter Grünwald (CWI & Leiden University) and Rosanne Turner (CWI & UMC Utrecht)
Anytime-valid testing and confidence intervals in contingency tables and beyond
15.00    break
15.30    Alan Malek (Deepmind, formerly Optimizely)
Causality in A/B testing
16.00    Wouter Koolen (CWI)
Instance-optimal algorithms for A/B testing
16.30    drinks

The symposium is freely accessible after registration, please register here.

We are organizing a hybrid event: onsite in the Amsterdam Science Park Congress Centre and via a live video stream. Please also register when you want to join via the live stream – we will then be able to send you the link on the day of the event.

How can we help you?

Looking for partners to collaborate. Or looking for a certain expertise? Or would you like to locate your business in the Amsterdam Science Park? Drop us a line and we help you to find a perfect match.

Leo le Duc Science & Business
For business inquiries contact

Leo Le Duc

+31 (0)20 820 80 60 Let's connect