A/B Testing & Optimization Course — XP² Learning Center
2026-02-28 18:50 Diff

This course will teach you the fundamentals of A/B testing and optimization – from basic concepts, common pitfalls, and proven methods, all the way through evaluating and scaling your results. 

15 Lessons

Lesson 1

An introduction to A/B testing and optimization

A comprehensive guide to A/B testing, explaining the differences between A/B and multivariate testing, how to conduct tests in a structured and progressive way, and the thought process behind choosing the right experiment.

Read Article

Professor David Steinberg of KPA Group

Professor Ron Kenett of KPA Group

Lesson 2

A/A testing and decision making in experimentation

A/A testing is meant to check that the underlying system is running properly. In this post, we’ll cover some of subtle issues to consider as you run them.

Read Article

Data Science and Predictive Modeling Expert

Lesson 3

Why reaching and protecting statistical significance is so important in A/B tests

Delve deeper into the mechanics of “classic” A/B testing, become familiar with the actual meaning of statistical significance, and discover the pitfalls threatening the validity of your test results.

Read Article

Lesson 4

Choosing the right traffic allocation in A/B testing

Learn how to choose the right traffic allocation method for your A/B tests and avoid common pitfalls, ensuring impactful, valid results.

Read Article

VP of Product, Dynamic Yield

Lesson 5

Understanding conversion attribution scoping in A/B testing

Understand the influence of different conversion attribution configurations on your personalization and A/B testing campaigns.

Read Article

VP of Product, Dynamic Yield

Lesson 6

Choosing the right conversion optimization objective

Conversion optimization can be a very powerful process, but it’s easy to get carried away by the methodology. Here’s how to choose the right optimization objective.

Read Article

Data Science and Predictive Modeling Expert

Lesson 7

Frequentist vs. Bayesian approach in A/B testing

The industry is moving toward the Bayesian framework as it is a simpler, less restrictive, more reliable, and more intuitive approach to A/B testing.

Read Article

Professor Ron Kenett of KPA Group

Professor David Steinberg of KPA Group

Lesson 8

Guidelines for running effective Bayesian A/B tests

In this post, we describe the basic ideas behind Bayesian statistics and how they feed into business decisions you will need to make at the end of a test.

Read Article

Lesson 9

Beyond A/B testing: Multi-armed bandit experiments

Learn how multi-armed bandit algorithms conclude experiments earlier than the classic A/B test while making fewer statistical errors on the way.

Read Article

Director of Enterprise Solution Engineering, Dynamic Yield

Lesson 10

Client-side vs server-side A/B testing and personalization

An in-depth analysis of the most important technical considerations when comparing client-side vs server-side rendering.

Read Article

Lesson 11

Segmented A/B tests: Avoiding average experiences

One of the biggest mistakes a company makes when A/B testing is selecting an average audience. Instead, they should be making segmentation an essential part of their test design — here’s how.

Read Article

Lesson 12

The impact of A/B tests and personalization on SEO

Read about Google’s official SEO advice on A/B or multivariate testing, and how to minimize the possible impact of A/B testing on SEO.

Read Article

Data Science and Marketing Analytics Expert

Lesson 13

There are no failed A/B tests: How to ensure every experiment yields meaningful results

With a comprehensive testing methodology and a renewed perspective toward experiment analysis, marketers can start gleaning meaningful insights from every A/B test, no matter the outcome.

Read Article

Senior Director of Marketing, Dynamic Yield

Lesson 14

How to analyze and interpret A/B testing results

Analyzing A/B testing results is one of the most important stages of an experiment. But it’s also the least talked about. Here’s how to do it right.

Read Article

Senior Director of Marketing, Dynamic Yield

Lesson 15

Building an experimentation growth plan: A Kopari Beauty case study

A conversation on personalization, conversion optimization and what makes the coconut the most kickass ingredient known to (wo)man with cosmetics retailer Kopari.

Read Article

Explore more learning paths