---
title: "Why you should (or shouldn't) do A/B testing. at Minnebar (2022)"
source: "/speaks/why-you-should-or-shouldnt-minnebar-june-2022/"
---

Speech

# Why you should (or shouldn't) do A/B testing.

Matt Schraan & Ali Joaquin

June 4, 2022

## About the talk

A/B testing is an incredibly valuable tool for data-driven product management. But, it doesn't come for free and it isn't the only available method for vetting new user experiences. Taken to its logical extreme, if you were to A/B test every feature in your product, you would be throwing away 50% of your product team's work!

So given that opportunity cost, is A/B testing even worth it? Well... it depends!

In this session, we'll engage in some real talk about A/B testing. Join us if you are interested in chewing on any of these questions.

- What makes for a good A/B testing opportunity?

- Why is A/B testing so costly, and how can we minimize that?

- How do you design a good A/B test?

- How do you implement a good A/B test?

- How should you go about interpreting your A/B test results?

## Presented by

Matt Schraan

VP, Product Management

[More from Matt](/team/matt-schraan/)

Matt Schraan

Ali Joaquin

Director, Design

[More from Ali](/team/ali-joaquin/)

Ali Joaquin

## About Livefront

Livefront builds intelligent products, platforms, and agents for the world's most admired companies. Partner with us to move faster, think bigger, and drive material business outcomes with AI.

### Tags

[Experience Design](/insights/all/?topic=experience-design) [Strategy & Product](/insights/all/?topic=strategy-product)

### Share

-   Copied

## View these next.

[See all](/insights/all/?type=speaking)

-   [

    Speech

    Humans in the Loop: Hiring Software Engineers in the AI Era

    Pete Jones & Nick Krantz

    ](/speaks/humans-in-the-loop-hiring-open-source-north-may-2026/)
-   [

    Speech

    Preppers & Comrades Unite: Building a Decentralized Mesh Network for Resilient Communication

    Chris Wodicka

    ](/speaks/preppers-comrades-unite-building-minnebar-may-2026/)
-   [

    Speech

    Let's Animate! An Introduction to RIVE.APP

    Shalanah Dawson

    ](/speaks/lets-animate-an-introduction-to-minnebar-may-2026/)