Product
Caret Symbol
Products
Experimentation
Learn more
Feature Flagging
Learn more
Personalization
Learn more
Geolift
Learn more
Key features
Warehouse Native
Artificial Intelligence
Reporting
Protocols
Resources
Caret Symbol
RESOURCES
Case Studies
Outperform
Updates
White Papers
FEATURED CASE STUDY
Turning AI hype into tangible business value through experimentation
Learn more
Blog
Header Nav OpenHeader Nav Close
Product
Caret Symbol
Products
Experimentation
Feature Flagging
Personalization
Geolift
Key Features
Warehouse Native
Artificial Intelligence
Reporting
Protocols
Resources
Caret Symbol
Case Studies
Outperform
Updates
White Papers
Blog
Docs
Offsite link icon

Outperform

The Basics | The Docs  | The Expert Tips | The Inside Scoop
The Basics
The Docs 
The Expert Tips
The Inside Scoop
Presented by Eppo
How businesses win by driving innovation and better decision-making

Outperform

The Basics | The Docs  | The Expert Tips | The Eppo Stuff
Trending now
Experimentation Protocols: Your Practical Path to Better, Faster Testing
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

0

Results

Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test

Measuring impact when you cannot hold out a control group

Read more
Wiggle Underscore SVG Animation
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation

How many engineers will you commit to internal tool buildouts?

Read more
Wiggle Underscore SVG Animation
Statistics
The 4 Types of Validity in an Experiment You Need to Know

Don't let these violations invalidate your experiment results

Read more
Wiggle Underscore SVG Animation
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing

A holistic comparison of statistical methods for online experimentation

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Certified Metrics

Ensure core metric definitions are in sync across experimentation in Eppo, BI, and other data platforms, all managed via GitHub

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Holdouts

Accurately measure the cumulative impact of your experimentation program

Read more
Wiggle Underscore SVG Animation
A/B Testing
Holdouts: Measuring Experiment Impact Accurately

Holdouts help measure the cumulative, long-term impact of an experimentation program. But getting value out of holdouts requires scale and maturity that not all organizations are ready for.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?

When does it make sense to bandit, and when to experiment?

Read more
Wiggle Underscore SVG Animation
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT

Some of my personal takeaways and highlights from a slightly bigger, seemingly more diverse CODE conference.

Read more
Wiggle Underscore SVG Animation
Culture
3 Ways To Sell Your Org on Experimentation

You can’t just say “we should take a scientific approach.” That won’t work.

Read more
Wiggle Underscore SVG Animation
A/B Testing
How to Run Search-Ranking Experiments

Optimizing search ranking algorithms can drive millions of dollars in revenue. Here's how to A/B test them.

Read more
Wiggle Underscore SVG Animation
A/B Testing
When Should I Use Mutually Exclusive Experiments?

Are mutually exclusive experiments necessary, or dangerous? Here's how to run them in Eppo.

Read more
Wiggle Underscore SVG Animation
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests

It’s time for experimentation tools to integrate directly with the CMS instead of trying to imitate them

Read more
Wiggle Underscore SVG Animation
AI/ML
Experimentation Gets AI to the "Real World”

Shailvi Wakhlu explains why machine learning and AI products require experimentation to quantify success.

Read more
Wiggle Underscore SVG Animation
Statistics
CUPED and CUPED++: Bending time in experimentation

Eppo makes CUPED widely available, allowing teams to run experiments up to 65% faster than before.

Read more
Wiggle Underscore SVG Animation
Culture
Designing Eppo Reports

How we designed Eppo Reports to facilitate a shared experimentation journey across an org

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Eppo Reports

Create visually compelling, fully contextualized PDF reports built to communicate experiment results org-wide.

Read more
Wiggle Underscore SVG Animation
A/B Testing
How to Compare LLMs with an A/B Test

Why experiments are necessary to evaluate LLMs - and how you can easily A/B test between various models with Eppo.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Experimentation Metrics: Deciding What To Measure

Metrics are the vehicle that drives change in data-driven organizations. 

Read more
Wiggle Underscore SVG Animation
Statistics
Beware of the Bayesian Imposter

Bayesian and frequentist approaches are fundamentally different, so why do they sometimes yield the same results?

Read more
Wiggle Underscore SVG Animation
Ryan Lucht
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Tyler Buffington
The Bet Test: Spotting Problems in Bayesian A/B Test Analysis
Drew Harry
Make Decisions Before Experimenting
How pre-registration yields more rigorous decisions, faster decisions, and saved time
Julian Runge
Gaming companies run thousands of experiments a year - here’s why and how
Introducing: Eppo Geolift
·
A/B Testing
Statistics
Engineering
Culture

Optimizing for Real Business Impact: A Strategic Framework for Ecommerce Experimentation

Carlos Trujillo
·
February 20, 2025

Gaming companies run thousands of experiments a year - here’s why and how

Julian Runge
·
February 18, 2025

Accelerate Experimentation Adoption with Protocols and Property Analysis

Eric Metelka
·
November 21, 2024

Marketing Incrementality 101

Greg Dale
·
October 25, 2024

Four Customer Characteristics That Should Change Your Experiment Runtime

Simon Jackson
·
May 16, 2024

Your Comprehensive Guide To Creating an Experiment Plan

Kristi Angel
·
March 6, 2024

Surviving the "Peeking Problem": A Self-Help Guide for Product Managers

Eric Metelka
·
February 22, 2024

Holdouts: Measuring Experiment Impact Accurately

Giorgio Martini
·
December 12, 2023

What to Do When You Encounter Sample Ratio Mismatch in A/B Testing

Allon Korem
·
March 6, 2025

The Bet Test: Spotting Problems in Bayesian A/B Test Analysis

Tyler Buffington
·
December 16, 2024

Top 3 Tips from Eppo's Geolift Launch

Elizabeth George
·
November 21, 2024

Bayesian Angels and Frequentist Demons

Sven Schmit
·
July 24, 2024

The Cult of Stat Sig

Giorgio Martini
·
May 29, 2024

Encouragement Design Experiments: When You Can't Run a True A/B Test

Sven Schmit
·
February 20, 2024

The 4 Types of Validity in an Experiment You Need to Know

Kristi Angel
·
January 11, 2024

Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing

Sven Schmit
·
January 8, 2024

Migrating Feature Flagging Tools Is Easy, Actually

Alexey Komissarouk
·
March 7, 2025

Mobile Experimentation with Eppo: From Feature Flags to A/B Testing

Aaron Silverman
·
February 19, 2025

AB Testing 101 for Engineers

Jonathan Fulton
·
October 24, 2024

What’s Wrong with Feature Flags?

Alexey Komissarouk
·
July 24, 2024

What Happened When We Replaced Airflow for DAG Orchestration?

Ryan Lucht
·
July 23, 2024

Building a Custom DAG Orchestration System for Experimentation

Kristi Angel
·
July 22, 2024

Why We Replaced Airflow in our Experimentation Platform

Ryan Lucht
·
July 23, 2024

Incremental Pipelines: Managing State at Scale

Ryan Lucht
·
June 21, 2023

Make Decisions Before Experimenting

Drew Harry
·
January 27, 2025

How We Ran Successful Experimentation Office Hours at Groupon

Anne Kim
·
July 24, 2024

How to Hackathon: Where Experimentation Mindset Meets Rapid Action

Aaron Silverman
·
April 18, 2024

What to Look For in an Experimentation Platform (Beyond Features)

Ryan Lucht
·
March 18, 2024

A Simple "Build vs. Buy" Decision Framework for Experimentation

Che Sharma
·
February 5, 2024

Designing Eppo Reports

Ryan Lucht
·
October 25, 2023

From 10s to 1000s: How to Scale Experimentation Velocity

Kristi Angel
·
July 26, 2023

Be Data-Informed, Not Data-Driven

Ryan Lucht
·
June 5, 2023
New from Eppo
Experimentation Protocols: Your Practical Path to Better, Faster Testing
January 2025 – CJ Towle, Product Marketing Manager
Arrow
Read the Guide

Expert Tips

Unsure how to run experiments? We’ve got you covered!
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
Sven Schmit
·
January 8, 2024
Engineering
What is an ETL Pipeline? Easy Guide with Examples
Sven Schmit
·
May 9, 2024
Tips
What is the DAU/MAU Ratio? In Simple Terms
Ryan Lucht
·
May 9, 2024
Tips
What are Daily Active Users (DAUs) Exactly?
Ryan Lucht
·
May 8, 2024
A/B Testing
Top 8 Optimizely Alternatives Compared Head-to-Head (2024)
Ryan Lucht
·
April 26, 2024
A/B Testing
What is A/B/n Testing? Easy Guide with Examples
Ryan Lucht
·
April 24, 2024
Culture
How to Hackathon: Where Experimentation Mindset Meets Rapid Action
Aaron Silverman
·
April 18, 2024
A/B Testing
10 A/B Testing Metrics You Should Be Tracking & Testing
Ryan Lucht
·
April 18, 2024
Engineering
What is Canary Testing? An Easy Guide (2024)
Sven Schmit
·
April 18, 2024
Tips
What is Bucket Testing? Examples & Best Practices
Ryan Lucht
·
April 16, 2024
Engineering
LaunchDarkly Pricing: Is it Worth The Cost?
Ryan Lucht
·
April 16, 2024
Engineering
Top 8 LaunchDarkly Alternatives for Feature Management & Experimentation (2024)
Ryan Lucht
·
April 10, 2024
Tips
19 SaaS Product Metrics for 2024: Track & Test for Success
Ryan Lucht
·
April 5, 2024
A/B Testing
7 Best A/B Testing Tools in 2024 (Expert Review)
Ryan Lucht
·
April 5, 2024
Tips
Product Strategy Framework: The 5 Top-Performing Frameworks to Consider
Anne Kim
·
April 5, 2024
Eppo News
Introducing: Eppo Contextual Bandits
Sven Schmit
·
April 2, 2024
A/B Testing
7 Benefits of A/B Testing | Is it Really Worth it?
Ryan Lucht
·
April 1, 2024
AI/ML
When Should I Use Contextual Bandit Algorithms vs. Recommendation Systems?
Ryan Lucht
·
March 29, 2024
Culture
What to Look For in an Experimentation Platform (Beyond Features)
Ryan Lucht
·
March 18, 2024
A/B Testing
Your Comprehensive Guide To Creating an Experiment Plan
Kristi Angel
·
March 6, 2024
A/B Testing
Surviving the "Peeking Problem": A Self-Help Guide for Product Managers
Eric Metelka
·
February 22, 2024
Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test
Sven Schmit
·
February 20, 2024
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation
Che Sharma
·
February 5, 2024
Statistics
The 4 Types of Validity in an Experiment You Need to Know
Kristi Angel
·
January 11, 2024
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
·
January 8, 2024
Eppo News
Now Live: Certified Metrics
Che Sharma
·
January 3, 2024
Eppo News
Now Live: Holdouts
Eric Metelka
·
December 14, 2023
A/B Testing
Holdouts: Measuring Experiment Impact Accurately
Giorgio Martini
·
December 12, 2023
A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?
Sven Schmit
·
December 12, 2023
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT
Sven Schmit
·
December 5, 2023
Culture
3 Ways To Sell Your Org on Experimentation
Ryan Lucht
·
December 4, 2023
A/B Testing
How to Run Search-Ranking Experiments
Ryan Lucht
·
November 30, 2023
A/B Testing
When Should I Use Mutually Exclusive Experiments?
Giorgio Martini
·
November 20, 2023
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests
Ryan Lucht
·
November 8, 2023
AI/ML
Experimentation Gets AI to the "Real World”
Ryan Lucht
·
November 8, 2023
Statistics
CUPED and CUPED++: Bending time in experimentation
Che Sharma
·
October 30, 2023
Culture
Designing Eppo Reports
Ryan Lucht
·
October 25, 2023
Eppo News
Now Live: Eppo Reports
Sven Schmit
·
October 17, 2023
A/B Testing
How to Compare LLMs with an A/B Test
Sven Schmit
·
September 12, 2023
A/B Testing
Experimentation Metrics: Deciding What To Measure
Anne Kim
·
August 24, 2023
Statistics
Beware of the Bayesian Imposter
Sven Schmit
·
August 15, 2023
Eppo News
The Most Powerful Diagnostics Tool Just Got Even Better
Kristi Angel
·
August 9, 2023
AI/ML
The "Transformative Force" of AI and Experimentation
Ryan Lucht
·
August 4, 2023
Culture
From 10s to 1000s: How to Scale Experimentation Velocity
Kristi Angel
·
July 26, 2023
AI/ML
AB Experiment Infra is AI Infra
Sven Schmit
·
July 24, 2023
AI/ML
AI Enabled Creators Need AB Experiments
Sven Schmit
·
July 24, 2023
Eppo News
Eppo and Modelbit: Introducing Our Partnership
Sven Schmit
·
July 19, 2023
Engineering
Incremental Pipelines: Managing State at Scale
Ryan Lucht
·
June 21, 2023
Culture
Be Data-Informed, Not Data-Driven
Ryan Lucht
·
June 5, 2023
Eppo News
Introducing the Copy SQL Button
Kristi Angel
·
May 24, 2023
Statistics
The Useful Useless p-value
Sven Schmit
·
May 17, 2023
Culture
How to Craft Compelling, Impactful Experiment Reports
Ryan Lucht
·
May 8, 2023
Eppo News
Eppo Announces Integration With Databricks
Sven Schmit
·
May 3, 2023
Product News
5 Ways to Ensure Data Quality When Running Experiments
Sven Schmit
·
April 25, 2023
Eppo News
Introducing Eppo's New Progress Bar
Kristi Angel
·
March 29, 2023
Culture
Experimentation is Not a Strategy
Hang Le
·
March 16, 2023
Culture
Doing Data Science in Sports, Where Experimentation Happens on the Field
Ryan Lucht
·
February 21, 2023
Product News
Architecting a Global Feature Flag Service
Ryan Lucht
·
February 16, 2023
Eppo News
Eppo partners with InvestInData to power data-driven decision making
Sven Schmit
·
January 19, 2023
Engineering
Introduction to Feature Flagging and Randomization
Anne Kim
·
January 12, 2023
Eppo News
Welcome to your unified feature flagging + experimentation platform
Sven Schmit
·
November 30, 2022
Statistics
What the heck is statistical power anyhow?
Anne Kim
·
October 25, 2022
Strategy
Introduction to Experimentation
Ryan Lucht
·
October 17, 2022
Culture
Tips for Making Experimentation Successful Across Your Organization
Anne Kim
·
September 26, 2022
AI/ML
Machine learning teams are AB experimentation teams
Sven Schmit
·
September 22, 2022
Eppo News
Eppo Obtains SOC 2 Type II Report
Sven Schmit
·
August 1, 2022
Eppo News
We raised $19.5M to bring Airbnb-caliber experimentation to all
Sven Schmit
·
June 22, 2022
Culture
The most impactful thing a data team can do is establish an experimentation program.
Sven Schmit
·
December 7, 2021
Culture
Stop Micromanaging Product Strategy
Sven Schmit
·
September 1, 2021
Eppo News
We're hiring a statistics engineer!
Sven Schmit
·
August 23, 2021
Strategy
Should you always run an experiment?
Sven Schmit
·
August 12, 2021
Culture
The Designer Gap in A/B Testing Tools
Che Sharma
·
June 28, 2021
Statistics
Reducing Experiment Durations
Che Sharma
·
June 17, 2021
Experimentation Frameworks: A Full Guide With Examples
Ryan Lucht
·
A/B Testing
How to Use CRO and A/B Testing Effectively
Ryan Lucht
·
Eppo News
Measuring Experiment Impact Accurately
Holdouts help measure the cumulative, long-term impact of an experimentation program.
Read more
Wiggle Underscore SVG Animation

Not ready to talk just yet?

Take a tour and see the platform for yourself.
Get a demo
Experiment School
Ever wonder how other companies run experiments?

Expert Tips

Marketing
x
Product News
x
Experimentation School
x
Strategy
x
AI/ML
x
A/B Testing
x
Engineering
x
Statistics
x
Eppo News
x
Culture
x
Tips
x