Product
Caret Symbol
Products
Experimentation
Learn more
Feature Flagging
Learn more
Personalization
Learn more
Key features
Warehouse Native
Artificial Intelligence
Reporting
Resources
Caret Symbol
RESOURCES
Case Studies
Outperform
Updates
White Papers
FEATURED CASE STUDY
Turning AI hype into tangible business value through experimentation
Learn more
About
Header Nav OpenHeader Nav Close
Product
Caret Symbol
Products
Experimentation
Feature Flagging
Personalization
Key Features
Warehouse Native
Artificial Intelligence
Reporting
Resources
Caret Symbol
Case Studies
Outperform
Updates
White Papers
About
Docs
Offsite link icon

Outperform

Presented by Eppo
How businesses win by driving innovation and better decision-making

Outperform

Trending now
Introducing the Experiment Performance Scorecard
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

0

Results

Eppo News
Introducing: Eppo Contextual Bandits

Unlock new possibilities for 1:1 personalization

Read more
Wiggle Underscore SVG Animation
A/B Testing
7 Benefits of A/B Testing | Is it Really Worth it in 2024?

Learn about the top benefits of A/B testing that your business should be taking advantage of in 2024.

Read more
Wiggle Underscore SVG Animation
AI/ML
When Should I Use Contextual Bandit Algorithms vs. Recommendation Systems?

Picking the right tool for building personalization

Read more
Wiggle Underscore SVG Animation
Culture
What to Look For in an Experimentation Platform (Beyond Features)

How to make a strategic decision and look for alignment, not just a laundry list of functionality

Read more
Wiggle Underscore SVG Animation
A/B Testing
Your Comprehensive Guide To Creating an Experiment Plan

A "How To" Based On My Lessons Learned In the Trenches

Read more
Wiggle Underscore SVG Animation
A/B Testing
Surviving the "Peeking Problem": A Self-Help Guide for Product Managers

How to avoid the pitfalls of peeking at A/B tests without flying blind

Read more
Wiggle Underscore SVG Animation
Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test

Measuring impact when you cannot hold out a control group

Read more
Wiggle Underscore SVG Animation
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation

How many engineers will you commit to internal tool buildouts?

Read more
Wiggle Underscore SVG Animation
Statistics
The 4 Types of Validity in an Experiment You Need to Know

Don't let these violations invalidate your experiment results

Read more
Wiggle Underscore SVG Animation
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing

A holistic comparison of statistical methods for online experimentation

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Certified Metrics

Ensure core metric definitions are in sync across experimentation in Eppo, BI, and other data platforms, all managed via GitHub

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Holdouts

Accurately measure the cumulative impact of your experimentation program

Read more
Wiggle Underscore SVG Animation
A/B Testing
Holdouts: Measuring Experiment Impact Accurately

Holdouts help measure the cumulative, long-term impact of an experimentation program. But getting value out of holdouts requires scale and maturity that not all organizations are ready for.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?

When does it make sense to bandit, and when to experiment?

Read more
Wiggle Underscore SVG Animation
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT

Some of my personal takeaways and highlights from a slightly bigger, seemingly more diverse CODE conference.

Read more
Wiggle Underscore SVG Animation
Culture
3 Ways To Sell Your Org on Experimentation

You can’t just say “we should take a scientific approach.” That won’t work.

Read more
Wiggle Underscore SVG Animation
A/B Testing
How to Run Search-Ranking Experiments

Optimizing search ranking algorithms can drive millions of dollars in revenue. Here's how to A/B test them.

Read more
Wiggle Underscore SVG Animation
A/B Testing
When Should I Use Mutually Exclusive Experiments?

Are mutually exclusive experiments necessary, or dangerous? Here's how to run them in Eppo.

Read more
Wiggle Underscore SVG Animation
AI/ML
Experimentation Gets AI to the "Real World”

Shailvi Wakhlu explains why machine learning and AI products require experimentation to quantify success.

Read more
Wiggle Underscore SVG Animation
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests

It’s time for experimentation tools to integrate directly with the CMS instead of trying to imitate them

Read more
Wiggle Underscore SVG Animation
Lenny Rachitsky
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Kristi Angel
How We Ran Successful Experimentation Office Hours at Groupon
Ideas for training and nurturing experimenters across the company
Alexey Komissarouk
What’s Wrong with Feature Flags?
Engineering and Growth teams aren't speaking the same language
Sven Schmit
Bayesian Angels and Frequentist Demons
Why do Bayesian and Frequentist claims sound so different?
Introducing: Eppo Geolift
·
A/B Testing
Statistics
Engineering
Culture

Marketing Incrementality 101

Greg Dale
·
October 25, 2024

Four Customer Characteristics That Should Change Your Experiment Runtime

Simon Jackson
·
May 16, 2024

Your Comprehensive Guide To Creating an Experiment Plan

Kristi Angel
·
March 6, 2024

Surviving the "Peeking Problem": A Self-Help Guide for Product Managers

Eric Metelka
·
February 22, 2024

Holdouts: Measuring Experiment Impact Accurately

Giorgio Martini
·
December 12, 2023

How to Run Search-Ranking Experiments

Aaron Maurer
·
November 30, 2023

When Should I Use Mutually Exclusive Experiments?

Heather Hargreaves
·
November 20, 2023

CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests

Ryan Lucht
·
November 8, 2023

Bayesian Angels and Frequentist Demons

Sven Schmit
·
July 24, 2024

The Cult of Stat Sig

Giorgio Martini
·
May 29, 2024

Encouragement Design Experiments: When You Can't Run a True A/B Test

Sven Schmit
·
February 20, 2024

The 4 Types of Validity in an Experiment You Need to Know

Kristi Angel
·
January 11, 2024

Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing

Sven Schmit
·
January 8, 2024

What We Heard at the 2023 Conference on Digital Experimentation @ MIT

Sven Schmit
·
December 5, 2023

Beware of the Bayesian Imposter

Sven Schmit
·
August 15, 2023

The Useful Useless p-value

Sven Schmit
·
May 17, 2023

AB Testing 101 for Engineers

Jonathan Fulton
·
October 24, 2024

What’s Wrong with Feature Flags?

Alexey Komissarouk
·
July 24, 2024

What Happened When We Replaced Airflow for DAG Orchestration?

Lisa Huynh
·
July 23, 2024

Building a Custom DAG Orchestration System for Experimentation

Eric Petzel
·
July 22, 2024

Why We Replaced Airflow in our Experimentation Platform

Chas DeVeas
·
July 23, 2024

Incremental Pipelines: Managing State at Scale

Evan Miller
·
June 21, 2023

5 Ways to Ensure Data Quality When Running Experiments

Mikkel Dengsøe
·
April 25, 2023

Introduction to Feature Flagging and Randomization

Justin Gage
·
January 12, 2023

How We Ran Successful Experimentation Office Hours at Groupon

Kristi Angel
·
July 24, 2024

How to Hackathon: Where Experimentation Mindset Meets Rapid Action

Aaron Silverman
·
April 18, 2024

What to Look For in an Experimentation Platform (Beyond Features)

Ryan Lucht
·
March 18, 2024

A Simple "Build vs. Buy" Decision Framework for Experimentation

Che Sharma
·
February 5, 2024

Designing Eppo Reports

Megan Matsumoto
·
October 25, 2023

From 10s to 1000s: How to Scale Experimentation Velocity

Lukas Goetz-Weiss
·
July 26, 2023

Be Data-Informed, Not Data-Driven

Rick Saporta
·
June 5, 2023

How to Craft Compelling, Impactful Experiment Reports

Adam Stone
·
May 8, 2023
E-Book
The Warehouse-Native experimentation workflow
August 2024 – John Hanson, Customer Data Scientist
Download E-Book

Expert Tips

Unsure how to run experiments? We’ve got you covered!
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
·
January 8, 2024
Eppo News
Measure Your Marketing Spend with Eppo Geolift
Greg Dale
·
October 29, 2024
A/B Testing
Marketing Incrementality 101
Greg Dale
·
October 25, 2024
Engineering
AB Testing 101 for Engineers
Jonathan Fulton
·
October 24, 2024
Tips
Eppo vs. Optimizely
Eric Metelka
·
September 11, 2024
Eppo News
Introducing the Experiment Performance Scorecard
Eric Metelka
·
September 4, 2024
Tips
Eppo vs. Statsig
Eric Metelka
·
August 23, 2024
Eppo News
Announcing Eppo's $28M Series B, and Why We Raised
Che Sharma
·
August 20, 2024
Tips
Databricks vs. Redshift: Which one is best in 2024?
Ryan Lucht
·
August 8, 2024
Tips
Top 6 VWO alternatives compared (2024)
Ryan Lucht
·
August 8, 2024
Optimizely vs. Google Optimize vs. Eppo: Which is best?
Ryan Lucht
·
August 8, 2024
Tips
LaunchDarkly vs. Rollout vs. Eppo: Which one is best?
Ryan Lucht
·
August 8, 2024
Strategy
What is a conversion funnel? Full guide with examples
Ryan Lucht
·
August 2, 2024
Tips
What is a digital experience platform (DXP)? In simple terms
Ryan Lucht
·
August 2, 2024
Tips
25 product management metrics you should be tracking
Ryan Lucht
·
August 1, 2024
Tips
What is a technical product manager (and what do they do)?
Ryan Lucht
·
August 1, 2024
Tips
What is a north star metric? + how to find it
Ryan Lucht
·
August 1, 2024
Statistics
Bayesian Angels and Frequentist Demons
Sven Schmit
·
July 24, 2024
Strategy
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Lenny Rachitsky
·
July 24, 2024
Engineering
What’s Wrong with Feature Flags?
Alexey Komissarouk
·
July 24, 2024
Culture
How We Ran Successful Experimentation Office Hours at Groupon
Kristi Angel
·
July 24, 2024
Experimentation School
Chetan Sharma On Institutional Knowledge
Che Sharma
·
July 24, 2024
Tips
Snowflake integrations: All the tools you can connect
Ryan Lucht
·
July 24, 2024
Strategy
What's the difference between metrics and analytics?
Ryan Lucht
·
July 24, 2024
Engineering
Why We Replaced Airflow in our Experimentation Platform
Chas DeVeas
·
July 23, 2024
Engineering
What Happened When We Replaced Airflow for DAG Orchestration?
Lisa Huynh
·
July 23, 2024
Engineering
Building a Custom DAG Orchestration System for Experimentation
Eric Petzel
·
July 22, 2024
A/B Testing
What is feature flag-driven development?
Ryan Lucht
·
July 19, 2024
A/B Testing
A/B testing vs. split testing: Which should you use?
Ryan Lucht
·
July 19, 2024
A/B Testing
What is sequential testing? (with examples)
Ryan Lucht
·
July 19, 2024
Tips
Product Roadmap 101: A Complete Guide with Examples
Eric Metelka
·
June 26, 2024
A/B Testing
VWO vs. Optimizely vs. Eppo: Which is best? | 2024
Ryan Lucht
·
June 26, 2024
A/B Testing
Digital experimentation 101: A Guide to Data-Driven Decision
Ryan Lucht
·
June 26, 2024
A/B Testing
Adobe Target vs. Optimizely vs. Eppo: Which One is Best?
Ryan Lucht
·
June 26, 2024
A/B Testing
VWO Review: Is it Worth it in 2024?
Ryan Lucht
·
June 21, 2024
Tips
What are Counter Metrics? (with examples)
Ryan Lucht
·
June 21, 2024
Tips
What is a User Flow? Explained (with Examples)
Ryan Lucht
·
June 21, 2024
Tips
10 Feature Flag Best Practices You Should be Using in 2024
Aaron Silverman
·
June 21, 2024
A/B Testing
LaunchDarkly vs. Optimizely vs. Eppo: Which One is Best?
Ryan Lucht
·
June 21, 2024
A/B Testing
Optimizely Pricing (2024): How Much Does it Cost?
Ryan Lucht
·
June 13, 2024
Engineering
10 Types of Feature Flags you Should Know
Ryan Lucht
·
June 12, 2024
A/B Testing
VWO Pricing (2024): How Much Does it Cost?
Ryan Lucht
·
June 12, 2024
Tips
20 Product Metrics you Should be Tracking
Eric Metelka
·
June 12, 2024
Eppo News
Introducing Layers: Enabling Coordinated Experimentation
Eric Metelka
·
June 6, 2024
AI/ML
How Netflix, Lyft, and Yahoo use Contextual Bandits for Personalization
Ryan Lucht
·
June 5, 2024
Tips
What is Feature Gating? With Examples
Eric Metelka
·
June 5, 2024
Statistics
How to Reduce Type 1 Errors in A/B Testing (Explained)
Ryan Lucht
·
June 5, 2024
Tips
What is Experience Analytics?
Ryan Lucht
·
June 5, 2024
Eppo News
Rebranding Eppo
Hang Le
·
June 4, 2024
Tips
What is Activation Rate? Full Guide With Examples
Ryan Lucht
·
May 30, 2024
Engineering
What Are Feature Flags? + How to Use Them
Aaron Silverman
·
May 30, 2024
Eppo News
Eppo x Perplexity Enterprise Pro
Che Sharma
·
May 29, 2024
Statistics
The Cult of Stat Sig
Giorgio Martini
·
May 29, 2024
Tips
What are Monthly Active Users (MAUs)?
Ryan Lucht
·
May 29, 2024
Eppo News
Joining The "Experimentation Avengers": Eppo's Customer Data Scientist Team
Tyler Buffington
·
May 22, 2024
Tips
Product vs. Marketing Analytics: What's the Difference?
Ryan Lucht
·
May 22, 2024
A/B Testing
What are Guardrail Metrics? With Examples
Ryan Lucht
·
May 22, 2024
Tips
What is The ICE Scoring Method? Explained (with Examples)
Ryan Lucht
·
May 22, 2024
Tips
The AARRR Pirate Metrics Framework Explained
Ryan Lucht
·
May 22, 2024
Engineering
What is an Agile Release Train? Explained (with examples)
Aaron Silverman
·
May 22, 2024
A/B Testing
Four Customer Characteristics That Should Change Your Experiment Runtime
Simon Jackson
·
May 16, 2024
Engineering
What are Rolling Deployments & How do They Work?
Aaron Silverman
·
May 16, 2024
Tips
What are Weekly Active Users (WAUs)? Easy Guide
Ryan Lucht
·
May 15, 2024
A/B Testing
What is an A/A test? Full Guide with Examples
Ryan Lucht
·
May 15, 2024
Tips
What is an Agile Product Roadmap? Explained (With Examples)
Eric Metelka
·
May 15, 2024
Tips
What is the DAU/MAU Ratio? In Simple Terms
Ryan Lucht
·
May 9, 2024
Engineering
What is an ETL Pipeline? Easy Guide with Examples
Aaron Silverman
·
May 9, 2024
Tips
What is Feature Creep? + How to Prevent It (with Examples)
Eric Metelka
·
May 9, 2024
Tips
What is Product Stickiness? Full Guide With Examples
Eric Metelka
·
May 9, 2024
Tips
What are Daily Active Users (DAUs) Exactly?
Ryan Lucht
·
May 8, 2024
A/B Testing
Top 8 Optimizely Alternatives Compared Head-to-Head (2024)
Ryan Lucht
·
April 26, 2024
A/B Testing
What is A/B/n Testing? Easy Guide with Examples
Ryan Lucht
·
April 24, 2024
Culture
How to Hackathon: Where Experimentation Mindset Meets Rapid Action
Aaron Silverman
·
April 18, 2024
Engineering
What is Canary Testing? An Easy Guide (2024)
Aaron Silverman
·
April 18, 2024
A/B Testing
10 A/B Testing Metrics You Should Be Tracking & Testing
Ryan Lucht
·
April 18, 2024
Engineering
LaunchDarkly Pricing: Is it Worth The Cost?
Ryan Lucht
·
April 16, 2024
Tips
What is Bucket Testing? Examples & Best Practices
Ryan Lucht
·
April 16, 2024
Engineering
Top 8 LaunchDarkly Alternatives for Feature Management & Experimentation (2024)
Ryan Lucht
·
April 10, 2024
Tips
Product Strategy Framework: The 5 Top-Performing Frameworks to Consider in 2024
Eric Metelka
·
April 5, 2024
A/B Testing
7 Best A/B Testing Tools in 2024 (Expert Review)
Ryan Lucht
·
April 5, 2024
Tips
19 SaaS Product Metrics for 2024: Track & Test for Success
Ryan Lucht
·
April 5, 2024
Eppo News
Introducing: Eppo Contextual Bandits
Sven Schmit
·
April 2, 2024
A/B Testing
7 Benefits of A/B Testing | Is it Really Worth it in 2024?
Ryan Lucht
·
April 1, 2024
AI/ML
When Should I Use Contextual Bandit Algorithms vs. Recommendation Systems?
Ryan Lucht
·
March 29, 2024
Culture
What to Look For in an Experimentation Platform (Beyond Features)
Ryan Lucht
·
March 18, 2024
A/B Testing
Your Comprehensive Guide To Creating an Experiment Plan
Kristi Angel
·
March 6, 2024
A/B Testing
Surviving the "Peeking Problem": A Self-Help Guide for Product Managers
Eric Metelka
·
February 22, 2024
Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test
Sven Schmit
·
February 20, 2024
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation
Che Sharma
·
February 5, 2024
Statistics
The 4 Types of Validity in an Experiment You Need to Know
Kristi Angel
·
January 11, 2024
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
·
January 8, 2024
Eppo News
Now Live: Certified Metrics
Che Sharma
·
January 3, 2024
Eppo News
Now Live: Holdouts
Eric Metelka
·
December 14, 2023
A/B Testing
Holdouts: Measuring Experiment Impact Accurately
Giorgio Martini
·
December 12, 2023
A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?
Sven Schmit
·
December 12, 2023
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT
Sven Schmit
·
December 5, 2023
Culture
3 Ways To Sell Your Org on Experimentation
Chad Sanderson
·
December 4, 2023
A/B Testing
How to Run Search-Ranking Experiments
Aaron Maurer
·
November 30, 2023
A/B Testing
When Should I Use Mutually Exclusive Experiments?
Heather Hargreaves
·
November 20, 2023
AI/ML
Experimentation Gets AI to the "Real World”
Shailvi Wakhlu
·
November 8, 2023
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests
Ryan Lucht
·
November 8, 2023
Eppo News
Measuring Experiment Impact Accurately
Holdouts help measure the cumulative, long-term impact of an experimentation program.
Read more
Wiggle Underscore SVG Animation

Not ready to talk just yet?

Take a tour and see the platform for yourself.
Get a demo
Experiment School
Ever wonder how other companies run experiments?

Expert Tips

Experimentation School
x
Strategy
x
AI/ML
x
A/B Testing
x
Engineering
x
Statistics
x
Eppo News
x
Culture
x
Tips
x