Product
Caret Symbol
Products
Experimentation
Learn more
Feature Flagging
Learn more
Personalization
Learn more
Geolift
Learn more
Key features
Warehouse Native
Artificial Intelligence
Reporting
Resources
Caret Symbol
RESOURCES
Case Studies
Outperform
Updates
White Papers
FEATURED CASE STUDY
Turning AI hype into tangible business value through experimentation
Learn more
Blog
Header Nav OpenHeader Nav Close
Product
Caret Symbol
Products
Experimentation
Feature Flagging
Personalization
Geolift
Key Features
Warehouse Native
Artificial Intelligence
Reporting
Resources
Caret Symbol
Case Studies
Outperform
Updates
White Papers
Blog
Docs
Offsite link icon

Outperform

The Basics | The Docs  | The Expert Tips | The Inside Scoop
The Basics
The Docs 
The Expert Tips
The Inside Scoop
Presented by Eppo
How businesses win by driving innovation and better decision-making

Outperform

The Basics | The Docs  | The Expert Tips | The Eppo Stuff
Trending now
Introducing the Experiment Performance Scorecard
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

0

Results

A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?

When does it make sense to bandit, and when to experiment?

Read more
Wiggle Underscore SVG Animation
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT

Some of my personal takeaways and highlights from a slightly bigger, seemingly more diverse CODE conference.

Read more
Wiggle Underscore SVG Animation
Culture
3 Ways To Sell Your Org on Experimentation

You can’t just say “we should take a scientific approach.” That won’t work.

Read more
Wiggle Underscore SVG Animation
A/B Testing
How to Run Search-Ranking Experiments

Optimizing search ranking algorithms can drive millions of dollars in revenue. Here's how to A/B test them.

Read more
Wiggle Underscore SVG Animation
A/B Testing
When Should I Use Mutually Exclusive Experiments?

Are mutually exclusive experiments necessary, or dangerous? Here's how to run them in Eppo.

Read more
Wiggle Underscore SVG Animation
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests

It’s time for experimentation tools to integrate directly with the CMS instead of trying to imitate them

Read more
Wiggle Underscore SVG Animation
AI/ML
Experimentation Gets AI to the "Real World”

Shailvi Wakhlu explains why machine learning and AI products require experimentation to quantify success.

Read more
Wiggle Underscore SVG Animation
Statistics
CUPED and CUPED++: Bending time in experimentation

Eppo makes CUPED widely available, allowing teams to run experiments up to 65% faster than before.

Read more
Wiggle Underscore SVG Animation
Culture
Designing Eppo Reports

How we designed Eppo Reports to facilitate a shared experimentation journey across an org

Read more
Wiggle Underscore SVG Animation
Eppo News
Now Live: Eppo Reports

Create visually compelling, fully contextualized PDF reports built to communicate experiment results org-wide.

Read more
Wiggle Underscore SVG Animation
A/B Testing
How to Compare LLMs with an A/B Test

Why experiments are necessary to evaluate LLMs - and how you can easily A/B test between various models with Eppo.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Experimentation Metrics: Deciding What To Measure

Metrics are the vehicle that drives change in data-driven organizations. 

Read more
Wiggle Underscore SVG Animation
Statistics
Beware of the Bayesian Imposter

Bayesian and frequentist approaches are fundamentally different, so why do they sometimes yield the same results?

Read more
Wiggle Underscore SVG Animation
Eppo News
The Most Powerful Diagnostics Tool Just Got Even Better

Eppo's best-in-class diagnostics ensure that your experiments yield trustworthy, actionable results.

Read more
Wiggle Underscore SVG Animation
AI/ML
The "Transformative Force" of AI and Experimentation

Azadeh Moghtaderi explains why only A/B testing can gauge the magnitude and impact of AI/ML models.

Read more
Wiggle Underscore SVG Animation
Culture
From 10s to 1000s: How to Scale Experimentation Velocity

How do you get from 10 experiments to 1000? Here are some practical tips to scale your velocity.

Read more
Wiggle Underscore SVG Animation
AI/ML
AB Experiment Infra is AI Infra

There is a gold standard for evaluating AI models: Comparing models in AB experiments against business metrics.

Read more
Wiggle Underscore SVG Animation
AI/ML
AI Enabled Creators Need AB Experiments

As the cost of implementing ideas goes to zero, evaluating ideas becomes the bottleneck

Read more
Wiggle Underscore SVG Animation
Eppo News
Eppo and Modelbit: Introducing Our Partnership

You can now combine the most powerful experimentation tool with the best-in-class model deployment platform.

Read more
Wiggle Underscore SVG Animation
Engineering
Incremental Pipelines: Managing State at Scale

Eppo's new pipeline architecture reduces both warehouse costs and pipeline run-times. Here's how we did it.

Read more
Wiggle Underscore SVG Animation
Lenny Rachitsky
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Kristi Angel
How We Ran Successful Experimentation Office Hours at Groupon
Ideas for training and nurturing experimenters across the company
Alexey Komissarouk
What’s Wrong with Feature Flags?
Engineering and Growth teams aren't speaking the same language
Sven Schmit
Bayesian Angels and Frequentist Demons
Why do Bayesian and Frequentist claims sound so different?
Introducing: Eppo Geolift
·
A/B Testing
Statistics
Engineering
Culture

Accelerate Experimentation Adoption with Protocols and Property Analysis

Eric Metelka
·
November 21, 2024

Marketing Incrementality 101

Greg Dale
·
October 25, 2024

Four Customer Characteristics That Should Change Your Experiment Runtime

Simon Jackson
·
May 16, 2024

Your Comprehensive Guide To Creating an Experiment Plan

Kristi Angel
·
March 6, 2024

Surviving the "Peeking Problem": A Self-Help Guide for Product Managers

Eric Metelka
·
February 22, 2024

Holdouts: Measuring Experiment Impact Accurately

Giorgio Martini
·
December 12, 2023

How to Run Search-Ranking Experiments

Aaron Maurer
·
November 30, 2023

When Should I Use Mutually Exclusive Experiments?

Heather Hargreaves
·
November 20, 2023

Correlation vs. Causation in Experimentation and Data Analysis

Ryan Lucht
·
January 14, 2025

The Bet Test: Spotting Problems in Bayesian A/B Test Analysis

Tyler Buffington
·
December 16, 2024

Top 3 Tips from Eppo's Geolift Launch

Elizabeth George
·
November 21, 2024

Bayesian Angels and Frequentist Demons

Sven Schmit
·
July 24, 2024

The Cult of Stat Sig

Giorgio Martini
·
May 29, 2024

Encouragement Design Experiments: When You Can't Run a True A/B Test

Sven Schmit
·
February 20, 2024

The 4 Types of Validity in an Experiment You Need to Know

Kristi Angel
·
January 11, 2024

Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing

Sven Schmit
·
January 8, 2024

AB Testing 101 for Engineers

Jonathan Fulton
·
October 24, 2024

What’s Wrong with Feature Flags?

Alexey Komissarouk
·
July 24, 2024

What Happened When We Replaced Airflow for DAG Orchestration?

Lisa Huynh
·
July 23, 2024

Building a Custom DAG Orchestration System for Experimentation

Eric Petzel
·
July 22, 2024

Why We Replaced Airflow in our Experimentation Platform

Chas DeVeas
·
July 23, 2024

Incremental Pipelines: Managing State at Scale

Evan Miller
·
June 21, 2023

5 Ways to Ensure Data Quality When Running Experiments

Mikkel Dengsøe
·
April 25, 2023

Introduction to Feature Flagging and Randomization

Justin Gage
·
January 12, 2023

How We Ran Successful Experimentation Office Hours at Groupon

Kristi Angel
·
July 24, 2024

How to Hackathon: Where Experimentation Mindset Meets Rapid Action

Aaron Silverman
·
April 18, 2024

What to Look For in an Experimentation Platform (Beyond Features)

Ryan Lucht
·
March 18, 2024

A Simple "Build vs. Buy" Decision Framework for Experimentation

Che Sharma
·
February 5, 2024

Designing Eppo Reports

Megan Matsumoto
·
October 25, 2023

From 10s to 1000s: How to Scale Experimentation Velocity

Lukas Goetz-Weiss
·
July 26, 2023

Be Data-Informed, Not Data-Driven

Rick Saporta
·
June 5, 2023

How to Craft Compelling, Impactful Experiment Reports

Adam Stone
·
May 8, 2023
E-Book
The Warehouse-Native experimentation workflow
August 2024 – John Hanson, Customer Data Scientist
Download
Download E-Book

Expert Tips

Unsure how to run experiments? We’ve got you covered!
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
Sven Schmit
·
January 8, 2024
Strategy
Why Data Types Are Critical to Clean, Actionable Analytics
Ryan Lucht
·
January 15, 2025
Statistics
Correlation vs. Causation in Experimentation and Data Analysis
Ryan Lucht
·
January 14, 2025
Strategy
Smoke Testing in Experimentation and Software Development
Aaron Silverman
·
January 13, 2025
A/B Testing
Clustered Experiments: When Traditional A/B Testing Falls Short
Lukas Goetz-Weiss
·
December 17, 2024
Statistics
The Bet Test: Spotting Problems in Bayesian A/B Test Analysis
Tyler Buffington
·
December 16, 2024
Statistics
Top 3 Tips from Eppo's Geolift Launch
Elizabeth George
·
November 21, 2024
A/B Testing
Accelerate Experimentation Adoption with Protocols and Property Analysis
Eric Metelka
·
November 21, 2024
Eppo News
Measure Your Marketing Spend with Eppo Geolift
Greg Dale
·
October 29, 2024
A/B Testing
Marketing Incrementality 101
Greg Dale
·
October 25, 2024
Engineering
AB Testing 101 for Engineers
Jonathan Fulton
·
October 24, 2024
Tips
Eppo vs. Optimizely
Eric Metelka
·
September 11, 2024
Eppo News
Introducing the Experiment Performance Scorecard
Eric Metelka
·
September 4, 2024
Tips
Eppo vs. Statsig
Eric Metelka
·
August 23, 2024
Eppo News
Announcing Eppo's $28M Series B, and Why We Raised
Che Sharma
·
August 20, 2024
Tips
LaunchDarkly vs. Rollout vs. Eppo: Which one is best?
Ryan Lucht
·
August 8, 2024
Optimizely vs. Google Optimize vs. Eppo: Which is best?
Ryan Lucht
·
August 8, 2024
Tips
Top 6 VWO alternatives compared (2024)
Ryan Lucht
·
August 8, 2024
Tips
Databricks vs. Redshift: Which one is best in 2024?
Ryan Lucht
·
August 8, 2024
Tips
What is a digital experience platform (DXP)? In simple terms
Ryan Lucht
·
August 2, 2024
Strategy
What is a conversion funnel? Full guide with examples
Ryan Lucht
·
August 2, 2024
Tips
What is a north star metric? + how to find it
Ryan Lucht
·
August 1, 2024
Tips
What is a technical product manager (and what do they do)?
Ryan Lucht
·
August 1, 2024
Tips
25 product management metrics you should be tracking
Ryan Lucht
·
August 1, 2024
Strategy
What's the difference between metrics and analytics?
Ryan Lucht
·
July 24, 2024
Tips
Snowflake integrations: All the tools you can connect
Ryan Lucht
·
July 24, 2024
Experimentation School
Chetan Sharma On Institutional Knowledge
Che Sharma
·
July 24, 2024
Culture
How We Ran Successful Experimentation Office Hours at Groupon
Kristi Angel
·
July 24, 2024
Engineering
What’s Wrong with Feature Flags?
Alexey Komissarouk
·
July 24, 2024
Strategy
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Lenny Rachitsky
·
July 24, 2024
Statistics
Bayesian Angels and Frequentist Demons
Sven Schmit
·
July 24, 2024
Engineering
What Happened When We Replaced Airflow for DAG Orchestration?
Lisa Huynh
·
July 23, 2024
Engineering
Why We Replaced Airflow in our Experimentation Platform
Chas DeVeas
·
July 23, 2024
Engineering
Building a Custom DAG Orchestration System for Experimentation
Eric Petzel
·
July 22, 2024
A/B Testing
What is sequential testing? (with examples)
Ryan Lucht
·
July 19, 2024
A/B Testing
A/B testing vs. split testing: Which should you use?
Ryan Lucht
·
July 19, 2024
A/B Testing
What is feature flag-driven development?
Ryan Lucht
·
July 19, 2024
A/B Testing
Adobe Target vs. Optimizely vs. Eppo: Which One is Best?
Ryan Lucht
·
June 26, 2024
A/B Testing
Digital experimentation 101: A Guide to Data-Driven Decision
Ryan Lucht
·
June 26, 2024
A/B Testing
VWO vs. Optimizely vs. Eppo: Which is best? | 2024
Ryan Lucht
·
June 26, 2024
Tips
Product Roadmap 101: A Complete Guide with Examples
Eric Metelka
·
June 26, 2024
A/B Testing
LaunchDarkly vs. Optimizely vs. Eppo: Which One is Best?
Ryan Lucht
·
June 21, 2024
Tips
10 Feature Flag Best Practices You Should be Using in 2024
Aaron Silverman
·
June 21, 2024
Tips
What is a User Flow? Explained (with Examples)
Ryan Lucht
·
June 21, 2024
Tips
What are Counter Metrics? (with examples)
Ryan Lucht
·
June 21, 2024
A/B Testing
VWO Review: Is it Worth it in 2024?
Ryan Lucht
·
June 21, 2024
A/B Testing
Optimizely Pricing (2024): How Much Does it Cost?
Ryan Lucht
·
June 13, 2024
Tips
20 Product Metrics you Should be Tracking
Eric Metelka
·
June 12, 2024
A/B Testing
VWO Pricing (2024): How Much Does it Cost?
Ryan Lucht
·
June 12, 2024
Engineering
10 Types of Feature Flags you Should Know
Ryan Lucht
·
June 12, 2024
Eppo News
Introducing Layers: Enabling Coordinated Experimentation
Eric Metelka
·
June 6, 2024
AI/ML
How Netflix, Lyft, and Yahoo use Contextual Bandits for Personalization
Ryan Lucht
·
June 5, 2024
Tips
What is Experience Analytics?
Ryan Lucht
·
June 5, 2024
Statistics
How to Reduce Type 1 Errors in A/B Testing (Explained)
Ryan Lucht
·
June 5, 2024
Tips
What is Feature Gating? With Examples
Eric Metelka
·
June 5, 2024
Eppo News
Rebranding Eppo
Hang Le
·
June 4, 2024
Engineering
What Are Feature Flags? + How to Use Them
Aaron Silverman
·
May 30, 2024
Tips
What is Activation Rate? Full Guide With Examples
Ryan Lucht
·
May 30, 2024
Eppo News
Eppo x Perplexity Enterprise Pro
Che Sharma
·
May 29, 2024
Statistics
The Cult of Stat Sig
Giorgio Martini
·
May 29, 2024
Tips
What are Monthly Active Users (MAUs)?
Ryan Lucht
·
May 29, 2024
Eppo News
Joining The "Experimentation Avengers": Eppo's Customer Data Scientist Team
Tyler Buffington
·
May 22, 2024
Engineering
What is an Agile Release Train? Explained (with examples)
Aaron Silverman
·
May 22, 2024
Tips
The AARRR Pirate Metrics Framework Explained
Ryan Lucht
·
May 22, 2024
Tips
What is The ICE Scoring Method? Explained (with Examples)
Ryan Lucht
·
May 22, 2024
A/B Testing
What are Guardrail Metrics? With Examples
Ryan Lucht
·
May 22, 2024
Tips
Product vs. Marketing Analytics: What's the Difference?
Ryan Lucht
·
May 22, 2024
Engineering
What are Rolling Deployments & How do They Work?
Aaron Silverman
·
May 16, 2024
A/B Testing
Four Customer Characteristics That Should Change Your Experiment Runtime
Simon Jackson
·
May 16, 2024
Tips
What is an Agile Product Roadmap? Explained (With Examples)
Eric Metelka
·
May 15, 2024
A/B Testing
What is an A/A test? Full Guide with Examples
Ryan Lucht
·
May 15, 2024
Tips
What are Weekly Active Users (WAUs)? Easy Guide
Ryan Lucht
·
May 15, 2024
Tips
What is Product Stickiness? Full Guide With Examples
Eric Metelka
·
May 9, 2024
Tips
What is Feature Creep? + How to Prevent It (with Examples)
Eric Metelka
·
May 9, 2024
Engineering
What is an ETL Pipeline? Easy Guide with Examples
Aaron Silverman
·
May 9, 2024
Tips
What is the DAU/MAU Ratio? In Simple Terms
Ryan Lucht
·
May 9, 2024
Tips
What are Daily Active Users (DAUs) Exactly?
Ryan Lucht
·
May 8, 2024
A/B Testing
Top 8 Optimizely Alternatives Compared Head-to-Head (2024)
Ryan Lucht
·
April 26, 2024
A/B Testing
What is A/B/n Testing? Easy Guide with Examples
Ryan Lucht
·
April 24, 2024
Culture
How to Hackathon: Where Experimentation Mindset Meets Rapid Action
Aaron Silverman
·
April 18, 2024
A/B Testing
10 A/B Testing Metrics You Should Be Tracking & Testing
Ryan Lucht
·
April 18, 2024
Engineering
What is Canary Testing? An Easy Guide (2024)
Aaron Silverman
·
April 18, 2024
Tips
What is Bucket Testing? Examples & Best Practices
Ryan Lucht
·
April 16, 2024
Engineering
LaunchDarkly Pricing: Is it Worth The Cost?
Ryan Lucht
·
April 16, 2024
Engineering
Top 8 LaunchDarkly Alternatives for Feature Management & Experimentation (2024)
Ryan Lucht
·
April 10, 2024
Tips
19 SaaS Product Metrics for 2024: Track & Test for Success
Ryan Lucht
·
April 5, 2024
A/B Testing
7 Best A/B Testing Tools in 2024 (Expert Review)
Ryan Lucht
·
April 5, 2024
Tips
Product Strategy Framework: The 5 Top-Performing Frameworks to Consider in 2024
Eric Metelka
·
April 5, 2024
Eppo News
Introducing: Eppo Contextual Bandits
Sven Schmit
·
April 2, 2024
A/B Testing
7 Benefits of A/B Testing | Is it Really Worth it in 2024?
Ryan Lucht
·
April 1, 2024
AI/ML
When Should I Use Contextual Bandit Algorithms vs. Recommendation Systems?
Ryan Lucht
·
March 29, 2024
Culture
What to Look For in an Experimentation Platform (Beyond Features)
Ryan Lucht
·
March 18, 2024
A/B Testing
Your Comprehensive Guide To Creating an Experiment Plan
Kristi Angel
·
March 6, 2024
A/B Testing
Surviving the "Peeking Problem": A Self-Help Guide for Product Managers
Eric Metelka
·
February 22, 2024
Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test
Sven Schmit
·
February 20, 2024
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation
Che Sharma
·
February 5, 2024
Statistics
The 4 Types of Validity in an Experiment You Need to Know
Kristi Angel
·
January 11, 2024
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
·
January 8, 2024
Eppo News
Now Live: Certified Metrics
Che Sharma
·
January 3, 2024
Eppo News
Now Live: Holdouts
Eric Metelka
·
December 14, 2023
A/B Testing
Holdouts: Measuring Experiment Impact Accurately
Giorgio Martini
·
December 12, 2023
Eppo News
Measuring Experiment Impact Accurately
Holdouts help measure the cumulative, long-term impact of an experimentation program.
Read more
Wiggle Underscore SVG Animation

Not ready to talk just yet?

Take a tour and see the platform for yourself.
Get a demo
Experiment School
Ever wonder how other companies run experiments?

Expert Tips

Experimentation School
x
Strategy
x
AI/ML
x
A/B Testing
x
Engineering
x
Statistics
x
Eppo News
x
Culture
x
Tips
x