A/B Testing Flows

One of Appcues' more advanced features is A/B testing. As you learn more about how your customers interact with your flows, you may want to use A/B testing to answer questions like:

  • What's different between people who see Appcues and those who don't?
  • How does one of my flows perform compared to another?

Preparing for a Test

To accurately measure the efficacy of your experiment, you'll first need to enable one of our third-party integrations and have the ability to segment users by their properties. The property that Appcues will send over is called _ABGroup, and the value will either be a 1 (Group A) or a 2 (Group B) depending on which group the user was assigned. We generate this property, and whichever A/B group a user is assigned persists on his profile and will remain the same. If this sounds like jargon to you, don't fret. We geek out about analytics and are happy to help—reach out!

A/B Testing Your First Flow

You can enable A/B testing from the flow's  Settings page. Scroll down until you find this section below:

Check the "Enable A/B testing" box to show the flow to a random 50% of your user base. This random bucketing is done for you, and you can further choose which of those two groups is in the "experiment" or the "control." Using this dropdown, you can also test two flows against each other by selecting Group A for your first flow and Group B for your second.

Analyzing the Results

To properly analyze the results of your A/B test, you'll need to integrate Appcues with a third-party analytics system. Those systems will let you see your results in a larger context and provide reporting features designed for this kind of analysis. In your analytics tool of choice, you'll want to view all users who:

  1. Completed a "Flow Started" event for the flow in question.
  2. Were either in Group A or Group B, depending on which you want to analyze.

Most systems will let you view that segment in funnels and other types of useful business reports. Give it a try and let us know what you think!

Still need help? Contact Us Contact Us