Action - A/B Test

The A/B Test action randomly splits people into two or more paths in a Flow. 

This action is best used if you want to A/B test a multi-step flow – for instance, sequences of emails. If you'd wish to run a standard single email A/B test (e.g., to figure out which subject line has a higher open rate) it's best to use the A/B test feature in Broadcasts (coming soon).

How to set up A/B Test action step?

Click on the step to configure it. By default, the A/B Test is split into two equal groups – Variant A and B. This means that 50% of the people (randomly chosen) will flow into Variant A and 50% will flow into Variant B. However, you can change this if you'd like a larger or a smaller portion to continue down a specific path.

Finally, you need to connect both the A and B links to another step:

Activate the Flow and let it run for a certain amount of time before you decide which path/sequence you'd like to keep. 

To see the performance of the emails in the flow, click on a specific email step and select the Report tab on the right. Note that the Report tab currently shows metrics from the last 30 days only (we're working on implementing a date picker):

Once you choose the winner variant, simply delete the A/B Test step and the loser path/sequence:

Creating an A/B Test with more than two variants

To add more variants to your A/B Test simply click on the "+ Add variant" button. Then, click on "Distribute % evenly" if you wish to create equal groups.

You can distribute the variants however you like. Note that the total sum of all of the variants must be 100%, otherwise, the A/B test will not work properly. 

If you wish to delete a variant click on the trash icon.

Finally, make sure to connect all of the variants to another step.

Example use cases

Randomly show different Intercom in-app messages

Randomly assign leads to two or more different salespeople

Use the Create HubSpot Deal action step and assign a different owner to each step: