How does A/B Testing work in Datatrics?
You can set A/B testing percentages in the platform. The way these approach works is when a visitor is on your website and is about to see a touchpoint (because the audience targeting is met), a randomizer script will determine which A/B testing label the visitor will get. The change of which label the visitor gets is the percentage you set in the project settings of your project.
After the visitor/profile got their A/B testing label, they keep this label forever, and the label is one of the following two: Show or Hide. Profiles with the label Show always see Datatrics’ touchpoints, the profiles with the label Hide never do. The only exception is when you create Campaigns with a 100% A/B testing setting.
It doesn’t matter if a touchpoint is shown, or it should have been shown to someone with a Hide label, we always send an event to ourselves and Google Analytics at this time. This is so you can see the performance of a touchpoint. You only want to compare people who saw a touchpoint to people in the same context, the ones who should have seen it, not the total group of people with the label Hide.
We know a lot of our customers use different A/B testing settings for a phased rollout, like different domains or languages. This is why we included an extra setting to be able to change the percentage based on URL. You can still have different A/B testing percentages, but make sure the groups of profiles don’t overlap.