Split or A/B Testing in Email Campaigns

Overview

A/B Testing (also known as split testing) in PXME allows you to compare up to 6 versions of an email campaign to see which performs best. You can experiment with subject lines or email content, test engagement with a portion of your list, and then automatically send the winning version to the rest of your audience. This ensures your campaigns are data-driven and optimized for maximum performance.

Navigation

1. Go to Marketing > Emails > Campaigns.

2. Create a new email campaign.

3. Click the A/B Testing tab and toggle it ON.

4. Choose whether to test:

   • Subject Line (best for open rates), or

   • Email Content (best for click rates).

Setting Up Your A/B Test

Step 1: Test Duration

• Define how long the test will run (e.g., 4 hours, 12 hours, 1 day).

• After this time, the winning version is automatically sent to the rest of your contacts.

Step 2: Variations & Test Size

• Add up to 6 variations.

• Adjust the Test Size Distribution (default is 50%) to control what percentage of your audience gets each version.

• Add your subject line or content variations manually, or use AI generation.

• Requirement: Minimum of 10 contacts per variation.

  • Example: Testing 4 variations requires at least 40 contacts.

Step 3: Winning Criteria

Choose how the winner is decided:

• Unique Open Rate → best for subject line testing.

• Unique Click Rate → best for content testing.

Step 4: Delivery Method

• Select Send Now or Schedule Campaign.

• Note: A/B Tests do not support Batch Schedule or RSS Schedule.

Managing A/B Tests

• You can pause, edit, or resume an A/B Test at any time.

• Results are displayed in the Statistics tab, showing performance for each variation alongside overall campaign stats.

Example Use Case

You’re launching a new product and want to maximize engagement:

1. Create two or more subject line variations.

2. Set the test duration to 6 hours.

3. PXME sends test versions to part of your audience.

4. At the end of 6 hours, the winning subject line is automatically sent to the rest of your contacts.

Result: You get higher open rates and better campaign ROI.

FAQs

Q1: What is A/B Testing in Email Campaigns, and how does it work?
It lets you test up to 6 variations of subject lines or content. The winner, based on open or click rates, is then sent to the rest of your audience automatically.

Q2: How do I set up A/B Testing?
Go to Marketing > Emails > Campaigns, create a campaign, click the A/B Testing tab, and configure variations, test size, duration, and winning criteria.

Q3: What are the minimum requirements?
At least 10 contacts per variation. For example, 4 variations = 40 contacts minimum.

Q4: What happens when the test duration ends?
The system automatically chooses the winner (based on your criteria) and sends it to the rest of your contacts.

Q5: Can I schedule A/B Tests?
Yes, you can schedule them — but Batch and RSS scheduling are not supported.