Process: Create Marketing Experiment

 

Flow

Legend

 

Objective

The creation of a marketing experiment is the initial step in the overall experimentation process. The marketing experiment represents an alternate version of site content, whose effectiveness will be compared against the original, or control, version.

 

Description

In order to measure the effectiveness of a marketing campaign, the Marketing Manager will create a marketing experiment. In the experiment, the Marketing Manager selects a content that represents the current content shown in the site, known as the control element. The Marketing Manager then changes a factor of that content for testing. The types of factors that can be tested are:

At least one element of the type of selected component is selected as 'experiment', which is known as test element. Each test element represents a changed version of the Web site or an alternative site content. Customers are selected to be shown either the control element or a test element according to a percentage split defined for each element. Information about what was shown, when and to whom is captured for analysis. At the end of the experiment, the winning element is made permanent in order to maximize the effectiveness of the content.

 

Edition

Professional, Enterprise

 

Tasks

Task Description Role
Select control element

The creator of this marketing experiment selects a control Content.

Marketing Manager
Select test elements

The creator of this marketing experiment selects test elements, which can be Web activities, displaying contents, customer segments and e-Marketing Spots depending on the experiment type defined during the design of this experiment.

Marketing Manager
Set experiment split ratio

The creator of this marketing experiment sets a ratio for the control element and each test element. The ratio number determines the percentage of unique customer visits for which the test or control content will be displayed in the e-Marketing Spot.

Marketing Manager
Set up marketing experiment properties

The creator of this marketing experiment sets the name, description, priority, persistence scope which determines how long the same experimental content will be shown to customers before a new one is selected, start date, and expiry options including end date and the number of customers who viewed the experiment before it expires. The creator also needs to decide the type of experiment he/she would like to run. Here are the four available types:

  • Activity testing - this type of experiment tests the effectiveness of various Web activities for a specific e-Marketing Spot.
  • Content testing - this type of experiment tests the effectiveness of content for a Web activity in an e-Marketing Spot.
  • Segment testing - this type of experiment tests the effectiveness of the targeted customer segment of a specific Web activity in an e-Marketing Spot.
  • Spot testing - this type of experiment tests the effectiveness of the e-Marketing Spot to which a Web activity is assigned.
Marketing Manager

 

Business artifacts

Feedback