Schedule the DownloadStatistics job to copy marketing and search statistics

Marketing and search statistics must be available in the staging environment so that business users can view up-to-date data in statistics reports and search rule experiments in Management Center. We can create and schedule a DownloadStatistics job on the staging or authoring server to connect to and automatically copy search and marketing event statistics from the production environment at a scheduled interval, for example, every ten minutes. The DownloadStatistics job connects to the production environment using the quick publish database connection to keep the search statistics up-to-date on the staging or authoring environment.

Procedure

1. Open the Administration Console and select Site on the Administration Console Site/Store Selection page.

2. Click Configuration > Scheduler. A list of jobs that are scheduled to run is displayed.

3. Create the DownloadStatistics job:

   1. Click New.

   2. Create the DownloadStatistics job with the following values:

      New Scheduled Job: DownloadStatistics

      Parameter	Value
      Job command	DownloadStatistics
      Start Date	Enter the date to begin downloading search statistics.
      Start time	Enter the time of day to start the job for the first time. Use the 24 hour clock format, for example, 13:00 for 1 PM
      Schedule interval	Type the number of seconds between successive runs of this job. If this parameter is omitted, the job is run only once. A typical schedule interval for this job is 600 seconds (10 minutes).
      Application type	Enter Statistics as the type so that the job is executed under a separate work manager thread pool.

      For more information about the full set of parameters for scheduled jobs, see Scheduling a site-level job.

   3. Click OK.

Results

Your job is listed on the Scheduler Status Display page and runs at the specified start time.

What to do next

After creating the DownloadStatistics job, we can configure it using the configuration found in the xml/config/com.ibm.commmerce.infrastructure/wc-component.xml file. The table names to be downloaded must be listed as properties under DownloadStatistics-Configurations:

A list of database tables that is managed by DownloadStatisticsCmd.

Property name	Property value
Reference name (not used internally by the runtime)	Defines the configuration grouping name used for a database table

For example:

<_config:configgrouping name="DownloadStatistics-Configurations">
<_config:property name="SearchStatistics" value="DownloadStatistics-SRCHSTAT"/>
</_config:configgrouping> 

For each of the database table configuration grouping sections, the following properties can be used:

TableName

The name of the database table to be downloaded.

Mode

Download mode: copy (default), or move.

BatchSize

The maximum number of records to be processed all at once in a single batch unit of work.

Default is 1000 when no value is specified.

Threshold

The maximum threshold limit of records to be processed.

Default is 10000 when no value is specified.

For example:

<_config:configgrouping name="DownloadStatistics-SRCHSTAT">
<_config:property name="TableName" value="SRCHSTAT"/>
<_config:property name="Mode" value="move"/>
</_config:configgrouping> 

Related concepts
Marketing statistics: storage and update frequency

Related tasks
Enable the collection of marketing statistics in Management Center
Enable the collection of statistics for search rule experiments
Copying marketing statistics from the production environment
Disable marketing statistics