Set the statistics displayed during a run
Overview
You can set the...
- type of data that you see during a run
- sampling rate for that data
- whether data is collected from all users or a representative sample
Set the level of statistics logging
- In the Test Navigator, browse to the schedule and double-click it.
- In the Schedule Contents area, click the name of the schedule.
- Go to the Statistics page.
Set Statistics log level to one of the following options:
Option Description None No statistics are displayed during the run, and any report that depends on statistics is not generated. At the end of the run, you see only a Summary report containing three items:
- The time the run took
- Whether the results were on the local computer
- If results are on a remote computer, which one
- The status of the run, which is Complete
Schedule Actions Select if you are interested only in the number of users. Schedule actions report the number of active and completed users in the run.
Primary Test Actions Limit the processing required by the workbench. Primary test actions include all schedule actions plus:
HTTP tests HTTP page-related actions (attempts, hits, and verification points). SAP tests SAP screens. Citrix tests All keyboard and mouse actions. SIP tests Provides statistics for all actions. Socket tests This option does not apply. Secondary Test Actions Limit the processing required by the workbench. Secondary test actions include all primary test actions plus HTTP page element–related actions.
HTTP tests HTTP page element-related actions. SAP tests SAP screen element-related actions. Citrix tests and SIP tests Statistics are identical to Primary Test Actions. Socket Send and Receive actions, the exchanged data is also available in the test log, by means of attachments. All For HTTP, SAP, Citrix and SIP tests, provides statistics for all actions. For socket Send and Receive actions, the exchanged data is also available in the test log, by means of attachments.
- In Statistics sample interval, type a number and select a time unit.
When you run a schedule, the reports show such information as...
- response time during a specific interval
- frequency of requests being transferred during an interval
- average response trend during an interval
You set this interval here.
- To set a sampling rate, select...
-
Only sample information from a subset of users
...then select one of the following options.
The number or the percentage that you specify is applied to each user group. If you are running user groups at remote locations, the number or percentage that you select is distributed evenly among the remote locations.
Option Description Fixed number of users Number is applied to each user group. Assume that schedule contains two user groups. One group contains four users, and one group contains 1000 users. If you specify 2 for this option, two users are sampled from each group.
Percentage of users Percentage is applied to each user group—but at least one user will be sampled from each group. Assume that schedule contains two user groups. One group contains four users, and one group contains 1000 users. If sampling rate is 10%, one user is sampled from the first group, and 100 users are sampled from the second group. If sampling rate is 25%, one user is sampled from the first group, and 250 users are sampled from the second group.
- Typically, you should select...
-
Only store All Hosts statistics
Selecting this option reduces the amount of statistical data stored, thus enabling you to test a larger load over a longer period of time with significantly less memory usage. Although you will not be able to analyze data from each computer that adds to test, this data is generally not of interest.
However, if you are running a test over different WANs—and if you are interested in seeing the data from each remote computer—you should clear this box.
Related tasks