Choose metrics
Defines metrics and describes how to add a primary and secondary metric in Optimizely Feature Experimentation.
Metrics are a quantitative measure of the success of your experiment. They tell you whether the variations in an experiment are winning, losing, or inconclusive based on changes in visitor behavior in response to your experiment.
For example, suppose your site has an Add-to-Cart button. You would use an event to track every time the button is clicked. You would use a metric to measure the percentage of users who added to the cart at least once or the average number of items added per user.
Choosing primary and secondary metrics
The primary metric is the one Optimizely Feature Experimentation uses to determine a statistically significant winning or losing variation. It is the most important goal of the experiment and decides whether your hypothesis is proven or disproven. In Optimizely Feature Experimentation, the primary metric will always achieve statistical significance at full speed, regardless of any other goals or events added.
All other metrics are secondary or monitoring metrics; select metrics that will give you insights into long-term success. See Primary metrics, secondary metrics, and monitoring goals in Optimizely Experimentation.
Identifying the correct metric is a huge factor in determining whether your experiment will have statistically significant results. See these supporting articles:
- Choosing primary vs. secondary metrics.
- Types of metrics and when to use them.
- Focusing on metrics that matter.
And, of course, if you run into trouble, check out our article on troubleshooting metrics.
How metrics are calculated
Optimizely Feature Experimentation creates metrics by aggregating events over time. Directly track actions like clicks, pageviews, form submissions, purchases, and scroll depth. After you create an event and add it to an experiment, you will decide how it is displayed as a metric.
Adding metrics to experiments
Every Optimizely Feature Experimentation experiment needs at least one metric. You can add or modify metrics at any time. For details on adding metrics to experiments, see Run A/B tests or Run a multi-armed bandit optimization. For step-by-step instructions on creating a metric, see Create a metric in Optimizely using the metric builder.
You can view the metrics attached to your experiment on the Experimentation Results page.
Updated 5 months ago