The rule performance dashboard helps merchandisers evaluate the impact of slotting rules on add-to-carts (ATC). For example, if a product was slotted in position one, did it contribute more add-to-carts than when the AI decided which product to place in position one, or did the slotted item in position one significantly underperform against AI ranked products?
In this analytics dashboard, Merchandisers can compare the actual performance of slotted products versus the expected performance if the AI had chosen products for ranking. The data insights will let merchandisers know if the rules they created have over- or under-performed in add-to-carts by comparing slotted add-to-carts vs not slotted add-to-carts. These analytics are available for slotted positions in both search and browse.
Rules listing page
Finding the rules that are over- or under-performing is a simple, intuitive task now with the rule performance listing page. This page focuses merchandisers attention on rules that have most significantly affected add-to-cart results. The table is sorted in descending order from greatest lost add-to-carts (most negative) to highest gained add-to-carts (most positive). Thus, the top of the table has the most severe under-performing rules and the back of the table has the most over-performing rules. The lost (or gained) add-to-carts are calculated by the difference between expected not slotted results versus the actual performance when the position is slotted.
"North Face" in position 11 example
For example, the rules listing page shows for the last query above “north face”, the pictured product is slotting in position 11. While this product was slotted, it achieved 30 less add-to-carts compared to the expected performance of position 11 when AI ranks products in the “north face” query. This data shows the difference between actual slotted conversions and expected not slotted conversions.
Conversion performance is not the sole motivation for slotting products, but these analytics arm merchandisers with conversion performance data to make data informed decisions on keeping rules or deleting them. Additional analytics are available on each row in the rule performance dashboard when you click the next arrow navigating to list position analytics.
NOTE: If the difference between the slotted item's performance and the historical performance of the position is less than 5% there will not be a notification in the Customer Dashboard.
List position analytics*
* To be released shortly in future release.
By clicking the arrow button on a specific slotting position, a list position analytics dashboard will display the detailed performance over time and difference from the not slotted period. This page provides insight into how the item slotted in the position is performing against expected performance.
Add to carts
The first section shows the average daily add-to-carts while the position has been slotted with the current product. The average column shows the expected add-to-carts from this position based on historical performance before being slotted.
The second set of numbers show the same comparison, the add-to-cart rate for the period while the position has been slotted and the average add-to-cart rate during the time the position was not slotted. The difference column shows the drop or gain in add-to-cart rates between the two time periods, slotted versus not slotted.
Daily viewers show the average number of views for the position in search or browse. Knowing the average daily views and the difference between actual and average add-to-cart rate is another way to size the slotting rule impact.
List Position History
The list position history chart shows the add-to-cart and add-to-cart rate over time for the position under investigation. For example, this chart shows the daily conversion rates for position 1 in a sample query, “rain barrel” or for a browse category. The chart shows the daily list position performance before and after the slotting event occurred. Notice the line changed shades once the item was slotted. It is easy to spot trends in add-to-cart performance in this time series view.