Hi Everyone - My past experience is with Optimizely, and I'm working to get up to speed on Dynamic Yield. One feature I really loved in Optimizely was test exclusion. For example, you typically wouldn't run two tests on the homepage concurrently as they could cross-pollinate with each other and skew the test results. Using test exclusions in Optimizely, the platform would ensure that a visitor to the homepage would only be let into one of the homepage tests and not both. This would allow you to run multiple tests on the same page or in different areas of the site and you could count on the results not being skewed.
What is the best practice in using DY? How do you ensure that running multiple tests can be done cleanly with no skewing of the test results. For example, if I have product recommendation tests running on the homepage, the product detail page and the cart, there are a lot of different permutations that a visitor could see in their session, especially if each test has multiple variations. In this example, would you run these tests at all the same time or would you sequentially run them one at a time for more granular learning?
Please sign in to leave a comment.