Do we always need a control group?


1 comment

  • Doron Taub

    Hi Marie,

    It is recommend to test any change you make on the site. In order to measure the impact of this change, adding a control group is very much recommended. This will allow you to see how is this change is impacting, in all metrics.

    However, there are cases where DY is used to upload fast Informational notifications that you want 100% of your traffic to see. This is considered as CMS (content management system), therefor the control group isn't needed.

    In CMS cases, without a control group, you could still see the revenue attributed to the message in the report, but it will not indicate if it is positive or negative. 

    Comment actions Permalink

Please sign in to leave a comment.