Global Control Group guide for sections with (only) script-based campaigns

The global control test is a method for measuring the overall impact of your experimentation program. You measure this using an A/B test that splits your overall traffic into two groups – users who receive personalized Dynamic Yield experiences and those who don’t – and compares them.

For example:

By comparing the performance of the Dynamic Yield Experiences and Control Group variations, you can estimate the total impact of experiences A, B, and C.

Setting up the global control test

Step 1: Create the global control test 

Create a Custom Code campaign using the following settings:

1. Name the campaign Global Control Test.
2. Set the trigger as Page Load.
3. Set the frequency to Session.
4. Create an experience with the name Global Control Test.
5. Leave targeting conditions as they are, targeted to all users.
6. Create a variation called Dynamic Yield Experiences with the following JavaScript code:
   

   var GCG_STORAGE_NAME = '_dy_cs_gcg';
   var CG_VALUE = 'Control Group';
   var DY_VALUE = 'Dynamic Yield Experiences';
   var STORAGE_TYPE = 'cookieStorage';
   window.DYO.StorageUtils.remove(GCG_STORAGE_NAME, [STORAGE_TYPE]);
   window.DYO.StorageUtils.set(GCG_STORAGE_NAME, DY_VALUE, [STORAGE_TYPE]);

7. Create another variation called Control Group with the following JavaScript code:
   

   var GCG_STORAGE_NAME = '_dy_cs_gcg';
   var CG_VALUE = 'Control Group';
   var DY_VALUE = 'Dynamic Yield Experiences';
   var STORAGE_TYPE = 'cookieStorage';
   window.DYO.StorageUtils.remove(GCG_STORAGE_NAME, [STORAGE_TYPE]);
   window.DYO.StorageUtils.set(GCG_STORAGE_NAME, CG_VALUE, [STORAGE_TYPE]);
   

8. Set the allocation to 95% for Dynamic Yield Experiences and 5% for Control Group.
9. Publish the campaign after validating the stickiness is set to "Sticky for the user (multi-session)" inside the cogwheel icon.

Step 2: Create the evaluator

The evaluator is used to target experiences to the Dynamic Yield Experiences group or the Control Group.

1. Create an evaluator with the name Global Control Test Group.
2. Set the value type to String.
3. Set Expected Values to Dynamic Yield Experiences and Control Group.
4. Insert the following code:

   (function () {
     return DYO.Q.Promise(function (resolve, reject) {
       var GCG_STORAGE_NAME = '_dy_cs_gcg';
       var STORAGE_TYPE = 'cookieStorage';
       window.DY.CS = window.DY.CS || {};
       if (window.DY.CS.inGlobalControl) {
         resolve(window.DY.CS.inGlobalControl);
         return true;
       }
       getGCCookie();
   
       function getGCCookie() {
         var GCValue = window.DYO.StorageUtils.get(GCG_STORAGE_NAME, [STORAGE_TYPE]);
         if (GCValue) {
           window.DY.CS.inGlobalControl = GCValue;
           resolve(GCValue);
         } else {
           setTimeout(function () {
             getGCCookie();
           }, 50);
         }
       }
     });
   })();

5. Save the evaluator.

Step 3: Add experiences to the global control test

Adding experiences to the global control test is an ongoing process. If you have a personalized experience, target it (using the evaluator you just created) to the Dynamic Yield Experiences group. This ensures that only users in the 95% population group receive this experience. 

If the campaign requires a default experience (served to all traffic, including the 5% control group), create the experience and serve it to the control group using the same evaluator. 

If you are using active cookie consent, consider having a second fallback experience with no targeting conditions that can be served to opted-out users. 

Best practices: What should you measure?

• Consult your Customer Success Manager regarding personalization and testing efforts to include to best measure the value of your personalization program.
• Don't include experiences that have no effect on the user's experience.
  For example, firing an event or implementing a cookie.
• Don't include experiences that must be served and are not optimized. 
  For example, cookie consent notification.