Currently, control bucket users in the test deploy to hewiki are seeing both control and treatment experiences, same with treatment bucket users.
The bucketing mechanisms on client and server are different code paths. Server is a mod function and client is using mw.experiment
mw.config.get('wgUserId') !== central id used on the server.
Current logic is bucketing based on the global ID, but using local id client-side.
Option 1:
Remove L99 and use the local ID.
Option 2:
Pass the central ID via virtual package file
QA Steps
Success Criteria: Verify that the AB test is bucketing users based on the local user ID, not the global centralAuth ID.
- Log in on the beta cluster (beta enwiki)
- Paste this code in the dev console and note whether the user ID an even or odd number mw.user.getId()
- In the dev console, inspect the network tab and find the eventLogging event with the experiment_name skin-vector-zebra-experiment
- Note whether the group is control or treatment, and whether the zebra design is visible or not.
Repeat this process on spanish beta cluster (beta eswiki).
Try using an account whose local user ID is even on one wiki and odd on the other.
A/C
- Users with an even number user ID are consistently bucketed into the control group and see the current design.
- Users with an odd number user ID are consistently bucketed into the treatment group and see the zebra design.
QA Results - Beta
| AC | Status | Details |
|---|---|---|
| 1 | ✅ | T336969#8890683 |
| 2 | ✅ | T336969#8890683 |
