I need to do an A/B test so that 50% of people receive a certain email and the other 50% receive another email. The email is sent on the server and I am using the experiment flag to decide which email the person should receive. Through email, these people have a link and when they click, they access the same page on my app. On this page there are some events that I want to monitor and compare the email conversion rate. Even though the person is not authenticated, I can know the email because this information exists in the url.
In this case, how should I proceed?
I have seen that when I fetch the flags providing the user_id it generates the [Experiment] Assignment event but if I don't provide the user_id it doesn't. What is the impact on the experiment of not having this [Experiment] Assignment generated?
Do I need to verify the user in order for the experiment to work properly? I'm asking this because we verify the user after they logged in, but at this point the user is not logged in.
I've set a metric as a goal and now I'm curious to understand how Amplitude knows that the event happened to a user of variant A or B, i.e. how does it associate the event with the variant?
Question
How to use A/B Tests with Amplitude Experiment for Server-Side Email Campaigns and Unauthenticated Users
+2Hi Raphael,
Thank you for writing in! My name is Audrey, and I am your Technical Support Agent here to help you.
#1. The **[Experiment] Assignment **event is very important for experiment analysis, monitoring, and debugging. If assignment events are not triggered, it could lead to issues in interpreting the results of your experiment. To figure out why this event is not triggering when you do not provide the User ID, it would help a lot to see the experiment that you've set up. Would you mind sharing the link here?
#2. As for whether you need to verify the user, it depends. Does the user stay logged out for the entire experiment? How do you plan on identifying unique users in the experiment? Again, it would really help to see the experiment itself.
#3. Amplitude Experiment uses a user property per flag and experiment, which is set or unset on both assignment and exposure events. Experiment uses this user property to determine which variant the user is in for experiment analysis purposes. The format of the user property is, `[Experiment] ` and the value is the variant key that the user was assigned or exposed to.
I hope this helped! Please let me know if you have any questions.
Best,
Audrey
P.S. Checkout upcoming events and user meetups on our events page.
Thank you for writing in! My name is Audrey, and I am your Technical Support Agent here to help you.
#1. The **[Experiment] Assignment **event is very important for experiment analysis, monitoring, and debugging. If assignment events are not triggered, it could lead to issues in interpreting the results of your experiment. To figure out why this event is not triggering when you do not provide the User ID, it would help a lot to see the experiment that you've set up. Would you mind sharing the link here?
#2. As for whether you need to verify the user, it depends. Does the user stay logged out for the entire experiment? How do you plan on identifying unique users in the experiment? Again, it would really help to see the experiment itself.
#3. Amplitude Experiment uses a user property per flag and experiment, which is set or unset on both assignment and exposure events. Experiment uses this user property to determine which variant the user is in for experiment analysis purposes. The format of the user property is, `[Experiment] ` and the value is the variant key that the user was assigned or exposed to.
I hope this helped! Please let me know if you have any questions.
Best,
Audrey
P.S. Checkout upcoming events and user meetups on our events page.
Reply
Welcome to the Amplitude Community!
If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. You can also create a Guest account below!
If you're a current customer, select the domain you use to sign in with Amplitude.
analytics.amplitude.com analytics.eu.amplitude.comor
Welcome to the Amplitude Community!
If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. Want to sign up as a guest? Create a Community account.
If you're a current customer, select the domain you use to sign in with Amplitude.
analytics.amplitude.com analytics.eu.amplitude.comor
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.