Skip to main content

I need to do an A/B test so that 50% of people receive a certain email and the other 50% receive another email. The email is sent on the server and I am using the experiment flag to decide which email the person should receive. Through email, these people have a link and when they click, they access the same page on my app. On this page there are some events that I want to monitor and compare the email conversion rate. Even though the person is not authenticated, I can know the email because this information exists in the url.

In this case, how should I proceed?

I have seen that when I fetch the flags providing the user_id it generates the [Experiment] Assignment event but if I don't provide the user_id it doesn't. What is the impact on the experiment of not having this nExperiment] Assignment generated?

Do I need to verify the user in order for the experiment to work properly? I'm asking this because we verify the user after they logged in, but at this point the user is not logged in.

I've set a metric as a goal and now I'm curious to understand how Amplitude knows that the event happened to a user of variant A or B, i.e. how does it associate the event with the variant?

Hi Raphael,

Thank you for writing in! My name is Audrey, and I am your Technical Support Agent here to help you.

#1. The **[Experiment] Assignment **event is very important for experiment analysis, monitoring, and debugging. If assignment events are not triggered, it could lead to issues in interpreting the results of your experiment. To figure out why this event is not triggering when you do not provide the User ID, it would help a lot to see the experiment that you've set up. Would you mind sharing the link here?

#2. As for whether you need to verify the user, it depends. Does the user stay logged out for the entire experiment? How do you plan on identifying unique users in the experiment? Again, it would really help to see the experiment itself.

#3. Amplitude Experiment uses a user property per flag and experiment, which is set or unset on both assignment and exposure events. Experiment uses this user property to determine which variant the user is in for experiment analysis purposes. The format of the user property is, `[Experiment] ` and the value is the variant key that the user was assigned or exposed to.

I hope this helped! Please let me know if you have any questions.

Best,
Audrey


P.S. Checkout upcoming events and user meetups on our events page.

Reply


Terms & ConditionsCookie settings