Product Experimentation

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences.

  • 68 Topics
  • 148 Replies

68 Topics

Amplitude Admin
Community Manager
Amplitude AdminCommunity Manager
published in Product Experimentation

Welcome to the product experimentation forum!

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences This is where you can ask and get feedback on questions such as: ✅ Am I able to export the data I have in Experiment similar to Analytics?✅ How can I re-assign variants to my users?✅ Why are my users not getting targeted the right variant?✅ What happens if we merge projects in Experiment? Helpful resources: ❓Overview of Amplitude Experiment❓The experimentation workflow: from configuring to troubleshooting your experiment❓Amplitude Experiment key terms ❓Set up mutually-exclusive experiments❓Understand the Experiment Analysis view❓Advanced topics in Experiment: duration estimates, sequential testing for statistical inference, MDE and confidence intervals, randominzation, performance and scaling, sample ratio mismatches❓Amplitude Academy course: Getting Started with ExperimentStill have questions? Post them here! 

2701
T
8 months ago
D
Dave PorterNew Member
asked in Product Experimentation

Separate Amplitude Experiment deployment or not for SSR server?

BackgroundThe examples in the server side rendering guide for Amplitude Experiment have…a “server” deployment key for initialising the node SDK used to fetch initial variants, see https://www.docs.developers.amplitude.com/experiment/guides/server-side-rendering/#initialize-the-server-sdka “client” deployment key for initialising the javascript SDK ExperimentClient with those initial variants, also used on the server. See first “if” branch here https://www.docs.developers.amplitude.com/experiment/guides/server-side-rendering/#initialize-the-client-sdk-on-render. The “client” deployment key matches that used to initialise the ExperimentClient in the browser in the second “if” branch.However, the Amplitude Experiment Node SSR Demo app here https://github.com/amplitude/experiment-node-server/tree/main/packages/ssr-demo uses an identical “client” deployment key for all three. (https://github.com/amplitude/experiment-node-server/blob/main/packages/ssr-demo/lib/experiment.ts and https://githu

0
D
5 days ago
C
Casey HNew Member
asked in Product Experimentation

Redirect A/B test with Amplitude

Hi, Has anyone ever succeeded in settng up a redirect A/B test using Amplitude Experiment? We have been looking for instructions to set up redirect test but couldn’t find any. 

0
C
25 days ago
V
Valentin IvanovNew Member
asked in Product Experimentation

Missing User ID in Start Session - GTM

Hi everyone, for my project I use GTM template “Amplitude Analytics Browser SDK” to initialise the Amplitude but I set userId and identify user in the project itself(by calling the newly created amplitude object), because GTM doesn’t have access to the information needed. Also I set timer with 30 retries in case that object is not initialised yet.Now what happens is that for majority of users but not all(around 70%) I can’t see information from identify, as well as User ID, in the user properties of Start Session event . However in the future events of same session the information I send with identify method is present but User ID is still missing. This causes the table in User Look-Up to show Amplitude ID instead of user Id for these events(but if you open the page of the user, he has correct Id). This is applicable only for the 70% of users I mentioned at the beginning, the rest are receiving identify data and userId in Start Session, so further events have userId set.Does anyone kno

0
V
1 month ago
T
Thomas GroendalNew Member
asked in Product Experimentation

How do I correlate time in platform to retention?

We’re working on a tool that is a platform for investigations in a virtual machine. We have a thesis that more time spent in the machine itself is going to be indicative of happy customers, as we meet a broader range of their investigative tasks in platform. I want to test this by seeing if time in platform is predictive of retention. I can measure time in platform on average, but I can’t figure out how to link it back to retention.I’m also open to criticism of the idea in general. 

1
Saish Redkar
Expert
1 month ago
N
Novita OliveraNew Member
asked in Product Experimentation

Change experiment key name

Can we change the experiment key name for existing Amplitude experiment?

0
N
1 month ago
L
Novice
lanceNovice
asked in Product Experimentation

Session metrics in experiments

Is it possible to track session metrics (e.g., Time spent per user, Avg length, etc.) in an Experiment Results chart? In the past we’ve tried using User Session charts but we aren’t cleanly able to create separate treatment and control segments and it does not have the same functionality in leveraging the only after Exposure event… feature in an Experiment Results chart 

0
L
Novice
2 months ago
J
Jacky LaiNew Member
asked in Product Experimentation

What is the best way to differentiate the path in funnel analysis?

I have one button, and one dropdown on the same page. There will be 3 events for each:1. button shown → button clicked → target page2. dropdown shown → dropdown clicked → target pageMy question is,Q1.what’s the granularity of time interval amplitude is using?Let’s say, if the granularity is 1 minute, within 1 minutebutton shown → dropdown shown → button clicked → dropdown clicked → target pageSince all the events happen in one minute, how to tell which scenarios (button or dropdown) completed the flow?Thanks.

1
dangrainger
Super Helper
2 months ago
M
Manuel FenklNew Member
asked in Product Experimentation

Amplitude Integration via Kotlin Multiplatform (cross-platform)

Hey folks, we are currently on the way towards migration from GA towards Amplitude. We have one iOS and one Android App, and we want to take this opportunity to integrate Amplitude via Kotlin Multiplatform Mobile (KMM).Goal: One business logic for the whole analytics integration in order to reduce the overhead of maintaining it on 2 platform and - most important - consistency among the platforms.Here is a video from GDG in Melbourne last week, talking about that in a more general way:  Does someone here in the community maby has experiences with such an integration? If yes, I would be very happy to get some insights about it. How did go, pitfalls, would you do it again, etc :)Thanks a lot!Best, Manuel 

1
M
2 months ago
R
Rohin MadhavanNew Member
asked in Product Experimentation

Integrating Appsflyer attribution data to Amplitude

We have been trying to send the Appsflyer integration data to Amplitude but we are unable to see the events on the Amplitude dashboard. We have followed documentations provided by both Appsflyer and Amplitude but we do have a few doubts which might be causing the integration to fail.We are using Amplitude-swift for getting the user analytics and initially we were to collecting the IDFA value from the user but for this integration to work I assume we require IDFA from both Amplitude and Appsflyer so we implemented the IDFA collection plugin as we are not able to use adSupportBlock method mentioned in the documentation. Would this be enough to get the IDFA collected? Could you clarify how to match the events in both Appsflyer and Amplitude? Any two events with the same IDFA value would suffice or should we map the events to amplitude while setting this up in Appsflyer?

0
R
2 months ago
S
Novice
srushti.wadekarNovice
asked in Product Experimentation

Quantifiable metrics in Amplitude

I’m trying to understand time taken by a user to perform an event x since the first time they login or use the system. This is quantifiable metric and can we use Amplitude to derive such metrics?

1
Saish Redkar
Expert
3 months ago
S
Novice
srushti.wadekarNovice
asked in Product Experimentation

Fetch product wastage (Low usage features) in Amplitude? 

Is it possible to fetch product wastage (Low usage features) in Amplitude out of all events recorded? 

1
Saish Redkar
Expert
3 months ago
Z
Zach AndersonNew Member
asked in Product Experimentation

Password Policy

I’m looking for information on the password policy for Amplitude. I understand it is not configurable and SSO is currently not an option for us since we are on the free tier. However, as part of our access review we need to document the current password policy to ensure it is inline with our internal policies or create an exception if needed. Does anyone have this information? We are looking for things such as password length, complexity, history, etc. 

0
Z
3 months ago
O
omygoodnessNew Member
asked in Product Experimentation

Tracking multiple applications on one instance (API-KEY)

Hi,I'm using Module Federation with Angular. In the host application, I initialize Amplitude using a single API key. However, I have several other applications that also utilize the same instance of Amplitude.Is it possible to set a global property, such as appName, so that all events coming from the different applications have this identifier? This would help in grouping those events or creating charts for unique apps. Alternatively, do I need to manage multiple instances and use multiple API keys to achieve this distinction?I know I can add appName to each track event but I would like to avoid that approach:amplitude.track(eventName, { appName: 'testApp',});amplitude.track(eventName, { appName: 'testApp1',});amplitude.track(eventName, { appName: 'testApp2',});etc... 

0
O
3 months ago
R
Rafael GuerreiroNew Member
asked in Product Experimentation

How do I integrate amplitude with google ads to track conversions?

When users open my iOS/Android app, I’d like to know whether they’re coming from an ad source and send this data to google. How can I do that?Also, I need to follow coppa and gdpr-k, can I use the IDFV for that? I can’t request IDFA.

0
R
4 months ago
A
Advait PatilNew Member
asked in Product Experimentation

Pause and restart experiment

If we have a business requirement to only run experiments on weekdays, would toggling the “active” to “inactive” achieve this? And if not, is there an easier way than setting up multiple instances?

0
A
4 months ago
M
Muchid AriyantoNew Member
asked in Product Experimentation

Excluding data on specific date for experiment

Hi Team, We have some issue on some specific date for experiment and we want to exclude that date for experiment result.  By this screenshot, we want to know how we can exclude date of 23 June 2023 for experiment decision, since in the date option we cant exclude date. Thank you  

3
M
4 months ago
I
Ivan AndrieievNew Member
asked in Product Experimentation

password policy

Is it possible to configure the password policy of analytics.amplitude.com?

5
Esther Trapadoux
Community Manager
5 months ago
V
Vania AlyaNew Member
asked in Product Experimentation

New Amplitude UI in Experiment

Hi Amplitude team! We’ve seen that you have made a UI and feature updates in almost every section of Amplitude product. This change creates a blocker for our process actually. We found that in the segmentation feature there is an option to revert back to the legacy Controls.Is this option available for the Experiment feature too? There are a couple of features that is no longer available and it’s quite painful for us. Would like to list it all down because I don’t have the pre existing UI screenshot.Copy-pasting a value without “ “. We saw that in the new feature when we want to copy a value, let’s say ID 23476 it will paste with “23476” which will not be detected as a user id. And thus creating the need to erase it one by one. The Open in Analytics feature which offers user to able to open a metric in Experiment to the Segmentation Chart. This helps us to further dive deep in the charts, so having the feature not available makes us have to copying and pasting each metrics and creating

0
V
5 months ago
L
Helpful Hero
liukaichiHelpful Hero
asked in Product Experimentation

Re-running experiments

Hi, so let’s say we’ve run an experiment that has failed, or has produced results we otherwise want to discard. Is there a way to “restart” the experiment so that we can use the same key, but provide different keys and get clean experiment results? By “clean” I mean old data will not interfere with new findings. I feel like with the current structure, there’s no way to do this, which means we need to cycle through a bunch of different keys every time we want a fresh start, even though most of the experiment is the same.  Any insight here would be appreciated.

0
L
Helpful Hero
5 months ago
V
Vania AlyaNew Member
asked in Product Experimentation

Data insufficient prompt in T Test Analysis Experiment

Hi Amplitude Team!I would like to ask regarding the Amplitude Experiment. The case is that we have a sample size requirement of 57,000, two sided, and 95% confidence level. However when we wanted to analyse the result of the experiment and changed the Statistical setting to the required, the data showed that it “needs more data to be conclusive” and the statistical in the data is 0% when the supposedly performance is -1.8% (with MDE of 1%). Is there any reason why this prompt is showing? Thank you!

3
N
Well-Versed
5 months ago
S
Novice
shani cohenNovice
asked in Product Experimentation

How to see which accounts the user is related to

Hello :)Account level managing question:short background:in my system, users can be - not related to any account related to 1 or more accountsQ1 - How do I see to which accounts the user is related to? can it appear somehow under the user properties?Q2 - Do I have a way to find out in a specific event if a user belongs to an account?  thank you 

1
Saish Redkar
Expert
5 months ago
P
Polina MokretsovaNew Member
asked in Product Experimentation

Distinct Property Values ​​Per User in the Event Segmentation

Hello! I’m a product analyst, studying the Amplitude for work.I got acquainted with the documentation on the functionality, but didn’t find a detailed description and application of Distinct Property Values ​​Per User in the Event Segmentation report.Can you explain where this functionality can be applied? And what does it mean?I will be grateful for your help!

3
Saish Redkar
Expert
6 months ago
R
Ricardo Mighty HealthNew Member
asked in Product Experimentation

Chart query error

I'm trying to do a single request (Manually, without any type of automation, just one time) but I sill receive the error: HTTP 429: Too many requests (Too Many Requests: Exceeded rate limit with query of cost 16425)Anyone faced this problem before?Regards,Schieck.

2
R
6 months ago
B
Ben KloesterNew Member
asked in Product Experimentation

What permissions does LaunchDarkly Cohort sync really need?

The instructions for setting up syncing of Amplitude cohorts to LaunchDarkly suggest creating an access token with Writer permissions, which has write access to pretty much everything except account members and billing. That seems like much more than is needed to do what the sync needs, as AFAICT it just creates and updates Segments in LD. Does anyone know what access is actually required, to what objects, in order for the sync to work? I’m considering creating a custom role that only has write permissions to Segments, for instance.

3
Esther Trapadoux
Community Manager
6 months ago

Terms & ConditionsCookie settings