Skip to main content

Product Experimentation

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences.

  • 114 Topics
  • 198 Replies
114 Topics
C
Casey HNew Member
asked in Product Experimentation
Redirect A/B test with Amplitude

Hi, Has anyone ever succeeded in settng up a redirect A/B test using Amplitude Experiment? We have been looking for instructions to set up redirect test but couldn’t find any. 

2050
C
V
Valentin IvanovNew Member
asked in Product Experimentation
Missing User ID in Start Session - GTM

Hi everyone, for my project I use GTM template “Amplitude Analytics Browser SDK” to initialise the Amplitude but I set userId and identify user in the project itself(by calling the newly created amplitude object), because GTM doesn’t have access to the information needed. Also I set timer with 30 retries in case that object is not initialised yet.Now what happens is that for majority of users but not all(around 70%) I can’t see information from identify, as well as User ID, in the user properties of Start Session event . However in the future events of same session the information I send with identify method is present but User ID is still missing. This causes the table in User Look-Up to show Amplitude ID instead of user Id for these events(but if you open the page of the user, he has correct Id). This is applicable only for the 70% of users I mentioned at the beginning, the rest are receiving identify data and userId in Start Session, so further events have userId set.Does anyone kno

3460
V
T
Thomas GroendalNew Member
asked in Product Experimentation
How do I correlate time in platform to retention?

We’re working on a tool that is a platform for investigations in a virtual machine. We have a thesis that more time spent in the machine itself is going to be indicative of happy customers, as we meet a broader range of their investigative tasks in platform. I want to test this by seeing if time in platform is predictive of retention. I can measure time in platform on average, but I can’t figure out how to link it back to retention.I’m also open to criticism of the idea in general. 

2341
Saish Redkar
Expert
N
Novita OliveraNew Member
asked in Product Experimentation
Change experiment key name

Can we change the experiment key name for existing Amplitude experiment?

1880
N
L
Novice
lanceNovice
asked in Product Experimentation
Session metrics in experiments

Is it possible to track session metrics (e.g., Time spent per user, Avg length, etc.) in an Experiment Results chart? In the past we’ve tried using User Session charts but we aren’t cleanly able to create separate treatment and control segments and it does not have the same functionality in leveraging the only after Exposure event… feature in an Experiment Results chart 

1650
L
Novice
J
Jacky LaiNew Member
asked in Product Experimentation
What is the best way to differentiate the path in funnel analysis?

I have one button, and one dropdown on the same page. There will be 3 events for each:1. button shown → button clicked → target page2. dropdown shown → dropdown clicked → target pageMy question is,Q1.what’s the granularity of time interval amplitude is using?Let’s say, if the granularity is 1 minute, within 1 minutebutton shown → dropdown shown → button clicked → dropdown clicked → target pageSince all the events happen in one minute, how to tell which scenarios (button or dropdown) completed the flow?Thanks.

2381
dangrainger
Expert
M
Manuel FenklNew Member
asked in Product Experimentation
Amplitude Integration via Kotlin Multiplatform (cross-platform)

Hey folks, we are currently on the way towards migration from GA towards Amplitude. We have one iOS and one Android App, and we want to take this opportunity to integrate Amplitude via Kotlin Multiplatform Mobile (KMM).Goal: One business logic for the whole analytics integration in order to reduce the overhead of maintaining it on 2 platform and - most important - consistency among the platforms.Here is a video from GDG in Melbourne last week, talking about that in a more general way:  Does someone here in the community maby has experiences with such an integration? If yes, I would be very happy to get some insights about it. How did go, pitfalls, would you do it again, etc :)Thanks a lot!Best, Manuel 

6351
M
R
Rohin MadhavanNew Member
asked in Product Experimentation
Integrating Appsflyer attribution data to Amplitude

We have been trying to send the Appsflyer integration data to Amplitude but we are unable to see the events on the Amplitude dashboard. We have followed documentations provided by both Appsflyer and Amplitude but we do have a few doubts which might be causing the integration to fail.We are using Amplitude-swift for getting the user analytics and initially we were to collecting the IDFA value from the user but for this integration to work I assume we require IDFA from both Amplitude and Appsflyer so we implemented the IDFA collection plugin as we are not able to use adSupportBlock method mentioned in the documentation. Would this be enough to get the IDFA collected? Could you clarify how to match the events in both Appsflyer and Amplitude? Any two events with the same IDFA value would suffice or should we map the events to amplitude while setting this up in Appsflyer?

2840
R
S
Conversationalist
srushti.wadekarConversationalist
asked in Product Experimentation
Quantifiable metrics in Amplitude

I’m trying to understand time taken by a user to perform an event x since the first time they login or use the system. This is quantifiable metric and can we use Amplitude to derive such metrics?

2701
Saish Redkar
Expert
S
Conversationalist
srushti.wadekarConversationalist
asked in Product Experimentation
Fetch product wastage (Low usage features) in Amplitude? 

Is it possible to fetch product wastage (Low usage features) in Amplitude out of all events recorded? 

2571
Saish Redkar
Expert
Z
Zach AndersonNew Member
asked in Product Experimentation
Password Policy

I’m looking for information on the password policy for Amplitude. I understand it is not configurable and SSO is currently not an option for us since we are on the free tier. However, as part of our access review we need to document the current password policy to ensure it is inline with our internal policies or create an exception if needed. Does anyone have this information? We are looking for things such as password length, complexity, history, etc. 

1950
Z
O
omygoodnessNew Member
asked in Product Experimentation
Tracking multiple applications on one instance (API-KEY)

Hi,I'm using Module Federation with Angular. In the host application, I initialize Amplitude using a single API key. However, I have several other applications that also utilize the same instance of Amplitude.Is it possible to set a global property, such as appName, so that all events coming from the different applications have this identifier? This would help in grouping those events or creating charts for unique apps. Alternatively, do I need to manage multiple instances and use multiple API keys to achieve this distinction?I know I can add appName to each track event but I would like to avoid that approach:amplitude.track(eventName, { appName: 'testApp',});amplitude.track(eventName, { appName: 'testApp1',});amplitude.track(eventName, { appName: 'testApp2',});etc... 

3160
O
R
Rafael GuerreiroNew Member
asked in Product Experimentation
How do I integrate amplitude with google ads to track conversions?

When users open my iOS/Android app, I’d like to know whether they’re coming from an ad source and send this data to google. How can I do that?Also, I need to follow coppa and gdpr-k, can I use the IDFV for that? I can’t request IDFA.

3000
R
A
Advait PatilNew Member
asked in Product Experimentation
Pause and restart experiment

If we have a business requirement to only run experiments on weekdays, would toggling the “active” to “inactive” achieve this? And if not, is there an easier way than setting up multiple instances?

3810
A
I
Ivan AndrieievNew Member
asked in Product Experimentation
password policy

Is it possible to configure the password policy of analytics.amplitude.com?

4155
Esther Trapadoux
Community Manager
M
Muchid AriyantoNew Member
asked in Product Experimentation
Excluding data on specific date for experiment

Hi Team, We have some issue on some specific date for experiment and we want to exclude that date for experiment result.  By this screenshot, we want to know how we can exclude date of 23 June 2023 for experiment decision, since in the date option we cant exclude date. Thank you  

2864
M
V
Vania AlyaNew Member
asked in Product Experimentation
New Amplitude UI in Experiment

Hi Amplitude team! We’ve seen that you have made a UI and feature updates in almost every section of Amplitude product. This change creates a blocker for our process actually. We found that in the segmentation feature there is an option to revert back to the legacy Controls.Is this option available for the Experiment feature too? There are a couple of features that is no longer available and it’s quite painful for us. Would like to list it all down because I don’t have the pre existing UI screenshot.Copy-pasting a value without “ “. We saw that in the new feature when we want to copy a value, let’s say ID 23476 it will paste with “23476” which will not be detected as a user id. And thus creating the need to erase it one by one. The Open in Analytics feature which offers user to able to open a metric in Experiment to the Segmentation Chart. This helps us to further dive deep in the charts, so having the feature not available makes us have to copying and pasting each metrics and creating

3340
V
L
Helpful Hero
liukaichiHelpful Hero
asked in Product Experimentation
Re-running experiments

Hi, so let’s say we’ve run an experiment that has failed, or has produced results we otherwise want to discard. Is there a way to “restart” the experiment so that we can use the same key, but provide different keys and get clean experiment results? By “clean” I mean old data will not interfere with new findings. I feel like with the current structure, there’s no way to do this, which means we need to cycle through a bunch of different keys every time we want a fresh start, even though most of the experiment is the same.  Any insight here would be appreciated.

3670
L
Helpful Hero
V
Vania AlyaNew Member
asked in Product Experimentation
Data insufficient prompt in T Test Analysis Experiment

Hi Amplitude Team!I would like to ask regarding the Amplitude Experiment. The case is that we have a sample size requirement of 57,000, two sided, and 95% confidence level. However when we wanted to analyse the result of the experiment and changed the Statistical setting to the required, the data showed that it “needs more data to be conclusive” and the statistical in the data is 0% when the supposedly performance is -1.8% (with MDE of 1%). Is there any reason why this prompt is showing? Thank you!

2093
N
Well-Versed
S
Novice
shani cohenNovice
asked in Product Experimentation
How to see which accounts the user is related to

Hello :)Account level managing question:short background:in my system, users can be - not related to any account related to 1 or more accountsQ1 - How do I see to which accounts the user is related to? can it appear somehow under the user properties?Q2 - Do I have a way to find out in a specific event if a user belongs to an account?  thank you 

2451
Saish Redkar
Expert
P
Polina MokretsovaNew Member
asked in Product Experimentation
Distinct Property Values ​​Per User in the Event Segmentation

Hello! I’m a product analyst, studying the Amplitude for work.I got acquainted with the documentation on the functionality, but didn’t find a detailed description and application of Distinct Property Values ​​Per User in the Event Segmentation report.Can you explain where this functionality can be applied? And what does it mean?I will be grateful for your help!

9783
Saish Redkar
Expert
R
Ricardo Mighty HealthNew Member
asked in Product Experimentation
Chart query error

I'm trying to do a single request (Manually, without any type of automation, just one time) but I sill receive the error: HTTP 429: Too many requests (Too Many Requests: Exceeded rate limit with query of cost 16425)Anyone faced this problem before?Regards,Schieck.

2622
R
B
Ben KloesterNew Member
asked in Product Experimentation
What permissions does LaunchDarkly Cohort sync really need?

The instructions for setting up syncing of Amplitude cohorts to LaunchDarkly suggest creating an access token with Writer permissions, which has write access to pretty much everything except account members and billing. That seems like much more than is needed to do what the sync needs, as AFAICT it just creates and updates Segments in LD. Does anyone know what access is actually required, to what objects, in order for the sync to work? I’m considering creating a custom role that only has write permissions to Segments, for instance.

2563
Esther Trapadoux
Community Manager
F
Novice
Florent VilmartNovice
asked in Product Experimentation
Exposure tracking through segment

Hi there!For Amplitude experiments, it is recommended to emit an exposure event.We are using segment.io and are wondering how we can track those events properly.Whenever we call `track` it ends up being an event with name `$exposure`.Segment doesn’t seem to wanna pass `event_type` to the destination.The alternative is to use the `identify` call, but I wonder if there are side effects compared to using the $exposure call.

4877
F
Novice
V
Vania AlyaNew Member
asked in Product Experimentation
Error Message when Saving Experiment

Hi amplitude team, I wanted to raise an error message that I encountered when saving changes to my experiment. If i may know what triggers this error? Because this happened to a couple of experiments with the same error message and we don’t use any value ($1,$2,$3) that was stated in the error message. Thank you!   

1532
Y
Team Member

Recent Tips & Tricks

Terms & ConditionsCookie settings