Product Experimentation

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences.

108 Topics
188 Replies

Rohin MadhavanNew Member

asked in Product Experimentation

Integrating Appsflyer attribution data to Amplitude

We have been trying to send the Appsflyer integration data to Amplitude but we are unable to see the events on the Amplitude dashboard. We have followed documentations provided by both Appsflyer and Amplitude but we do have a few doubts which might be causing the integration to fail.We are using Amplitude-swift for getting the user analytics and initially we were to collecting the IDFA value from the user but for this integration to work I assume we require IDFA from both Amplitude and Appsflyer so we implemented the IDFA collection plugin as we are not able to use adSupportBlock method mentioned in the documentation. Would this be enough to get the IDFA collected? Could you clarify how to match the events in both Appsflyer and Amplitude? Any two events with the same IDFA value would suffice or should we map the events to amplitude while setting this up in Appsflyer?

2490

1 year ago

srushti.wadekarConversationalist

asked in Product Experimentation

Quantifiable metrics in Amplitude

I’m trying to understand time taken by a user to perform an event x since the first time they login or use the system. This is quantifiable metric and can we use Amplitude to derive such metrics?

2031

1 year ago

srushti.wadekarConversationalist

asked in Product Experimentation

Fetch product wastage (Low usage features) in Amplitude?

Is it possible to fetch product wastage (Low usage features) in Amplitude out of all events recorded?

2071

1 year ago

Zach AndersonNew Member

asked in Product Experimentation

Password Policy

I’m looking for information on the password policy for Amplitude. I understand it is not configurable and SSO is currently not an option for us since we are on the free tier. However, as part of our access review we need to document the current password policy to ensure it is inline with our internal policies or create an exception if needed. Does anyone have this information? We are looking for things such as password length, complexity, history, etc.

1680

1 year ago

omygoodnessNew Member

asked in Product Experimentation

Tracking multiple applications on one instance (API-KEY)

Hi,I'm using Module Federation with Angular. In the host application, I initialize Amplitude using a single API key. However, I have several other applications that also utilize the same instance of Amplitude.Is it possible to set a global property, such as appName, so that all events coming from the different applications have this identifier? This would help in grouping those events or creating charts for unique apps. Alternatively, do I need to manage multiple instances and use multiple API keys to achieve this distinction?I know I can add appName to each track event but I would like to avoid that approach:amplitude.track(eventName, { appName: 'testApp',});amplitude.track(eventName, { appName: 'testApp1',});amplitude.track(eventName, { appName: 'testApp2',});etc...

2730

1 year ago

Rafael GuerreiroNew Member

asked in Product Experimentation

How do I integrate amplitude with google ads to track conversions?

When users open my iOS/Android app, I’d like to know whether they’re coming from an ad source and send this data to google. How can I do that?Also, I need to follow coppa and gdpr-k, can I use the IDFV for that? I can’t request IDFA.

2650

1 year ago

Advait PatilNew Member

asked in Product Experimentation

Pause and restart experiment

If we have a business requirement to only run experiments on weekdays, would toggling the “active” to “inactive” achieve this? And if not, is there an easier way than setting up multiple instances?

3140

1 year ago

Ivan AndrieievNew Member

asked in Product Experimentation

password policy

Is it possible to configure the password policy of analytics.amplitude.com?

3445

1 year ago

Muchid AriyantoNew Member

asked in Product Experimentation

Excluding data on specific date for experiment

Hi Team, We have some issue on some specific date for experiment and we want to exclude that date for experiment result. By this screenshot, we want to know how we can exclude date of 23 June 2023 for experiment decision, since in the date option we cant exclude date. Thank you

2364

1 year ago

Vania AlyaNew Member

asked in Product Experimentation

New Amplitude UI in Experiment

Hi Amplitude team! We’ve seen that you have made a UI and feature updates in almost every section of Amplitude product. This change creates a blocker for our process actually. We found that in the segmentation feature there is an option to revert back to the legacy Controls.Is this option available for the Experiment feature too? There are a couple of features that is no longer available and it’s quite painful for us. Would like to list it all down because I don’t have the pre existing UI screenshot.Copy-pasting a value without “ “. We saw that in the new feature when we want to copy a value, let’s say ID 23476 it will paste with “23476” which will not be detected as a user id. And thus creating the need to erase it one by one. The Open in Analytics feature which offers user to able to open a metric in Experiment to the Segmentation Chart. This helps us to further dive deep in the charts, so having the feature not available makes us have to copying and pasting each metrics and creating

2850

1 year ago

liukaichiHelpful Hero

asked in Product Experimentation

Re-running experiments

Hi, so let’s say we’ve run an experiment that has failed, or has produced results we otherwise want to discard. Is there a way to “restart” the experiment so that we can use the same key, but provide different keys and get clean experiment results? By “clean” I mean old data will not interfere with new findings. I feel like with the current structure, there’s no way to do this, which means we need to cycle through a bunch of different keys every time we want a fresh start, even though most of the experiment is the same. Any insight here would be appreciated.

3200

1 year ago

Vania AlyaNew Member

asked in Product Experimentation

Data insufficient prompt in T Test Analysis Experiment

Hi Amplitude Team!I would like to ask regarding the Amplitude Experiment. The case is that we have a sample size requirement of 57,000, two sided, and 95% confidence level. However when we wanted to analyse the result of the experiment and changed the Statistical setting to the required, the data showed that it “needs more data to be conclusive” and the statistical in the data is 0% when the supposedly performance is -1.8% (with MDE of 1%). Is there any reason why this prompt is showing? Thank you!

1833

1 year ago

shani cohenNovice

asked in Product Experimentation

How to see which accounts the user is related to

Hello :)Account level managing question:short background:in my system, users can be - not related to any account related to 1 or more accountsQ1 - How do I see to which accounts the user is related to? can it appear somehow under the user properties?Q2 - Do I have a way to find out in a specific event if a user belongs to an account? thank you

1971

1 year ago

Polina MokretsovaNew Member

asked in Product Experimentation

Distinct Property Values Per User in the Event Segmentation

Hello! I’m a product analyst, studying the Amplitude for work.I got acquainted with the documentation on the functionality, but didn’t find a detailed description and application of Distinct Property Values Per User in the Event Segmentation report.Can you explain where this functionality can be applied? And what does it mean?I will be grateful for your help!

8483

1 year ago

Ricardo Mighty HealthNew Member

asked in Product Experimentation

Chart query error

I'm trying to do a single request (Manually, without any type of automation, just one time) but I sill receive the error: HTTP 429: Too many requests (Too Many Requests: Exceeded rate limit with query of cost 16425)Anyone faced this problem before?Regards,Schieck.

2072

1 year ago

Ben KloesterNew Member

asked in Product Experimentation

What permissions does LaunchDarkly Cohort sync really need?

The instructions for setting up syncing of Amplitude cohorts to LaunchDarkly suggest creating an access token with Writer permissions, which has write access to pretty much everything except account members and billing. That seems like much more than is needed to do what the sync needs, as AFAICT it just creates and updates Segments in LD. Does anyone know what access is actually required, to what objects, in order for the sync to work? I’m considering creating a custom role that only has write permissions to Segments, for instance.

2063

1 year ago

Florent VilmartNovice

asked in Product Experimentation

Exposure tracking through segment

Hi there!For Amplitude experiments, it is recommended to emit an exposure event.We are using segment.io and are wondering how we can track those events properly.Whenever we call `track` it ends up being an event with name `$exposure`.Segment doesn’t seem to wanna pass `event_type` to the destination.The alternative is to use the `identify` call, but I wonder if there are side effects compared to using the $exposure call.

4147

1 year ago

Vania AlyaNew Member

asked in Product Experimentation

Error Message when Saving Experiment

Hi amplitude team, I wanted to raise an error message that I encountered when saving changes to my experiment. If i may know what triggers this error? Because this happened to a couple of experiments with the same error message and we don’t use any value ($1,$2,$3) that was stated in the error message. Thank you!

1292

1 year ago

Ossi PesonenNew Member

asked in Product Experimentation

Amplitude Experiment device type for iPhone 14 not working

We are trying to set up A/B testing for anonymous users that is targeted specifically for iPhone users. Amplitude, however, seems to be unable to detect iPhones for the variant as per our testing. For reasons unknown the variant is not returned in the request, because Amplitude does not recognize iPhone via the user agent.We are using the JavaScript SDK and setting it up as per documentation, and I’ve done some debugging to see what type of user agent string is being delivered via network requests from a phone:Granted, this is from an iPhone simulator, but based on the information I gathered from the web, it is exactly as a real device, which also do not work. We had QA engineers try to enable this experiment as well with real iPhones on our website and we couldn’t get it to work.Here’s a snippet of the JS code:const amplitudeExperiment = window.experiment;if (amplitudeExperiment) { var div = document.getElementById('variant-info'); amplitudeExperiment.fetch().then(function() { co

3543

1 year ago

anandraprincNew Member

asked in Product Experimentation

Unable to fetch new file from GCS Bucket

I am new to Amplitude, I have configured a source to GCS for event data import. It imported first time when I have configured, but later whenI am pushing another files to GCP bucket with same extension and format it is not reading that file.

2767

1 year ago

Novita OliveraNew Member

asked in Product Experimentation

Difference between Exposure event with blue font and green font

I saw that sometimes my exposure event is in blue one and sometimes it is in green font. I read that this is due to the event that is outside the session.Can I interpret that blue exposure is for front end experiment and green exposure is for back end experiment? What conditions that make the exposure event is outside the session?Reference: https://github.com/segmentio/analytics-react-native/issues/654

3982

1 year ago

Novita OliveraNew Member

asked in Product Experimentation

Best practices for using custom exposure in Amplitude experiments

Our aim is to utilize custom exposure in Amplitude experiments to make sure the users who see the changes is expected as the definition that we want to target. But we have observed a problem of receiving some exposures without any assignment, even after a few weeks of implementation. Is there any suggestion or guidelines of best practices for using custom exposure effectively in Amplitude?https://analytics.amplitude.com/tiketcom/chart/new/denicz1

5511

1 year ago

invictusNovice

asked in Product Experimentation

Exposure Events Tracking

Hi Amplitude CommunityI am trying to launch my first experiment and trying to track exposure eventHowever the docs seem to not have been updated.What is the correct code to track exposure event.I am using this amplitude.track( "$exposure", (Map<String, ? extends Object>) new Properties() .put("exposure.getFlagKey()",exposure.getVariant()));} but I feel this is not the right wayCould someone please help me out?

6937

1 year ago

liukaichiHelpful Hero

asked in Product Experimentation

Flag-Dependent Experiment Allocation

I have a question regarding experiment allocations.We have two flags that we want to be dependent on each other. For example "For users who are shown this, give them another experiment".For example using two flags, "show_tabs" and "show_new_shiny_tab". I would like to configure an experiment that is "For users who see the tabs, perform an A/B Test to users to test a new shiny tab". So to achieve behavior, we select on the "show_new_shiny_tab" experiment the following: "Users where show_tabs = true/false". Will this work as expected? From what we see, there is room for doubt, but overall it looks like it is working. Is there any concerns with this approach?

2261

1 year ago