Skip to main content

User Groups
Events
Documentation
Blog
Product Updates
Academy

Homepage
Using Amplitude
Product Experimentation

Product Experimentation

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences.

107 Topics
184 Replies

When you subscribe we will email you when there is a new topic in this category

107 Topics

Recently active

Most replies Most views Newest first

srushti.wadekarConversationalist

asked in Product Experimentation

Quantifiable metrics in Amplitude

I’m trying to understand time taken by a user to perform an event x since the first time they login or use the system. This is quantifiable metric and can we use Amplitude to derive such metrics?

srushti.wadekarConversationalist

asked in Product Experimentation

Fetch product wastage (Low usage features) in Amplitude?

Is it possible to fetch product wastage (Low usage features) in Amplitude out of all events recorded?

Zach AndersonNew Member

asked in Product Experimentation

Password Policy

I’m looking for information on the password policy for Amplitude. I understand it is not configurable and SSO is currently not an option for us since we are on the free tier. However, as part of our access review we need to document the current password policy to ensure it is inline with our internal policies or create an exception if needed. Does anyone have this information? We are looking for things such as password length, complexity, history, etc.

omygoodnessNew Member

asked in Product Experimentation

Tracking multiple applications on one instance (API-KEY)

Hi,I'm using Module Federation with Angular. In the host application, I initialize Amplitude using a single API key. However, I have several other applications that also utilize the same instance of Amplitude.Is it possible to set a global property, such as appName, so that all events coming from the different applications have this identifier? This would help in grouping those events or creating charts for unique apps. Alternatively, do I need to manage multiple instances and use multiple API keys to achieve this distinction?I know I can add appName to each track event but I would like to avoid that approach:amplitude.track(eventName, { appName: 'testApp',});amplitude.track(eventName, { appName: 'testApp1',});amplitude.track(eventName, { appName: 'testApp2',});etc...

Rafael GuerreiroNew Member

asked in Product Experimentation

How do I integrate amplitude with google ads to track conversions?

When users open my iOS/Android app, I’d like to know whether they’re coming from an ad source and send this data to google. How can I do that?Also, I need to follow coppa and gdpr-k, can I use the IDFV for that? I can’t request IDFA.

Advait PatilNew Member

asked in Product Experimentation

Pause and restart experiment

If we have a business requirement to only run experiments on weekdays, would toggling the “active” to “inactive” achieve this? And if not, is there an easier way than setting up multiple instances?

Muchid AriyantoNew Member

asked in Product Experimentation

Excluding data on specific date for experiment

Hi Team, We have some issue on some specific date for experiment and we want to exclude that date for experiment result. By this screenshot, we want to know how we can exclude date of 23 June 2023 for experiment decision, since in the date option we cant exclude date. Thank you

Ivan AndrieievNew Member

asked in Product Experimentation

password policy

Is it possible to configure the password policy of analytics.amplitude.com?

Vania AlyaNew Member

asked in Product Experimentation

New Amplitude UI in Experiment

Hi Amplitude team! We’ve seen that you have made a UI and feature updates in almost every section of Amplitude product. This change creates a blocker for our process actually. We found that in the segmentation feature there is an option to revert back to the legacy Controls.Is this option available for the Experiment feature too? There are a couple of features that is no longer available and it’s quite painful for us. Would like to list it all down because I don’t have the pre existing UI screenshot.Copy-pasting a value without “ “. We saw that in the new feature when we want to copy a value, let’s say ID 23476 it will paste with “23476” which will not be detected as a user id. And thus creating the need to erase it one by one. The Open in Analytics feature which offers user to able to open a metric in Experiment to the Segmentation Chart. This helps us to further dive deep in the charts, so having the feature not available makes us have to copying and pasting each metrics and creating

liukaichiHelpful Hero

asked in Product Experimentation

Re-running experiments

Hi, so let’s say we’ve run an experiment that has failed, or has produced results we otherwise want to discard. Is there a way to “restart” the experiment so that we can use the same key, but provide different keys and get clean experiment results? By “clean” I mean old data will not interfere with new findings. I feel like with the current structure, there’s no way to do this, which means we need to cycle through a bunch of different keys every time we want a fresh start, even though most of the experiment is the same. Any insight here would be appreciated.

Vania AlyaNew Member

asked in Product Experimentation

Data insufficient prompt in T Test Analysis Experiment

Hi Amplitude Team!I would like to ask regarding the Amplitude Experiment. The case is that we have a sample size requirement of 57,000, two sided, and 95% confidence level. However when we wanted to analyse the result of the experiment and changed the Statistical setting to the required, the data showed that it “needs more data to be conclusive” and the statistical in the data is 0% when the supposedly performance is -1.8% (with MDE of 1%). Is there any reason why this prompt is showing? Thank you!

shani cohenNovice

asked in Product Experimentation

How to see which accounts the user is related to

Hello :)Account level managing question:short background:in my system, users can be - not related to any account related to 1 or more accountsQ1 - How do I see to which accounts the user is related to? can it appear somehow under the user properties?Q2 - Do I have a way to find out in a specific event if a user belongs to an account? thank you

Polina MokretsovaNew Member

asked in Product Experimentation

Distinct Property Values Per User in the Event Segmentation

Hello! I’m a product analyst, studying the Amplitude for work.I got acquainted with the documentation on the functionality, but didn’t find a detailed description and application of Distinct Property Values Per User in the Event Segmentation report.Can you explain where this functionality can be applied? And what does it mean?I will be grateful for your help!

Ricardo Mighty HealthNew Member

asked in Product Experimentation

Chart query error

I'm trying to do a single request (Manually, without any type of automation, just one time) but I sill receive the error: HTTP 429: Too many requests (Too Many Requests: Exceeded rate limit with query of cost 16425)Anyone faced this problem before?Regards,Schieck.

Ben KloesterNew Member

asked in Product Experimentation

What permissions does LaunchDarkly Cohort sync really need?

The instructions for setting up syncing of Amplitude cohorts to LaunchDarkly suggest creating an access token with Writer permissions, which has write access to pretty much everything except account members and billing. That seems like much more than is needed to do what the sync needs, as AFAICT it just creates and updates Segments in LD. Does anyone know what access is actually required, to what objects, in order for the sync to work? I’m considering creating a custom role that only has write permissions to Segments, for instance.

Florent VilmartNovice

asked in Product Experimentation

Exposure tracking through segment

Hi there!For Amplitude experiments, it is recommended to emit an exposure event.We are using segment.io and are wondering how we can track those events properly.Whenever we call `track` it ends up being an event with name `$exposure`.Segment doesn’t seem to wanna pass `event_type` to the destination.The alternative is to use the `identify` call, but I wonder if there are side effects compared to using the $exposure call.

Vania AlyaNew Member

asked in Product Experimentation

Error Message when Saving Experiment

Hi amplitude team, I wanted to raise an error message that I encountered when saving changes to my experiment. If i may know what triggers this error? Because this happened to a couple of experiments with the same error message and we don’t use any value ($1,$2,$3) that was stated in the error message. Thank you!

Ossi PesonenNew Member

asked in Product Experimentation

Amplitude Experiment device type for iPhone 14 not working

We are trying to set up A/B testing for anonymous users that is targeted specifically for iPhone users. Amplitude, however, seems to be unable to detect iPhones for the variant as per our testing. For reasons unknown the variant is not returned in the request, because Amplitude does not recognize iPhone via the user agent.We are using the JavaScript SDK and setting it up as per documentation, and I’ve done some debugging to see what type of user agent string is being delivered via network requests from a phone:Granted, this is from an iPhone simulator, but based on the information I gathered from the web, it is exactly as a real device, which also do not work. We had QA engineers try to enable this experiment as well with real iPhones on our website and we couldn’t get it to work.Here’s a snippet of the JS code:const amplitudeExperiment = window.experiment;if (amplitudeExperiment) { var div = document.getElementById('variant-info'); amplitudeExperiment.fetch().then(function() { co

anandraprincNew Member

asked in Product Experimentation

Unable to fetch new file from GCS Bucket

I am new to Amplitude, I have configured a source to GCS for event data import. It imported first time when I have configured, but later whenI am pushing another files to GCP bucket with same extension and format it is not reading that file.

Novita OliveraNew Member

asked in Product Experimentation

Difference between Exposure event with blue font and green font

I saw that sometimes my exposure event is in blue one and sometimes it is in green font. I read that this is due to the event that is outside the session.Can I interpret that blue exposure is for front end experiment and green exposure is for back end experiment? What conditions that make the exposure event is outside the session?Reference: https://github.com/segmentio/analytics-react-native/issues/654

Novita OliveraNew Member

asked in Product Experimentation

Best practices for using custom exposure in Amplitude experiments

Our aim is to utilize custom exposure in Amplitude experiments to make sure the users who see the changes is expected as the definition that we want to target. But we have observed a problem of receiving some exposures without any assignment, even after a few weeks of implementation. Is there any suggestion or guidelines of best practices for using custom exposure effectively in Amplitude?https://analytics.amplitude.com/tiketcom/chart/new/denicz1

asked in Product Experimentation

Exposure Events Tracking

Hi Amplitude CommunityI am trying to launch my first experiment and trying to track exposure eventHowever the docs seem to not have been updated.What is the correct code to track exposure event.I am using this amplitude.track( "$exposure", (Map<String, ? extends Object>) new Properties() .put("exposure.getFlagKey()",exposure.getVariant()));} but I feel this is not the right wayCould someone please help me out?

liukaichiHelpful Hero

asked in Product Experimentation

Flag-Dependent Experiment Allocation

I have a question regarding experiment allocations.We have two flags that we want to be dependent on each other. For example "For users who are shown this, give them another experiment".For example using two flags, "show_tabs" and "show_new_shiny_tab". I would like to configure an experiment that is "For users who see the tabs, perform an A/B Test to users to test a new shiny tab". So to achieve behavior, we select on the "show_new_shiny_tab" experiment the following: "Users where show_tabs = true/false". Will this work as expected? From what we see, there is room for doubt, but overall it looks like it is working. Is there any concerns with this approach?

jacoob_mNew Member

asked in Product Experimentation

Flag management by API.

Hi,I use a flag to enable user features in my app. I add user ids to the segments by UI.I did it according to the doc: Working with feature flags and feature rolloutsBut it is inconvenient with more users.I would like to do it by API. I got acquainted with Experiment customers: New endpoints available for the Management API but I did not find an answer there on how to manage the list of users belonging to the segment. I can pull a segment for a flag but I can't change the segment.Can I do it with the current state of the API? Maybe there are some other ways to enable/disable the flag for users via the API.

Fran6New Member

asked in Product Experimentation

Cohort with specific behaviour every month

I would like to create a cohorte of people who performed a certain number of actions per month (like listen to < 20 songs in each month last year). But what if someone listen to 20 songsa month and then 21 in the other one ? In that case I would like to take him out of my cohorte and only keep the people who performed less than 20 songs every month during a year. Is it possible to get these people in a cohorte ? Thanks in advance

1
2
3
4
5

Page 3 / 5

Recent Tips & Tricks

Improving Data Quality with Collaboration
Tag Manager Vs. SDK
Insights Are Only As Good As Your Schema

Powered by Gainsight

Terms & Conditions Cookie settings

Welcome to the Amplitude Community!

If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. You can also create a Guest account below!

If you're a current customer, select the domain you use to sign in with Amplitude.

analytics.amplitude.com analytics.eu.amplitude.com

or

Username *

E-mail address *

Password *

I accept Terms & Conditions.

loginBox.register.email_repeat

Welcome to the Amplitude Community!

If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. Want to sign up as a guest? Create a Community account.

If you're a current customer, select the domain you use to sign in with Amplitude.

analytics.amplitude.com analytics.eu.amplitude.com

or

Sign in as a guest with Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK