Skip to main content

User Groups
Events
Documentation
Blog
Product Updates
Academy

Homepage
Using Amplitude
Product Experimentation

Product Experimentation

Amplitude Experiment is our product that allows teams to remotely modify and configure the product experiences for unique audiences.

110 Topics
194 Replies

When you subscribe we will email you when there is a new topic in this category

110 Topics

lanceNovice

asked in Product Experimentation

Session metrics in experiments

Is it possible to track session metrics (e.g., Time spent per user, Avg length, etc.) in an Experiment Results chart? In the past we’ve tried using User Session charts but we aren’t cleanly able to create separate treatment and control segments and it does not have the same functionality in leveraging the only after Exposure event… feature in an Experiment Results chart

Jacky LaiNew Member

asked in Product Experimentation

What is the best way to differentiate the path in funnel analysis?

I have one button, and one dropdown on the same page. There will be 3 events for each:1. button shown → button clicked → target page2. dropdown shown → dropdown clicked → target pageMy question is,Q1.what’s the granularity of time interval amplitude is using?Let’s say, if the granularity is 1 minute, within 1 minutebutton shown → dropdown shown → button clicked → dropdown clicked → target pageSince all the events happen in one minute, how to tell which scenarios (button or dropdown) completed the flow?Thanks.

Manuel FenklNew Member

asked in Product Experimentation

Amplitude Integration via Kotlin Multiplatform (cross-platform)

Hey folks, we are currently on the way towards migration from GA towards Amplitude. We have one iOS and one Android App, and we want to take this opportunity to integrate Amplitude via Kotlin Multiplatform Mobile (KMM).Goal: One business logic for the whole analytics integration in order to reduce the overhead of maintaining it on 2 platform and - most important - consistency among the platforms.Here is a video from GDG in Melbourne last week, talking about that in a more general way: Does someone here in the community maby has experiences with such an integration? If yes, I would be very happy to get some insights about it. How did go, pitfalls, would you do it again, etc :)Thanks a lot!Best, Manuel

Rohin MadhavanNew Member

asked in Product Experimentation

Integrating Appsflyer attribution data to Amplitude

We have been trying to send the Appsflyer integration data to Amplitude but we are unable to see the events on the Amplitude dashboard. We have followed documentations provided by both Appsflyer and Amplitude but we do have a few doubts which might be causing the integration to fail.We are using Amplitude-swift for getting the user analytics and initially we were to collecting the IDFA value from the user but for this integration to work I assume we require IDFA from both Amplitude and Appsflyer so we implemented the IDFA collection plugin as we are not able to use adSupportBlock method mentioned in the documentation. Would this be enough to get the IDFA collected? Could you clarify how to match the events in both Appsflyer and Amplitude? Any two events with the same IDFA value would suffice or should we map the events to amplitude while setting this up in Appsflyer?

srushti.wadekarConversationalist

asked in Product Experimentation

Quantifiable metrics in Amplitude

I’m trying to understand time taken by a user to perform an event x since the first time they login or use the system. This is quantifiable metric and can we use Amplitude to derive such metrics?

srushti.wadekarConversationalist

asked in Product Experimentation

Fetch product wastage (Low usage features) in Amplitude?

Is it possible to fetch product wastage (Low usage features) in Amplitude out of all events recorded?

Zach AndersonNew Member

asked in Product Experimentation

Password Policy

I’m looking for information on the password policy for Amplitude. I understand it is not configurable and SSO is currently not an option for us since we are on the free tier. However, as part of our access review we need to document the current password policy to ensure it is inline with our internal policies or create an exception if needed. Does anyone have this information? We are looking for things such as password length, complexity, history, etc.

omygoodnessNew Member

asked in Product Experimentation

Tracking multiple applications on one instance (API-KEY)

Hi,I'm using Module Federation with Angular. In the host application, I initialize Amplitude using a single API key. However, I have several other applications that also utilize the same instance of Amplitude.Is it possible to set a global property, such as appName, so that all events coming from the different applications have this identifier? This would help in grouping those events or creating charts for unique apps. Alternatively, do I need to manage multiple instances and use multiple API keys to achieve this distinction?I know I can add appName to each track event but I would like to avoid that approach:amplitude.track(eventName, { appName: 'testApp',});amplitude.track(eventName, { appName: 'testApp1',});amplitude.track(eventName, { appName: 'testApp2',});etc...

Rafael GuerreiroNew Member

asked in Product Experimentation

How do I integrate amplitude with google ads to track conversions?

When users open my iOS/Android app, I’d like to know whether they’re coming from an ad source and send this data to google. How can I do that?Also, I need to follow coppa and gdpr-k, can I use the IDFV for that? I can’t request IDFA.

Advait PatilNew Member

asked in Product Experimentation

Pause and restart experiment

If we have a business requirement to only run experiments on weekdays, would toggling the “active” to “inactive” achieve this? And if not, is there an easier way than setting up multiple instances?

Ivan AndrieievNew Member

asked in Product Experimentation

password policy

Is it possible to configure the password policy of analytics.amplitude.com?

Muchid AriyantoNew Member

asked in Product Experimentation

Excluding data on specific date for experiment

Hi Team, We have some issue on some specific date for experiment and we want to exclude that date for experiment result. By this screenshot, we want to know how we can exclude date of 23 June 2023 for experiment decision, since in the date option we cant exclude date. Thank you

Vania AlyaNew Member

asked in Product Experimentation

New Amplitude UI in Experiment

Hi Amplitude team! We’ve seen that you have made a UI and feature updates in almost every section of Amplitude product. This change creates a blocker for our process actually. We found that in the segmentation feature there is an option to revert back to the legacy Controls.Is this option available for the Experiment feature too? There are a couple of features that is no longer available and it’s quite painful for us. Would like to list it all down because I don’t have the pre existing UI screenshot.Copy-pasting a value without “ “. We saw that in the new feature when we want to copy a value, let’s say ID 23476 it will paste with “23476” which will not be detected as a user id. And thus creating the need to erase it one by one. The Open in Analytics feature which offers user to able to open a metric in Experiment to the Segmentation Chart. This helps us to further dive deep in the charts, so having the feature not available makes us have to copying and pasting each metrics and creating

liukaichiHelpful Hero

asked in Product Experimentation

Re-running experiments

Hi, so let’s say we’ve run an experiment that has failed, or has produced results we otherwise want to discard. Is there a way to “restart” the experiment so that we can use the same key, but provide different keys and get clean experiment results? By “clean” I mean old data will not interfere with new findings. I feel like with the current structure, there’s no way to do this, which means we need to cycle through a bunch of different keys every time we want a fresh start, even though most of the experiment is the same. Any insight here would be appreciated.

Vania AlyaNew Member

asked in Product Experimentation

Data insufficient prompt in T Test Analysis Experiment

Hi Amplitude Team!I would like to ask regarding the Amplitude Experiment. The case is that we have a sample size requirement of 57,000, two sided, and 95% confidence level. However when we wanted to analyse the result of the experiment and changed the Statistical setting to the required, the data showed that it “needs more data to be conclusive” and the statistical in the data is 0% when the supposedly performance is -1.8% (with MDE of 1%). Is there any reason why this prompt is showing? Thank you!

shani cohenNovice

asked in Product Experimentation

How to see which accounts the user is related to

Hello :)Account level managing question:short background:in my system, users can be - not related to any account related to 1 or more accountsQ1 - How do I see to which accounts the user is related to? can it appear somehow under the user properties?Q2 - Do I have a way to find out in a specific event if a user belongs to an account? thank you

Polina MokretsovaNew Member

asked in Product Experimentation

Distinct Property Values Per User in the Event Segmentation

Hello! I’m a product analyst, studying the Amplitude for work.I got acquainted with the documentation on the functionality, but didn’t find a detailed description and application of Distinct Property Values Per User in the Event Segmentation report.Can you explain where this functionality can be applied? And what does it mean?I will be grateful for your help!

Ricardo Mighty HealthNew Member

asked in Product Experimentation

Chart query error

I'm trying to do a single request (Manually, without any type of automation, just one time) but I sill receive the error: HTTP 429: Too many requests (Too Many Requests: Exceeded rate limit with query of cost 16425)Anyone faced this problem before?Regards,Schieck.

Ben KloesterNew Member

asked in Product Experimentation

What permissions does LaunchDarkly Cohort sync really need?

The instructions for setting up syncing of Amplitude cohorts to LaunchDarkly suggest creating an access token with Writer permissions, which has write access to pretty much everything except account members and billing. That seems like much more than is needed to do what the sync needs, as AFAICT it just creates and updates Segments in LD. Does anyone know what access is actually required, to what objects, in order for the sync to work? I’m considering creating a custom role that only has write permissions to Segments, for instance.

Florent VilmartNovice

asked in Product Experimentation

Exposure tracking through segment

Hi there!For Amplitude experiments, it is recommended to emit an exposure event.We are using segment.io and are wondering how we can track those events properly.Whenever we call `track` it ends up being an event with name `$exposure`.Segment doesn’t seem to wanna pass `event_type` to the destination.The alternative is to use the `identify` call, but I wonder if there are side effects compared to using the $exposure call.

Vania AlyaNew Member

asked in Product Experimentation

Error Message when Saving Experiment

Hi amplitude team, I wanted to raise an error message that I encountered when saving changes to my experiment. If i may know what triggers this error? Because this happened to a couple of experiments with the same error message and we don’t use any value ($1,$2,$3) that was stated in the error message. Thank you!

Ossi PesonenNew Member

asked in Product Experimentation

Amplitude Experiment device type for iPhone 14 not working

We are trying to set up A/B testing for anonymous users that is targeted specifically for iPhone users. Amplitude, however, seems to be unable to detect iPhones for the variant as per our testing. For reasons unknown the variant is not returned in the request, because Amplitude does not recognize iPhone via the user agent.We are using the JavaScript SDK and setting it up as per documentation, and I’ve done some debugging to see what type of user agent string is being delivered via network requests from a phone:Granted, this is from an iPhone simulator, but based on the information I gathered from the web, it is exactly as a real device, which also do not work. We had QA engineers try to enable this experiment as well with real iPhones on our website and we couldn’t get it to work.Here’s a snippet of the JS code:const amplitudeExperiment = window.experiment;if (amplitudeExperiment) { var div = document.getElementById('variant-info'); amplitudeExperiment.fetch().then(function() { co

anandraprincNew Member

asked in Product Experimentation

Unable to fetch new file from GCS Bucket

I am new to Amplitude, I have configured a source to GCS for event data import. It imported first time when I have configured, but later whenI am pushing another files to GCP bucket with same extension and format it is not reading that file.

Novita OliveraNew Member

asked in Product Experimentation

Difference between Exposure event with blue font and green font

I saw that sometimes my exposure event is in blue one and sometimes it is in green font. I read that this is due to the event that is outside the session.Can I interpret that blue exposure is for front end experiment and green exposure is for back end experiment? What conditions that make the exposure event is outside the session?Reference: https://github.com/segmentio/analytics-react-native/issues/654

Novita OliveraNew Member

asked in Product Experimentation

Best practices for using custom exposure in Amplitude experiments

Our aim is to utilize custom exposure in Amplitude experiments to make sure the users who see the changes is expected as the definition that we want to target. But we have observed a problem of receiving some exposures without any assignment, even after a few weeks of implementation. Is there any suggestion or guidelines of best practices for using custom exposure effectively in Amplitude?https://analytics.amplitude.com/tiketcom/chart/new/denicz1

1
2
3
4
5

Page 3 / 5

Recent Tips & Tricks

Improving Data Quality with Collaboration
Tag Manager Vs. SDK
Insights Are Only As Good As Your Schema

Powered by Gainsight

Terms & Conditions Cookie settings

Welcome to the Amplitude Community!

If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. You can also create a Guest account below!

If you're a current customer, select the domain you use to sign in with Amplitude.

analytics.amplitude.com analytics.eu.amplitude.com

or

Username *

E-mail address *

Password *

I accept Terms & Conditions.

loginBox.register.email_repeat

Welcome to the Amplitude Community!

If you don't have an Amplitude account, you can create an Amplitude Starter account for free and enjoy direct access to the Community via SSO. Create an Amplitude account. Want to sign up as a guest? Create a Community account.

If you're a current customer, select the domain you use to sign in with Amplitude.

analytics.amplitude.com analytics.eu.amplitude.com

or

Sign in as a guest with Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK