Skip to main content

Data Planning and Governance

Data (Beta) provides data planning and tracking that helps companies run on clean and consistent analytics by eliminating human error during the instrumentation process.

  • 253 Topics
  • 628 Replies
253 Topics
Amplitude Admin
Community Manager
Amplitude AdminCommunity Manager
posted in Data Planning and Governance
Can I selectively delete or modify historical data on Amplitude?

Hi Amplitude Community, At the moment, it is not possible to selectively delete or modify historical events. Our current architecture is based on pre-aggregated sets by the hour, day, week and month for users and events. While this allows us to scale well, a limitation is that data is immutableThat being said, we have some options for specific use cases:You can use the Export API to pull all the data from their project, sanitize the data (remove properties), and then perform a Self Backfill and use Batch API to push events into a new Amplitude project. Please note that backfilling data will increase the event volume in your org, which may incur costs. Deleting the old project will not reduce the volume. Do you want just to drop certain data? Amplitude Data's drop filters feature allows you to remove specific event data from your charts at query time. These events are not deleted, and they can be restored to your charts simply by editing or deleting the drop filter. You can read more ab

0
Amplitude Admin
Community Manager
1 year ago
Amplitude Admin
Community Manager
Amplitude AdminCommunity Manager
published in Data Planning and Governance
Welcome to the data planning and governance forum!

Learn, ask questions, or help others with planning and managing data in Amplitude. This is where you can ask and get feedback on questions such as: ✅ How does the environments section work with projects?✅ What is the difference between Taxonomy vs Govern vs Data?✅ Why are some events not showing up on my tracking plan?✅ How do I make an event Inactive after it's been Deleted?✅ What does it mean for an event to have a warning sign that says invalid x% of the time? Helpful resources: ❓Get started with Amplitude Data: what is Amplitude Data, best practices, working with branches, a typical workflow in Amplitude Data❓Building a tracking plan❓Advanced Data topics: lookup tables, integrating Jira, transformations and derived properties❓Amplitude Academy course: Getting Started with Data ❓Amplitude Academy course: Instrumenting your Data Taxonomy❓Amplitude Academy course: Iterating on a Data-Informed CultureStill have questions? Post them here! 

7850
Amplitude Admin
Community Manager
1 year ago
G
Guilherme DuarteNew Member
asked in Data Planning and Governance
Export Channel Classifier Information

Hi,We’re using Amplitude Channel classifiers to categorize user acquisition. We can see and use the Channel user property populated correctly within Amplitude. Is it possible to export that data with the BigQuery Destination?Thanks

3
P
1 day ago
S
Sabyr ZhurumbayevNew Member
asked in Data Planning and Governance
Why is nothing displayed in the tab Splitting?

Why is nothing displayed in the tab Splitting? Type - Array, Item type- Any. Is it a bug?  

3
T
Team Member
8 days ago
H
Novice
HaythamNovice
asked in Data Planning and Governance
Reference event timestamp in a derived property?

Is there any way to reference the time of an event in a derived property formula? I am trying to create a derived property that calculates the difference in time between a date in a user property (the users account creation date) and the date of the event being measured. I have gotten it to work using the TODAY() function, but I can’t seem to find any way to reference the event time itself. TODAY() only works if looking at the last N days, but I can’t use it to create historical trends. ThanksDIVIDE( MINUS( TODAY() , DATE_TO_LONG( REGEXEXTRACT( PROPERTY( 'first_insert_date', 'user' ), "^\d{4}-\d{2}-\d{2}" ) ) ), 86400000) 

3
T
Team Member
20 days ago
L
Lance JohnsonNew Member
asked in Data Planning and Governance
Cleanup old properties to get under property limit without blocking future reuse of those properties

We are bumping into our property limit and need to clean things up. Admittedly our data governance has been lacking for awhile and has caused us to have a lot of events/properties that showed up years ago for a bit and are no longer used.In my naive attempt to resolve this issue I went and found all properties not seen > 2 years ago and deleted them. This does seem to have removed them from the property limit count but after digging around a bit in docs I realized there is a nuanced behavior to deleted events/properties in that they are actually ‘blocked’ as well. As such, if a ‘new’ event is sent that has a property that matches one of these deleted property it won’t be associated w/ the event or saved in Amplitude. It does seem like these properties can be undeleted to solve that but the delete behavior is a bit problematic because it creates a ‘gotcha’ that could confuse neophytes or be missed and impact our data collection. Property names are usually rather simplistic like ‘butt

3
jarren.patao
Community Manager
21 days ago
S
Supratim RayNew Member
asked in Data Planning and Governance
Issue while adding new environment in Amplitude project

Hello,I need to create a new project in Amplitude and link 2 environments for it, that shows under Data for that project.Following the documentation, I created a new project called Test (screenshot attached). In Data section project settings, under Environment,I see one environment is already created and linked to it. As I tried to create a new environment, under the Select Project I could not find the other project I wanted it to connect (screenshot attached). It has an option to Add or Manage project, but that is taking to all projects list. I checked individual project settings but didn’t find any option to link either.Can anyone please help on this. I am new to Amplitude, apologies if the question is too basic.@belinda.chiu   

1
B
23 days ago
I
idalboNew Member
asked in Data Planning and Governance
Snowflake key-pair authentication keeps failing and data export errors

I recently switch authentication for the user exporting data from Amplitude to Snowflake from username password to key-pair authentication. I follow the instruction on screen, but every time I switch from pw to key-pair, the export fails with the following codeErrorsError Type: SnowflakeTime: Invalid DateTimeMessage: JWT token is invalid. [143cbb72-85dc-4e2c-8bc7-fef3a0d42fd4]The login to Snowflake succeeds (I checked the login history table there). Also, if I switch back to password auth it works as expected. Given the very small degree of customization allowed here, I don’t know what might be happening and how to solve this.

0
I
26 days ago
L
LUCAS ABREUNew Member
asked in Data Planning and Governance
Export data to private redshift cluster

Hi,We're interested in leveraging Amplitude's Redshift export feature, but our Redshift cluster resides in a private subnet within our VPC.We're hesitant to expose it publicly. I looked at the docs and the community posts trying to find something about this topic and found nothing. Does anyone know if Amplitude offer a VPC peering solution for Redshift export? If so, could you provide guidance on how to set it up or a link to the documentation? Thank you in advance!

1
Jacenda Davis
Team Member
1 month ago
Z
zeroseshNew Member
asked in Data Planning and Governance
Support for Transparency & Consent Framework (TCF) v2.2

Hello, are there any plans to implement support for the Transparency & Consent Framework (TCF) v2.2? This framework enables publishers and developers to collect region-specific consent via a Consent Management Platform (CMP) and allows vendors like Amplitude to retrieve and apply those preferences. For more details, please see: https://iabeurope.eu/transparency-consent-framework/ 

0
Z
1 month ago
S
Supratim RayNew Member
asked in Data Planning and Governance
Not able to add new environment in Amplitude project

Hello,I need to create a new project in Amplitude and link 2 environments for it, that shows under Data for that project.Following the documentation, I created a new project called Test (screenshot attached). In Data section project settings, under Environment,I see one environment is already created and linked to it. As I tried to create a new environment, under the Select Project I could not find the other project I wanted it to connect (screenshot attached). It has an option to Add or Manage project, but that is taking to all projects list. I checked individual project settings but didn’t find any option to link either.Can anyone please help on this. I am new to Amplitude, apologies if the question is too basic.@sydney.koh  

0
S
1 month ago
V
Vicente RotmanNew Member
asked in Data Planning and Governance
Duplicated and Missing Data events

Hello, I am using the Webhook Destintation functionality on the data connections.I send events through Webhook and I have found 2 issues constantly happeningThere are missing events and events that fail to be delivered for a missing property I’m using that is actually present. Then I go to find the specific event in a Segmentation chart, if I filter by that property being missed I do find some events but then when look deeply into those events they do have the property. Some events don’t even appear in the data connection counter and some of them fail with this error that is not accurate. Duplicated events. This is less serious but many events are sent multiple times to the WebhookMany thanks for the help and clarifications,Best,Vicente

0
V
1 month ago
G
Helpful Hero
GakaHelpful Hero
asked in Data Planning and Governance
Ampli CLI pull problem (React Native SDK)

Hello! Our app is a react-native project and we already get some analitycs by amplitude about year. Now I want to improve amplitude usage for our project and I would like to use Ampli CLI for our app.  If I try to executeampli pullI get the next warningWARNING You have yet to create a source in your account. Log into https://data.amplitude.com/ to create one.But in our app we have one source React native SDK with name ReactNative. Connected.Please tell me, is it possible to use ampli cli for react native project or maybe something wrong?

2
J
2 months ago
M
Madhulika MukherjeeNew Member
asked in Data Planning and Governance
How do I remove the Accounts Add On?

I added it thinking we’ll implement it, but plans changed. Now I want to remove it, but when I try to “modify plan” the Accounts Add On is defaulted to checkboxed, and I cannot uncheck it.Anybody knows how to remove it so I dont keep getting charged for it every month?

2
liuaud
Well-Versed
2 months ago
N
NiarcotykNew Member
asked in Data Planning and Governance
Send Identify event from Segment to Amplitude

Hello,  We are using Segment to collect events and send them to Amplitude. Our source code is in PHP, and this concerns the Identification event. Here the format of event: client.Identify(&analytics.Identify{   UserId: "XXXXXXXX",   Traits: map[string]interface{}{     "creation_date": "2024-07-22T06:14:30.000Z",     "is_akeneo_user": false,     "job_profile": "unknown",     "pim_user_group_ids": map[string]interface{}{       "0": "srnt-xxx@5",       "1": "srnt-xxx@11",     },     "pim_user_group_labels": map[string]interface{}{       "0": "srnt-xxx@IT support",       "1": "srnt-xxx@All",     },     "pim_user_id_prod": "srnt-xxx@1",     "pim_user_type": "user",   }, }) The problem is that it arrives in Amplitude in a format that is difficult to use. Here the format in Amplitude: pim_user_group_ids.0 pim_user_group_ids.1 pim_user_group_labels.0 pim_user_group_labels.1 So we change format from backend to spend this event: client.Identify(&analytics.Identify{   UserId: "XXXXXXX",  

2
L
Team Member
2 months ago
A
Alice Tsui
asked in Data Planning and Governance
How to split shared properties

Hi,  I have a few events which have the same property name but each have different values sent to the same property name. I want to rename the property to be less generic. Is there a way to split the values of a share property name? 

3
Jacenda Davis
Team Member
2 months ago
C
Conversationalist
Chris MarshallConversationalist
asked in Data Planning and Governance
Adding Amplitude to a Wix Site

Please do not point me to the documentation. I have read through all of the documentations and they are all missing something for how to actually make Amplitude work on Wix. I have done exactly what this article says, and i have followed both the outdated and the new version of this article. I have even added the SDK right into the page code itself and still no dice. Every time i run it i get the “amplitude is not defined” error. It is behaving as though no library of functions is ever called. If i had to guess i need to place something along the lines of “import amplitude from *********” somewhere. Something like this has to be missing from the documentation. If anyone has actually successfully added amplitude to a Wix website would you please show me how?

1
J
2 months ago
A
Akshay GulatiNew Member
asked in Data Planning and Governance
Default Properties Missing for some users

We recently instrumented Amplitude & are seeing an issue where the default user properties are set to none for almost 30% of our users even though custom user properties are being set for these users.Have been unable to spot a pattern or root cause for this. Any help would be sincerely appreciated.

0
A
2 months ago
S
Shakthi Prasad G SNew Member
asked in Data Planning and Governance
Unique user id

Hello all,We are using amplitude in our phaser based android and ios app. We have an escalation from the client with amplitude data displaying “all android users as 1 single android user”. The have provided with  dashboard screenshot showing list events where user id’s  shown as as “android-user” where they insisting it should actually show uniq ids for example, such as 83939399322.    Note: Here we using   AmplitudeServerZone set to EU do you think its default behaviour in EU zone due to GDPR restriction or Do you thing we are missing something in the implementation of app side. Thanks-Shakthi    

1
S
2 months ago
M
Matej PinterNew Member
asked in Data Planning and Governance
Despite being admin I have no access to workspace in CLI

We have a project which has android and iOS mobile app. I work in iOS team and I have admin role in amplitude. I installed latest CLI and tried to update with ampli pull command. Before that I logged in with ampli login and it correctly shows my name, zone and org. But despite of that I’m getting this error:✘ ERROR Current user doesn't have access to the workspace in ampli.json. Run ampli login to login as another user. You may need to ampli logout first. I’m out of ideas what else I can do here… 

1
M
3 months ago
J
Justin TrenorNew Member
asked in Data Planning and Governance
/api/2/deletions/users ignore_invalid_ids not working

I am running the following: import requestsimport jsonfrom requests.auth import HTTPBasicAuthurl = "https://amplitude.com/api/2/deletions/users"payload = json.dumps({ "user_ids": [ "this_one_exists", "does_not_exist" ], "requester": "test@gmail.com", "ignore_invalid_ids": True,})headers = { 'Content-Type': 'application/json', 'Accept': 'application/json'}auth = HTTPBasicAuth('API_KEY', 'SECRET_KEY')response = requests.request("POST", url, headers=headers, data=payload, auth=auth)print(response.text) Notice that in user IDs, one value does exist on Amplitude, and the other doesn’t. I get the following response: {'error': {'http_code': 400, 'type': 'invalid', 'message': 'Invalid definition', 'metadata': {'details': 'invalid amplitude_ids and/or user_ids given for app [%s]. invalid amplitude ids: [%s], invalid user_ids: [%s]'}}} My understanding is that the first should be added to the batch queue, and the second should be reported as an invalid ID. Am I doing something wrong here? T

1
eddie.gaona
Team Member
3 months ago
S
sambraveryNew Member
asked in Data Planning and Governance
Identifying Unexpected Enum Values

I’m seeing warnings under “Investigate Issues” that some of my events have “Unexpected Enum Values”. How do I see which values are coming through which are unexpected?I can see the list of enums in my tracking plan. I could try & map this with all events coming through; but that’s quite manual. I’m hoping there is a report which shows me the acutal values that are coming through which aren’t in the enum list.

3
rox.chang
Team Member
3 months ago
V
Viktor MNew Member
asked in Data Planning and Governance
Allow team to edit all charts in a space

Hello! It’s important for our use-case to allow 3 team members to ‘save’ all charts in a space rather duplicate with ‘save as’. I’m aware this is possible via the ‘share’ button in top right of each chart, but this manual work for each is burdensome. Documentation here: Collaborate on your analyses using spaces outlines the ability to use spaces to manage permissions.There are three levels of permissions:Can add: The user can add items or folders, or move existing content. Can edit: The user can edit, archive, and save changes to all content in the space. Can view: The user can only view the content residing in the space. However, these options are not available in my space. I have attempted ‘my space’ → Settings and Members → I view list of members, with no ability to set edit permissions. How can I get to these configurations to perform this bulk chart edit access capability? 

0
V
3 months ago
J
Conversationalist
Jonathan ShaharConversationalist
asked in Data Planning and Governance
Data Goverance and QA

I created a set of default properties on the event, user, and group level and I would like to be informed if an event is sent to Amplitude without them. The same goes for the formatting, sit should be lowerCamelCase.How can I make it happen?

8
Y
Team Member
4 months ago
JennRu
Community Manager
JennRuCommunity Manager
posted in Data Planning and Governance
Build derived properties to determine how many days until a future contract end date is approaching.

Analysis limitations on date fields Use cases to expand analysis and targeting on date fields relative to TODAY() Extract this data and stamp it onto a newly derived property with retroactive data  Build analyses and cohorts with newly derived propertiesAnalysis limitations on date fieldsAre you tracking a property where data type = date?Sample group property date field synced from Salesforce to AmplitudeThere are a few ways you can filter on date fields in Amplitude today. You can build a cohort or chart segment using the following operator conditions= specific date ≠ specific date ∋ portion of the date string ∌ portion of the date string > or ≥ specific date (all days after that single point in time) < or ≤ specific date (all days before that single point in time) However, these are all relatively static filters. If you need to set a dynamic filter on a date field relative to today, keep reading below. Use cases to expand analysis and targeting on date fields relative

3
JennRu
Community Manager
4 months ago

Recent Tips & Tricks

Terms & ConditionsCookie settings