Skip to main content

Data Planning and Governance

Data (Beta) provides data planning and tracking that helps companies run on clean and consistent analytics by eliminating human error during the instrumentation process.

  • 261 Topics
  • 633 Replies
261 Topics
Alexander Magnusson
Alexander MagnussonNew Member
published in Data Planning and Governance
Messy Data Cleanup Hour #1: A handy Amplitude Data Cleanup checklist and list of tips

Alex Magnusson is a leading expert in the field of product analytics, specializing in helping companies leverage the power of Amplitude to make data-driven decisions. He is the co-founder and CEO of Magnusson Analytica, a consultancy that provides Amplitude implementation, training, and strategic guidance to clients worldwide. If you want 1:1 help and a free chat, book time with Alex here!In this Amplitude Messy Data Cleanup Hour, we covered the essential steps for maintaining clean, reliable, and actionable data in Amplitude. Including common challenges such as overwhelming event lists, inconsistent naming conventions, data validation, and the ongoing task of aligning tracking with evolving business objectives. For more help, and to chat with Alex and other users, join our Slack community!  Amplitude Data Cleanup ChecklistHere's a handy checklist to help you audit, clean, and govern your Amplitude data:I. Establish a Data-Driven Mindset:Build strong habits, data cleanup is an ongoing

1710
Alexander Magnusson
2 months ago
Amplitude Admin
Community Manager
Amplitude AdminCommunity Manager
posted in Data Planning and Governance
Can I selectively delete or modify historical data on Amplitude?

Hi Amplitude Community, At the moment, it is not possible to selectively delete or modify historical events. Our current architecture is based on pre-aggregated sets by the hour, day, week and month for users and events. While this allows us to scale well, a limitation is that data is immutableThat being said, we have some options for specific use cases:You can use the Export API to pull all the data from their project, sanitize the data (remove properties), and then perform a Self Backfill and use Batch API to push events into a new Amplitude project. Please note that backfilling data will increase the event volume in your org, which may incur costs. Deleting the old project will not reduce the volume. Do you want just to drop certain data? Amplitude Data's drop filters feature allows you to remove specific event data from your charts at query time. These events are not deleted, and they can be restored to your charts simply by editing or deleting the drop filter. You can read more ab

4330
Amplitude Admin
Community Manager
1 year ago
Amplitude Admin
Community Manager
Amplitude AdminCommunity Manager
published in Data Planning and Governance
Welcome to the data planning and governance forum!

Learn, ask questions, or help others with planning and managing data in Amplitude. This is where you can ask and get feedback on questions such as: ✅ How does the environments section work with projects?✅ What is the difference between Taxonomy vs Govern vs Data?✅ Why are some events not showing up on my tracking plan?✅ How do I make an event Inactive after it's been Deleted?✅ What does it mean for an event to have a warning sign that says invalid x% of the time? Helpful resources: ❓Get started with Amplitude Data: what is Amplitude Data, best practices, working with branches, a typical workflow in Amplitude Data❓Building a tracking plan❓Advanced Data topics: lookup tables, integrating Jira, transformations and derived properties❓Amplitude Academy course: Getting Started with Data ❓Amplitude Academy course: Instrumenting your Data Taxonomy❓Amplitude Academy course: Iterating on a Data-Informed CultureStill have questions? Post them here! 

8240
Amplitude Admin
Community Manager
2 years ago
M
Matt SoybelliNew Member
asked in Data Planning and Governance
Comparison with last week changed

I have a report that compares today’s revenue with last week’s. Previously, it showed the entire day’s revenue from last week compared to today’s updated revenue. Now, it considers the hour of the day when comparing with last week, so I can see last week’s revenue up to the same hour as today.

151
Saish Redkar
Expert
11 days ago
J
Jan ChangNew Member
asked in Data Planning and Governance
How are event properties across different projects counted with regards to the Event Property Limit?

If I have two amplitude projects, with roughly the same schema for events and properties, are event properties with the same in both projects counted toward the limit twice? Currently, my team has two separate amplitude organizations for our test and production environments, and we would like to consolidate them under two separate projects under one organization. However, we are well over half of the total 2000 event property limit so if this would duplicate our event property count it would be a big problem.

191
liuaud
Peer Moderator
1 month ago
archana
Team Member
archanaTeam Member
published in Data Planning and Governance
Getting Started with Amplitude Data - New Amplitude Academy course!

Hi everyone! My name is Archana and I’m a Learning Experience Designer on the Customer Education team here at Amplitude. Are you getting started with the Amplitude Data (BETA) experience? You’re in luck! We have a brand new course in the Amplitude Academy designed to get you familiar with the Data UI and teach you how to plan, implement, and maintain your analytics tracking.Create an Amplitude Academy account to access the course here: Getting Started with Amplitude Data [On-demand course]Have questions? Connect with your fellow course participants and me by replying to this thread. Happy learning!

4021
A
1 month ago
J
Jayeon ChoiNew Member
asked in Data Planning and Governance
Inquiry on Auto-Filling Event Descriptions

Hello,I’m Jayeon Choi, the Data Governance Manager at Wantedlab. We have recently added new events with the same names as our existing events, but with the prefix "[WEAVER]" attached. I would like to locate the original event names without the prefix and automatically apply the existing descriptions (without prefix) to these new events(including images).For example,if we already have an event called "jobs__view" in our event list, I would like to add the same description of this existing event to the new event "[WEAVER] jobs__view". Could you guide us on how we might implement this in Amplitude?Your assistance would be greatly appreciated. Thank you,

280
J
1 month ago
I
idalboNew Member
asked in Data Planning and Governance
Snowflake key-pair authentication keeps failing and data export errors

I recently switch authentication for the user exporting data from Amplitude to Snowflake from username password to key-pair authentication. I follow the instruction on screen, but every time I switch from pw to key-pair, the export fails with the following codeErrorsError Type: SnowflakeTime: Invalid DateTimeMessage: JWT token is invalid. [143cbb72-85dc-4e2c-8bc7-fef3a0d42fd4]The login to Snowflake succeeds (I checked the login history table there). Also, if I switch back to password auth it works as expected. Given the very small degree of customization allowed here, I don’t know what might be happening and how to solve this.

941
N
1 month ago
B
Bhushan LalNew Member
asked in Data Planning and Governance
Getting "Request missing required field" when I don't pass user_id while tracking with nodeJs SDK

I’m trying to track the events of users who are not authenticated with the help of amplitude. Clearly, the userId field is optional, and can be passed as undefined. ampli.propertySearchPerformed(undefined, { props }) But, when I do so - I got runtime error - “Request missing required field”.I’ve tried with ampli wrapper and track as well but got same issues.I’m using nodeJs SDK. How exactly, I can avoid passing user_id?

380
B
2 months ago
R
Novice
rubenugarteNovice
asked in Data Planning and Governance
Exporting data through Stitch

I was interested in using Stitch to export data from Amplitude, however, I can see that this integration requires the Query add-on, which is no longer for sale: https://www.stitchdata.com/docs/integrations/saas/amplitude Are there any alternatives that can work with Stitch?

340
R
Novice
2 months ago
H
Helge FredheimNew Member
asked in Data Planning and Governance
Cannot log in via CLI

I try to log in using the ampli CLI.I type ampli pull, and I am prompted to log in. When accepting to log in, the browser is opened, and I am sent to a page in Amplitude where I can give access.When I approve, I am redirected to https://localhost:13222/ where obviously nothing is running. And the command line prompt is still waiting for me to log in...Is there a missing ENV variable in Amplitude or something, or am I doing anything wrong here? 

1851
A
2 months ago
G
Helpful Hero
GakaHelpful Hero
asked in Data Planning and Governance
Ampli CLI pull problem (React Native SDK)

Hello! Our app is a react-native project and we already get some analitycs by amplitude about year. Now I want to improve amplitude usage for our project and I would like to use Ampli CLI for our app.  If I try to executeampli pullI get the next warningWARNING You have yet to create a source in your account. Log into https://data.amplitude.com/ to create one.But in our app we have one source React native SDK with name ReactNative. Connected.Please tell me, is it possible to use ampli cli for react native project or maybe something wrong?

4373
P
3 months ago
J
jdavchevNew Member
asked in Data Planning and Governance
Advice on events (user + event properties) - app with users part of multiple organizations

Hey everyone, So I get that events are best suited to track on the user level.In the app that we build a user is a global user that can join and be a Member of several different organizations. (think slack, workspaces) So my question would be how would be best to build the user properties so that you can show in which workspaces a user is part of and the role they have. I see there is concept of arrays in the docs but let’s say I’m in workspaceA with role1, workspaceB with role1 and workspaceC with role2.https://amplitude.com/docs/sdks/analytics/browser/javascript-sdk#arrays-in-user-properties Also see there is account add-on in amplitude (have not seen it yet, waiting for plan upgrade) and wonder how this could be useful, for example, to easily make aggregate reports based on workspaces (regardless how many users are there)https://amplitude.com/docs/analytics/account-level-reporting Would appreciate feedback/advice from someone that have tackled those problems before. Best,JD

450
J
3 months ago
J
jdavchevNew Member
asked in Data Planning and Governance
Advice on initial setup - website (no session) + legacy and new gen product

Hello community, New here, so far love Amplitude, can’t wait to start using it at scale. I started with reading manual and diving into the academy but I would appreciate to bounce of thoughts/ideas on initial setup in amplitude. The setup My situation is we have a website (no user session) and product in the following platforms:website (no session) product app ( user logs in )The thing is we have legacy product let’s call it version 1 and a new product version 2. For some time users will experience both version 1 and 2 but ultimately the idea is to sunset version 1. The amplitude setup question Option 1Do we create one single amplitude project that combines the website and product 1 and product 2.Pros:not really sure what might be pros. It would be great if could track someone across everywhere but not really the case.Cons:user ids are different in product 1 and 2 so it’s hard actually to track cross projects for example events like “User register” should use some property to tell if t

420
J
3 months ago
G
Guilherme DuarteNew Member
asked in Data Planning and Governance
Export Channel Classifier Information

Hi,We’re using Amplitude Channel classifiers to categorize user acquisition. We can see and use the Channel user property populated correctly within Amplitude. Is it possible to export that data with the BigQuery Destination?Thanks

2313
P
3 months ago
S
Sabyr ZhurumbayevNew Member
asked in Data Planning and Governance
Why is nothing displayed in the tab Splitting?

Why is nothing displayed in the tab Splitting? Type - Array, Item type- Any. Is it a bug?  

783
T
Team Member
3 months ago
H
Novice
HaythamNovice
asked in Data Planning and Governance
Reference event timestamp in a derived property?

Is there any way to reference the time of an event in a derived property formula? I am trying to create a derived property that calculates the difference in time between a date in a user property (the users account creation date) and the date of the event being measured. I have gotten it to work using the TODAY() function, but I can’t seem to find any way to reference the event time itself. TODAY() only works if looking at the last N days, but I can’t use it to create historical trends. ThanksDIVIDE( MINUS( TODAY() , DATE_TO_LONG( REGEXEXTRACT( PROPERTY( 'first_insert_date', 'user' ), "^\d{4}-\d{2}-\d{2}" ) ) ), 86400000) 

1173
T
Team Member
3 months ago
L
Lance JohnsonNew Member
asked in Data Planning and Governance
Cleanup old properties to get under property limit without blocking future reuse of those properties

We are bumping into our property limit and need to clean things up. Admittedly our data governance has been lacking for awhile and has caused us to have a lot of events/properties that showed up years ago for a bit and are no longer used.In my naive attempt to resolve this issue I went and found all properties not seen > 2 years ago and deleted them. This does seem to have removed them from the property limit count but after digging around a bit in docs I realized there is a nuanced behavior to deleted events/properties in that they are actually ‘blocked’ as well. As such, if a ‘new’ event is sent that has a property that matches one of these deleted property it won’t be associated w/ the event or saved in Amplitude. It does seem like these properties can be undeleted to solve that but the delete behavior is a bit problematic because it creates a ‘gotcha’ that could confuse neophytes or be missed and impact our data collection. Property names are usually rather simplistic like ‘butt

1693
jarren.patao
Community Manager
3 months ago
S
Supratim RayNew Member
asked in Data Planning and Governance
Issue while adding new environment in Amplitude project

Hello,I need to create a new project in Amplitude and link 2 environments for it, that shows under Data for that project.Following the documentation, I created a new project called Test (screenshot attached). In Data section project settings, under Environment,I see one environment is already created and linked to it. As I tried to create a new environment, under the Select Project I could not find the other project I wanted it to connect (screenshot attached). It has an option to Add or Manage project, but that is taking to all projects list. I checked individual project settings but didn’t find any option to link either.Can anyone please help on this. I am new to Amplitude, apologies if the question is too basic.@belinda.chiu   

941
B
3 months ago
L
LUCAS ABREUNew Member
asked in Data Planning and Governance
Export data to private redshift cluster

Hi,We're interested in leveraging Amplitude's Redshift export feature, but our Redshift cluster resides in a private subnet within our VPC.We're hesitant to expose it publicly. I looked at the docs and the community posts trying to find something about this topic and found nothing. Does anyone know if Amplitude offer a VPC peering solution for Redshift export? If so, could you provide guidance on how to set it up or a link to the documentation? Thank you in advance!

1091
Jacenda Davis
Team Member
4 months ago
Z
zeroseshNew Member
asked in Data Planning and Governance
Support for Transparency & Consent Framework (TCF) v2.2

Hello, are there any plans to implement support for the Transparency & Consent Framework (TCF) v2.2? This framework enables publishers and developers to collect region-specific consent via a Consent Management Platform (CMP) and allows vendors like Amplitude to retrieve and apply those preferences. For more details, please see: https://iabeurope.eu/transparency-consent-framework/ 

1190
Z
4 months ago
S
Supratim RayNew Member
asked in Data Planning and Governance
Not able to add new environment in Amplitude project

Hello,I need to create a new project in Amplitude and link 2 environments for it, that shows under Data for that project.Following the documentation, I created a new project called Test (screenshot attached). In Data section project settings, under Environment,I see one environment is already created and linked to it. As I tried to create a new environment, under the Select Project I could not find the other project I wanted it to connect (screenshot attached). It has an option to Add or Manage project, but that is taking to all projects list. I checked individual project settings but didn’t find any option to link either.Can anyone please help on this. I am new to Amplitude, apologies if the question is too basic.@sydney.koh  

670
S
4 months ago
V
Vicente RotmanNew Member
asked in Data Planning and Governance
Duplicated and Missing Data events

Hello, I am using the Webhook Destintation functionality on the data connections.I send events through Webhook and I have found 2 issues constantly happeningThere are missing events and events that fail to be delivered for a missing property I’m using that is actually present. Then I go to find the specific event in a Segmentation chart, if I filter by that property being missed I do find some events but then when look deeply into those events they do have the property. Some events don’t even appear in the data connection counter and some of them fail with this error that is not accurate. Duplicated events. This is less serious but many events are sent multiple times to the WebhookMany thanks for the help and clarifications,Best,Vicente

850
V
5 months ago
M
Madhulika MukherjeeNew Member
asked in Data Planning and Governance
How do I remove the Accounts Add On?

I added it thinking we’ll implement it, but plans changed. Now I want to remove it, but when I try to “modify plan” the Accounts Add On is defaulted to checkboxed, and I cannot uncheck it.Anybody knows how to remove it so I dont keep getting charged for it every month?

1392
liuaud
Peer Moderator
5 months ago
N
NiarcotykNew Member
asked in Data Planning and Governance
Send Identify event from Segment to Amplitude

Hello,  We are using Segment to collect events and send them to Amplitude. Our source code is in PHP, and this concerns the Identification event. Here the format of event: client.Identify(&analytics.Identify{   UserId: "XXXXXXXX",   Traits: map[string]interface{}{     "creation_date": "2024-07-22T06:14:30.000Z",     "is_akeneo_user": false,     "job_profile": "unknown",     "pim_user_group_ids": map[string]interface{}{       "0": "srnt-xxx@5",       "1": "srnt-xxx@11",     },     "pim_user_group_labels": map[string]interface{}{       "0": "srnt-xxx@IT support",       "1": "srnt-xxx@All",     },     "pim_user_id_prod": "srnt-xxx@1",     "pim_user_type": "user",   }, }) The problem is that it arrives in Amplitude in a format that is difficult to use. Here the format in Amplitude: pim_user_group_ids.0 pim_user_group_ids.1 pim_user_group_labels.0 pim_user_group_labels.1 So we change format from backend to spend this event: client.Identify(&analytics.Identify{   UserId: "XXXXXXX",  

762
L
Team Member
5 months ago
Terms & ConditionsCookie settings