Can you update historical events with a new user property

Hi there,

We added a new user property and I was hoping that this would propagate to historical events.

However, this has not occurred and this user property is still showing as `(none)` for events created before this user property was set.

I was reading this somewhat related topic where Yuanyuan Zhang notes:

Once a user property is set, it will be applied to all events going forward until it gets updated. For example, you first have user property email = abc@gmail.com, all events will have this user property value. Then you send in another value today email = def@gmail.com, all events from that point onwards will have the user property value def@gmail.com.

And:

You can update the same user prop "email" by including "email" in the payload with the new value and specify that it will be overwritten for the user properties at the top and the new value will propagate to further events. Historical events will not get updated.

Does this confirm that it is not possible to update the user properties of historical events? Or is there a way to do this?

Would like to emphasise that this is a new user property that did not previously exist (in case that makes any difference).

Any advice is greatly appreciated!

Lachy

Find more posts tagged with

User Properties

Accepted answers

Yuanyuan Zhang

Hi Lachy

Thank you for this post!

It is correct that it is NOT possible to update the user properties of historical events at Amplitude. User properties will only apply to events going forward. Our current architecture is based on pre-aggregated sets by the hour, day, week and month for users and events. While this allows us to scale well, a limitation is that historical data is immutable.

Hope this clarifies!

Best,

All comments

Yuanyuan Zhang

Hi Lachy

Thank you for this post!

Hope this clarifies!

Best,

James Lindsay

The user properties being ‘time based’ is actually quite nice in Amplitude, since it can do more in terms of reporting than what you get in the likes of Mixpanel.

Although I do find one thing lacking here.

Say I want to import historical user properties.

What I’m getting from doing that is the user properties only present on users who trigger any event after the historical import onwards. That’s okay… I guess for event-based reports like Segmentation.

Although when I try and do an analysis using the User Composition I’m still only seeing the user properties for users who triggered an event from import onwards. What we’re lacking here is a historical view of the user properties when importing historically… which seems like a feature ‘bug’?

This could perhaps be remedied by sending another event after the historical user properties import but that isn’t ideal.

One other issue I find is when importing data, say using the BigQuery connector or even Hightouch. If we’re importing user profiles with properties and events… wouldn’t we then need to make sure we’re syncing the user profiles with their properties before we sync their associated events?

Going forwards I’ll be adding user properties to their relevant events when syncing (such as Lifetime Value in the Purchase event) and reserving user profile updates to non-event-specific properties.

Yuanyuan Zhang

James Lindsay

Although when I try and do an analysis using the User Composition I’m still only seeing the user properties for users who triggered an event from import onwards. What we’re lacking here is a historical view of the user properties when importing historically… which seems like a feature ‘bug’?
This could perhaps be remedied by sending another event after the historical user properties import but that isn’t ideal.

I understand this might be confusing, but this is not a bug. User Composition looks at the user properties, not events, but the values of user properties are drawn from active events of users. This behavior may not fit all use cases, so please feel free to submit feature requests.

One other issue I find is when importing data, say using the BigQuery connector or even Hightouch. If we’re importing user profiles with properties and events… wouldn’t we then need to make sure we’re syncing the user profiles with their properties before we sync their associated events?

It is correct that you would need to sync user properties before syncing events because user properties only apply to events going forward.

Scott A

Hi — wondering if cohorts would solve this problem, i.e. defining cohorts on the current value of a user properties, then comparing cohorts on historical events. Would that work?

James Lindsay

Hi — wondering if cohorts would solve this problem, i.e. defining cohorts on the current value of a user properties, then comparing cohorts on historical events. Would that work?

Unfortunately, I don’t think that would work either.

I ended up changing how we import user properties and made it, so the relevant events synced all the user properties (i.e. lifetime spending, etc).

This would still pose an issue for ‘CRM like’ properties which simply aren’t attached to a specific event. It would also pose an issue if the user property were across multiple events (like total spending across online and offline POS sources).

In this case, sending a ‘dummy event’ may be the only solution. Another option is to use computed properties… although this is only available for 365 days windows and is a paid add-on.

Dan Carpenter

Just want to understand this further as I expect this applies to our use case.

After signing for our product users can trial all features for a period of time, then when they convert to paid users they must select a plan tier. We would like be able to segment product usage during the trial period by what product they ultimately sign up for. There is no way for us to set the product tier on the user prior to converting. Is there any way for us to accomplish this?

Quick Links

Unanswered Questions

Import data from one amplitude account to another
How do I transfer data from one amplitude account to another? It seems all the community chats about this have completely broken links. Easy to export, no way to import, very frustrating. :(
@amplitude/plugin-web-vitals-browser build fails on CRA v4 (react-scripts@4.0.3)
When using @amplitude/plugin-web-vitals-browser with Create React App v4 (react-scripts@4.0.3), the build fails with: ./node_modules/@amplitude/plugin-web-vitals-browser/node_modules/web-vitals/dist/web-vitals.js<br /><br />SyntaxError:…
Question about Amplitude Export API Data Delay
Hello, I'm using SpringBoot and Kotlin to integrate with the Amplitude Export API. The official Amplitude documentation (https://amplitude.com/docs/apis/analytics/export) states that "data is available to export at a minimum within 2 hours of when the servers received it." However, there's no clear information about the…
Retrieve via the API users based on a user property
Hello, Is there a way to make a query like: “Give me all the users that have the user property X equal to 10”, by using just any of the APIs, without making a cohort first through the Amplitude’s UI? Thank you!
400 Status Code Error When Loading "Page Viewed: Cart" Data
Hi, I’m trying to create a chart in Amplitude using the Page Viewed: Cart event, measured as Uniques, over the past 7 days. However, I keep getting this error on the graph: "An error occurred while loading your data. (400 status code)" Other events seem to load fine, so it looks specific to this event or configuration. Has…