Question

Import Efficiency Issues


Hi, I’m currently trying import our old BigQuery events (320 days) to Mixpanel.

I have been able to import a single event (json-formatted) by using “https://api.mixpanel.com/import” API.

However, I found that importing 18,000 events (via for-loop of course) takes nearly 80~90 minutes.

The problem is that the total data we are trying to import is approximately 320 * 18,000 events! 

The total time for the import process would take 24h-18 days!

I know the amount of data we are trying to import is huge, but could there be any more efficient way for importing 5.4GB json files?

Thanks in advance!


0 replies

Be the first to reply!

Reply


Mixpanel