Import Efficiency Issues

Hi, I’m currently trying import our old BigQuery events (320 days) to Mixpanel.

I have been able to import a single event (json-formatted) by using “” API.

However, I found that importing 18,000 events (via for-loop of course) takes nearly 80~90 minutes.

The problem is that the total data we are trying to import is approximately 320 * 18,000 events! 

The total time for the import process would take 24h-18 days!

I know the amount of data we are trying to import is huge, but could there be any more efficient way for importing 5.4GB json files?

Thanks in advance!

0 replies

Be the first to reply!