Does the Event export API support streaming data?
Hi Kim P., Please stand by as I search the Mixpanel knowledge base for an AI-powered answer. I normally take about 15 seconds or so. In case AI cannot answer your question, feel free to reach out to Mixpanel support at mixpanel.com/get-support. If you have follow-up questions for this thread, please tag me again with your question: @kapa.ai <follow-up question> đź‘‹
Feel free to ask a follow-up question once I've answered by mentioning me with @kapa.ai
Based on the provided knowledge sources, the Event Export API itself does not directly support streaming data. However, Mixpanel does offer event streaming capabilities through other methods.The Event Export API is primarily designed for batch exports of raw event data. According to the Raw Event Export API documentation, it allows you to download your event data as it is received and stored within Mixpanel, complete with all event properties and exact timestamps. This API is used for exporting data in batches, not for real-time streaming.For streaming data, Mixpanel offers event streaming or cloud ingestion options. As mentioned in the Send Your Data guide, if your company already has an existing event stream pipeline, you can use it to send data into Mixpanel as you receive it. Mixpanel provides examples for setting up pipelines from services like Amazon S3, Google Cloud Storage, and Google Pubsub.It's important to note that while the Event Export API doesn't support streaming, Mixpanel does have capabilities for real-time or near-real-time data flow through other methods. If you need a streaming solution, you would likely want to look into these event streaming or cloud ingestion options rather than the Event Export API.
kapa.ai is still learning and improving, please let me know how I did by reacting below.
ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.
What should I do if there are a lot of data even with only one day date range? The response size can be 4GB or more for only one day. For 5 days it’s about 25GB and our system won’t be able to process this. I tried to zip the response but after unzipping the file is still large. Could it possible to add pagination to be used with limit or some other way to filter the data?