Feature Request: Reduce Delay Time for BigQuery to Mixpanel Syncs
Hi there - I've recently been working to set up warehouse syncs from Google BigQuery to Mixpanel within our organisation and have the following feature requests. Great product - really like it so far. I will put each feature request as a separate message to avoid confusion; Shorter Delay Time for Warehouse Connectors We currently use the following sync settings for our warehouse connectors from BigQuery Timestamp in our context is the time that the message was published (not the time it was inserted into the warehouse table), and this is used as the partition field for our event tables. We don’t have a separate column for the insert time (and even if we did, it would not be the partition), and messages take up to 10 minutes from being published to reach the warehouse tables. To work around this, we round the timestamp down to the nearest hour, and create our syncs at some time past the hour (15 - 20 minutes after) and rely on Event Deduplication using the MessageId to remove duplicate events. Ideally, we would instead like to be able to use the delay functionality in Mixpanel, which can only currently be set to 1 or 2 days, at a much lower interval (15 minutes), so that we still get the data in near-real time but without potentially missing events.
