Each Mixpanel Feature Flag can only have one connected experiment report? What if I set something wrong, could I make report-level correction retrospectively or the whole report would stay contaminated all the time?
Feature Flag & Experiment Report Connection
One Flag, One Experiment?
The knowledge sources don't explicitly state whether a single Mixpanel Feature Flag can be connected to only one experiment report at a time. I can't confirm or deny this with certainty based on the available documentation.
Retrospective Corrections to an Experiment Report
The good news is that Mixpanel does allow you to change experiment settings mid-run, with some important caveats:
"Mixpanel analyzes your experiment on the fly, so you can adjust settings at any time if needed. If you notice a configuration mistake — like selecting Frequentist when you meant Sequential — feel free to correct it, even if the experiment has been running for weeks." [Changing Settings Mid-Experiment]
So for genuine configuration mistakes, you can fix them retroactively without the report being permanently "contaminated."
What You Should NOT Do
The key warning is around p-hacking — don't adjust settings because you don't like the current results:
"The one thing to avoid is changing settings because the current results aren't what you hoped for. If you adjust the confidence level, metrics, or duration in search of a significant result, you're more likely to find something that looks meaningful but is actually noise." [Changing Settings Mid-Experiment]
When to Start Fresh
If you want to test a fundamentally different configuration rather than correct a mistake, the recommended approach is to restart the experiment:
"If you want to test a different configuration, restart the experiment instead. This resets the data and ensures your analysis starts fresh." [Changing Settings Mid-Experiment]
In summary: Genuine mistakes can be corrected on the fly. The report won't be permanently contaminated as long as you're fixing real errors rather than chasing favorable results. For deeper reconfigurations, restarting is the clean path forward.
ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.
The knowledge sources do not contain enough information to answer this precisely. The documentation does state that the Experiment Start Date defaults to the "date of the first user exposed to the experiment" [Experiments Setup], which in your case would be May. However, there is one important constraint to be aware of:
You cannot analyze experiments prior to your experimentation purchase date. [Experimentation Pricing FAQ]
So the answer to your timing question depends on a few unknowns:
If the start date anchors to May (first exposure), the 60-day duration would end around end of July.
If the start date is treated as June (when you created the report), it would end around end of August.
The docs don't explicitly clarify how the 60-day duration interacts with a backdated start date when the report is created later. I'd recommend reaching out to Mixpanel Support or your account team to confirm the exact behavior before relying on either assumption.
ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.
