Comparing Customer Experiments vs. Tracked Experiments in Mixpanel | Mixpanel Community

Comparing Customer Experiments vs. Tracked Experiments in Mixpanel

What are the pros and cons of using Customer Experiments versus Tracked Experiments in Mixpanel's Experimentation feature?

2 comments

kapa.ai
APP
·
·
Hi Lois, Please stand by as I search the Mixpanel knowledge base for an AI-powered answer. I normally take about 15 seconds or so. In case AI cannot answer your question, feel free to reach out to Mixpanel support at mixpanel.com/get-support. If you have follow-up questions for this thread, please tag me again with your question: @kapa.ai <follow-up question> 👋
Feel free to ask a follow-up question once I've answered by mentioning me with @kapa.ai
kapa.ai
APP
·
·
Based on the knowledge sources provided, I can offer information about Custom Experiments and Tracked Experiments in Mixpanel's Experimentation feature. However, the sources don't explicitly list pros and cons for each type. I'll provide the available information about both types: Custom Experiments: - Allow you to define the control and variant groups of the experiment - These groups can be defined by cohort, user profile property, or event property filters - Provide flexibility in setting up experiment groupsTracked Experiments: - Available if you have experiments implemented in your code - Mixpanel automatically detects experiments that began in the last 30 days - Require sending data in a specific format with an event named "$experiment_started" and properties for "Experiment name" and "Variant name"Both types of experiments can be analyzed using Mixpanel's Experiments report, which calculates the variants' effects on dashboard metrics by determining the delta and lift between variants.It's worth noting that Mixpanel recommends ensuring that the control and variant groups are mutually exclusive to avoid abstracting the report results.For more detailed information about setting up and using experiments in Mixpanel, you can refer to the Experiments documentation.
kapa.ai is still learning and improving, please let me know how I did by reacting below.
ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.