Hi I noticed a behavior in one my dashboard that I'm trying to figure it out I created a funnel of 2 steps step one = viewing screen of different subscription plans step two = subscription to a plan The event of view subscription plan have a property present the layout of the screen which refers to the a/b testing layout given I wish to comare the funnel between the different layout If i create the funnel with event comparison (a=layout 1; b=layout 2) I get different result if i'm doing breakdown according the layout property Why is that? isnt it the same analysis?
Hi Shai- Julianne from Mixpanel Support here. Diving right in, the exact funnel behavior is impacted by the conversion criteria as well. But at a high level, an event comparison isn't necessarily expected to match a breakdown. When you use event comparison, Mixpanel essentially creates two separate funnel reports in a single view. For example, if you're comparing layout 1 and layout 2, Mixpanel will create one funnel for users who did layout 1 and another funnel for users who did layout 2. If a user tracked 'View Screen' with both values, they could enter both funnels. With a breakdown applied, a user can also enter each segment, but only after having exited the previous attempt (ie, via converting or timing out). As an example, let's say a user tracks the following, all within the conversion window: 1. View screen, layout = 1 2. View screen, layout = 2 3. Subscribe to plan With the event comparison funnel, the user would enter and convert for both layout 1 and layout 2. With the breakdown funnel, the user would enter on Event 1 with layout = 1. Since they haven't exited that funnel attempt, Event 2 would be ignored in the funnel. This means the funnel would show one conversion for layout 1 and no conversions for layout 2. Let me know if you have any questions!
Great explanation!! Thank you so much Really appreciate it 🙏