Gabi M.

We do it through backend, and Mixpanel records events for each A/B test with variant as a property (I then make user cohorts based on it) The challenge is seeing if the difference between variants is statistically significant, which is why I use Mixpanel Experiment feature, that calculates the significance However, (as far as I know) it allows for only 2 variants, which means we have to find a way to analyse a test with involves 3 variants Especially because the more variants there is, the more comparisons we have to make (eg. A vs B, A vs C, B vs C) increasing the chance for type 1 error, so there needs to be a correction involved If you know a way to analysing it, I'm all ears!

I see, many conversions like that are easier to see in a table view ✅ Out of curiosity, how do you approach analysing more than 2 variants for an A/B test? Experiments in Mixpanel allow for only 2 variants, so I guess it has to be calculated off-platform? This is something I'm in the middle of solving, so I appreciate if you could share you approach!

kapa.ai But in this example: If your goal is to track users adding items to a shopping cart: instead of tracking multiple events Add Shirt to Cart, Add Hoodie to Cart, and Add Socks to Cart, track a Add to Cart event with a Item property set to “Shirt”, or “Hoodie”, or “Socks” Each item added to the cart will trigger the "Add to Cart" event, creating multiple events We'd like to have one event

kapa.ai Please find an example of tracking actions as properties in your knowledge base

I think setting the report as "metric" at top right helps with this You see the conversion rate and the number of users that converted

Hi! What exactly do you need?