Question

How to A/B testing for new users in Mixpanel?

  • 17 June 2020
  • 1 reply
  • 93 views

  • New Participant
  • 0 replies

I can't set up and A/B testing experiment for new users.

I am trying to do an A/B test where the new users of my app are able to access different parts of the app. I have setted a tweak variable that when setted to true it allows users to access an specific functionality and when setted to false it does not.

The idea behind the experiment is to see if by allowing new users to access this functionality their engagement will increase. So, I want to launch the experiment for the new users that will sign up during the next 7 days.

I am able to prepare everything of the experiment, but when I have to choose which users will be part of the experiment is where I get lost...

This is what I have tried so far.

sign_up_on is a property that is setted when the user registers in the app and it tells the date of registration.

The thing is that this experiment never reached any user.

I have seen that there is a Created reserved user property in Mixpanel and maybe I should use that one.

Thanks.


1 reply

Userlevel 1
Badge +2

Hey Dani!

You’re almost there! In the filter for sign_up_on, you have it set to filter for the date to occur in the next 7 days but the sign up date has already happened, so no users will get the test.

As such, I have a sample screenshot using the Created property, but you can select ‘was less than’ instead:

Let me know if that works!

Best,

Ian

Reply