- Posts: 3
- Thank you received: 0
Welcome to the LimeSurvey Community Forum
Ask the community, share ideas, and connect with other LimeSurvey users!
Randomization within 2groups
- Braendle
- Topic Author
- Offline
- New Member
Your LimeSurvey version: LimeSurvey Cloud
Version 5.4.12
Own server or LimeSurvey hosting:
Survey theme/template:
==================
Hey everyone,
I am trying to implement a survey experiment with random allocation of participants. One half is supposed to get the treatment the other half not ( I initiated this process with the if
Bedingte Bearbeitung; if(test,result_if_true[,result_if_false = ''])
(is_empty( gleichung ), rand(1, 2), gleichung ) function). However in the beginning I ask for a demographic variable (nationality) and I want for all participants who indicate they have a Russian nationality to also split these people 50/50 on the treatment. And the people with all other ethnicities to be split 50/50 as well. Is this possible to randomize people based on 2 different characteristic? I hope I clearly described my problem. If you need any additional information, please do not hesitate to point out the missing information.
Thanks in advance!
Nina
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
- Posts: 11639
- Thank you received: 2737
Each person has the same chance (50%) to get into the treatment group vs. the control group. So each "Russian" has a 50% chance to get into the treatment group, just like each German, each French or each Chinese would have.
With a big number of respondents from Russia you should get a more or less good distribution. Maybe I am wrong, but I don't think that there would be any difference if you would create a random number for each nationality. The change for each respondent is already 50%, it doesn't matter which nationality. So in the long run, you should get to a more or less even distribution between treatment and control group for each nationality.
However, random is random. This means there is no guarantee that you will get exactly 50% in each group. Because for each random draw the chance is 50/50 again. This means it is totally natural that you might have one group with more, the other with less respondents.
You could use different approaches, but they all have one thing in common. An even distribution is not guaranteed and the smaller the sample size the chance of a big difference is higher.
You would need a solution like "bucket least filled", which is probably quite complicated to implement, especially if you have a lot of nationalities.
How do you recruit your respondents? Do you know them before and invite them via email or is this an open survey and anyone can participate?
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Please Log in to join the conversation.
- Joffm
- Offline
- LimeSurvey Community Team
- Posts: 12888
- Thank you received: 3965
you seem to be German.
So you may have a look into my "Tutorial 4: Gleichungen, Zu- und andere Fälle" in the German part.
And, as @holch,
If there are 50% Russians in group 1 and 50% of other nations in group 1, there are 50% of your whole sample there.
Joffm
Volunteers are not paid.
Not because they are worthless, but because they are priceless
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
- Posts: 11639
- Thank you received: 2737
If there are 50% Russians in group 1 and 50% of other nations in group 1, there are 50% of your whole sample there.
I don't really understand what you are trying to say here.
My point: if a russian gets into the survey, the chance that Russian gets into the treatment group is 50%, correct?
If you add a random number between 1 and 2 for each nationality, the chance for each russian is still 50%, correct?
So I don't see how implementing a different random number draw for each nationality will improve the distribution of Russians (or any other nationality) over the two different groups.
Aber vielleicht stehe ich ja gerade auf dem Schlauch.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Please Log in to join the conversation.
- Joffm
- Offline
- LimeSurvey Community Team
- Posts: 12888
- Thank you received: 3965
I just wanted to say it again, only repeated your statement.
So each "Russian" has a 50% chance to get into the treatment group, just like each German, each French or each Chinese would have.
No difference, if I create two random numbers (Russians vs. Other) or only one. The result will be the same.
Joffm
Volunteers are not paid.
Not because they are worthless, but because they are priceless
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
- Posts: 11639
- Thank you received: 2737
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Please Log in to join the conversation.
- Braendle
- Topic Author
- Offline
- New Member
- Posts: 3
- Thank you received: 0
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
- Posts: 11639
- Thank you received: 2737
I hope I explained my problem a bit better now.
Nope, not really.
So you know the people who will participate? How will they receive the link? Will you have a closed survey where you can identify each respondent? In this case you could decide beforehand who falls into the "russian-german" group and then could distribute them evenly into the test group. Just use a dice, or let someone else randomly apply them to the groups.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Please Log in to join the conversation.
- Braendle
- Topic Author
- Offline
- New Member
- Posts: 3
- Thank you received: 0
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
- Posts: 11639
- Thank you received: 2737
I want to make sure that not all Russian germans end up in one group which could happen by chance.
I think that is a very slim chance. Will have to think about this one and if there is something that can be done.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Please Log in to join the conversation.
- Joffm
- Offline
- LimeSurvey Community Team
- Posts: 12888
- Thank you received: 3965
Well, you can calculate the probability that you get 20% of the Russians in group 1 and 80% in group 2.
You will get a small, but positive result.
Yes, it is possible, as it is possible that you roll a perfect dice 10 times and it shows 10 times a "6". The probability is 0.00000165%
Or the probability that the ball will land on red 50 times in a row in roulette = 0.0000000000000888%
So, possible but not really probable.
We all know the Galton-board to show the binomial distribution, which approximates a normal distribution.
And this you can expect in your experiment.
Now distribute your people by a random number and it will be fine.
And if there is an imbalance, you always can fine tune
Though it is sufficient to use "random==1" resp. "random==2" to distribute your respondents, you may add a nationality code (nat) 1=Russians, 2=others (only to be anle to fine tune)
Now you start with
group 1: "random==1 and nat<3"
group 2: "random==2 and nat<3"
Now, if by some reasons there are too many russians in group 1 you may change the conditions t
group 1: "random==1 and nat==2" only "other nations with random number==1"
group 2: "random==2 or nat==1" repondents with random number==2 OR Russians without considering the random number.
If it is balanced again, switch back the conditions.
Joffm
And everything you are pondering about you should simulate throwing a coin (or in EXCEL)
Volunteers are not paid.
Not because they are worthless, but because they are priceless
Please Log in to join the conversation.