Welcome to the LimeSurvey Community Forum

Ask the community, share ideas, and connect with other LimeSurvey users!

[Bug?] Randomization of Answer Options Works in Preview but Not After Activation

More
1 week 3 days ago #271415 by DisplayName
Hi, am I missing something… or is this a bug?I’m building a LimeSurvey survey with a question group containing multiple 5‑point array questions. Each question uses the same four answer options (for the attachments here I used the answer labels L0–L3).
Goal: Randomize the order of these five answer options independently for each question.Setting used: Display / Random order / "Yes" enabled for all individual array questions. Issue:
  • In preview mode, randomization works per question as intended.
  • After activating the survey, randomization is applied once globally → all questions in the group display the same randomized order.
     
Question:Is this a bug? How can I ensure that each question randomizes its answer options independently in the activated survey, just like in preview?
I’ll attach screenshots showing how it’s supposed to work (preview) vs. how it actually behaves (activated).

Thanks for looking into it!

Cheers,
Display

Please Log in to join the conversation.

More
1 week 3 days ago #271416 by holch
This is not a bug, but a feature.

Generally one uses randomization to avoid special patterns over the whole sample (eg the first item is chosen most often, etc.), but at the same time it can be extremely irritating for respondents if the same sub questions appear in different order in different questions, especially when they are longer item batteries. Thus, the same item battery is randomized once for the respondent an then keeps the order for the rest of its appearances in the in the questionnaire. For the next respondent the dice is rolled again for the first appearance of the item battery, and then this random order stays the same. This is not a bug, but basically the desired outcome.

I think the same randomization is applied to all.later item batteries, eg item 3 is always on position 2,item 2 is always on position 4,etc.

I am not sure, but you could try to use different sub question codes for the questions, not sure if this helps (eg L11, L12,... And then L21, L22... Etc) . Or you could already post the second item battery in a different order, which should then give you a different pattern after the initial randomization.

I personally think for most purposes the default behavior is actually good, but I can understand that for certain experiments you might want to have a different order of the sub question for every appearance in the questionnaire, not just a randomization per respondent.

Help us to help you!
  • Provide your LS version and where it is installed (own server, uni/employer, SaaS hosting, etc.).
  • Always provide a LSS file (not LSQ or LSG).
Note: I answer at this forum in my spare time, I'm not a LimeSurvey GmbH employee.
The following user(s) said Thank You: DisplayName

Please Log in to join the conversation.

More
1 week 3 days ago - 1 week 3 days ago #271417 by holch
Search in the forum, I think joffm or tpartner have posted a solution for this already. I am on my phone, so I won't search for you. But this definitely has been answered before. 

Help us to help you!
  • Provide your LS version and where it is installed (own server, uni/employer, SaaS hosting, etc.).
  • Always provide a LSS file (not LSQ or LSG).
Note: I answer at this forum in my spare time, I'm not a LimeSurvey GmbH employee.
Last edit: 1 week 3 days ago by holch.

Please Log in to join the conversation.

Moderators: holchtpartner

Lime-years ahead

Online-surveys for every purse and purpose