This is not a bug, but a feature.
Generally one uses randomization to avoid special patterns over the whole sample (eg the first item is chosen most often, etc.), but at the same time it can be extremely irritating for respondents if the same sub questions appear in different order in different questions, especially when they are longer item batteries. Thus, the same item battery is randomized once for the respondent an then keeps the order for the rest of its appearances in the in the questionnaire. For the next respondent the dice is rolled again for the first appearance of the item battery, and then this random order stays the same. This is not a bug, but basically the desired outcome.
I think the same randomization is applied to all.later item batteries, eg item 3 is always on position 2,item 2 is always on position 4,etc.
I am not sure, but you could try to use different sub question codes for the questions, not sure if this helps (eg L11, L12,... And then L21, L22... Etc) . Or you could already post the second item battery in a different order, which should then give you a different pattern after the initial randomization.
I personally think for most purposes the default behavior is actually good, but I can understand that for certain experiments you might want to have a different order of the sub question for every appearance in the questionnaire, not just a randomization per respondent.
Help us to help you!
- Provide your LS version and where it is installed (own server, uni/employer, SaaS hosting, etc.).
- Always provide a LSS file (not LSQ or LSG).
Note: I answer at this forum in my spare time, I'm not a LimeSurvey GmbH employee.