- Posts: 28
- Thank you received: 10
Welcome to the LimeSurvey Community Forum
Ask the community, share ideas, and connect with other LimeSurvey users!
LS on a server cluster. Was: What is the max response-id limesurvey can handle?
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
5 years 5 months ago #175972
by hvgard
Harold van Garderen
What is the max response-id limesurvey can handle? was created by hvgard
Hi,
I 'm more sure this is the right category for this Q. So apologies when this one is on the wrong place.
What is the max response-id limesurvey can handle? I'm not much of a database guy. So looking up the datatype is beyond me. Let alone find the answer.
We are on Version 2.6.7-lts Build 171212
Thanks, Harold
I 'm more sure this is the right category for this Q. So apologies when this one is on the wrong place.
What is the max response-id limesurvey can handle? I'm not much of a database guy. So looking up the datatype is beyond me. Let alone find the answer.
We are on Version 2.6.7-lts Build 171212
Thanks, Harold
Harold van Garderen
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11658
- Thank you received: 2742
5 years 5 months ago #175995
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic What is the max response-id limesurvey can handle?
What do you mean with max response-id? The maximum length of digits a response ID can have or the maximum number of response-Id.
And what do you refer to as "response-id" exactly?
And what do you refer to as "response-id" exactly?
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The topic has been locked.
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
- Posts: 28
- Thank you received: 10
5 years 5 months ago #175997
by hvgard
Harold van Garderen
Replied by hvgard on topic What is the max response-id limesurvey can handle?
Hi, thanks for you response.
We will soon have a project where a Limesurvey survey can get over 10 million "visits". I want to make sure we don't run out of the allowed ID range.
So I mean the maximum (largest) number the ID field can get. A million, 10 milllion? 2^16, 2^32? PS: I guess ID is has unsigned type in the MySQL database.
Thanks, Harold
We will soon have a project where a Limesurvey survey can get over 10 million "visits". I want to make sure we don't run out of the allowed ID range.
So I mean the maximum (largest) number the ID field can get. A million, 10 milllion? 2^16, 2^32? PS: I guess ID is has unsigned type in the MySQL database.
Thanks, Harold
Harold van Garderen
The topic has been locked.
- DenisChenu
- Online
- LimeSurvey Community Team
Less
More
- Posts: 13645
- Thank you received: 2491
5 years 5 months ago #175999
by DenisChenu
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Replied by DenisChenu on topic What is the max response-id limesurvey can handle?
int : (AUTO_INCREMENT) : 2^(31) more than 2 billion …
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11658
- Thank you received: 2742
5 years 5 months ago #176003
by holch
Wow, that is some serious stuff. Because in my experience, you get a return of max. 10% (maybe if you have a very special relationship with your audience you can get more, but with these numbers I doubt that there is a very special relationship).
So this would mean you would invite about 100 Million people?
I guess you have other problems than just the number of lines in the MySQL database or the potential length of the id for each response.
I guess you have heaving machinery ready, with a lot of memory, CPU power and SSD disk space to handle a load like this. Report your experience here please!
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic What is the max response-id limesurvey can handle?
We will soon have a project where a Limesurvey survey can get over 10 million "visits".
Wow, that is some serious stuff. Because in my experience, you get a return of max. 10% (maybe if you have a very special relationship with your audience you can get more, but with these numbers I doubt that there is a very special relationship).
So this would mean you would invite about 100 Million people?
I guess you have other problems than just the number of lines in the MySQL database or the potential length of the id for each response.
I guess you have heaving machinery ready, with a lot of memory, CPU power and SSD disk space to handle a load like this. Report your experience here please!
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The topic has been locked.
- jelo
- Offline
- Platinum Member
Less
More
- Posts: 5033
- Thank you received: 1257
5 years 5 months ago #176012
by jelo
@Harold: Can you share two lines about the project scope? Classic survey? Transaction feedback?
The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
Replied by jelo on topic What is the max response-id limesurvey can handle?
The project with 10 million "visits" could be very small in terms of server resources. Depends on the timeframe. The question about the ID could be the biggest issues.holch wrote: Wow, that is some serious stuff. Because in my experience, you get a return of max. 10%
@Harold: Can you share two lines about the project scope? Classic survey? Transaction feedback?
The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
- Posts: 28
- Thank you received: 10
5 years 5 months ago #176017
by hvgard
Harold van Garderen
Replied by hvgard on topic What is the max response-id limesurvey can handle?
Thanks Denis. That should suffice for a while .
Harold van Garderen
The topic has been locked.
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
- Posts: 28
- Thank you received: 10
5 years 5 months ago #176019
by hvgard
Harold van Garderen
Replied by hvgard on topic What is the max response-id limesurvey can handle?
Hi Jelo, it is a "stories" project on education for parents, teachers and children/youth. We will gather responses for 6 months. But in january there will be a campaign via regular media and we expect up to 40k visitors per hour.
Harold van Garderen
The topic has been locked.
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
- Posts: 28
- Thank you received: 10
5 years 5 months ago #176020
by hvgard
Harold van Garderen
Replied by hvgard on topic What is the max response-id limesurvey can handle?
The potential audience is indeed 5.5 million. Even when 10% responds this means a half million responses. And people are invited to come back to share experiences.
We indeed have "thick" database servers and so far 5 webservers in a cluster to handle peak loads. We can expand the # of webservers (hardware or CPU's of memory) in 10 tot 15 mins. We can currently scale up to 12 if I remember well.
We indeed have "thick" database servers and so far 5 webservers in a cluster to handle peak loads. We can expand the # of webservers (hardware or CPU's of memory) in 10 tot 15 mins. We can currently scale up to 12 if I remember well.
Harold van Garderen
The topic has been locked.
- jelo
- Offline
- Platinum Member
Less
More
- Posts: 5033
- Thank you received: 1257
5 years 5 months ago #176021
by jelo
The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
Replied by jelo on topic What is the max response-id limesurvey can handle?
Thanks for the insight.
luck with the project. Some kind of horizontal or vertical scaling seems to be needed, to handle that amount of visitors.
Here comes the flood. Goodhvgard wrote: we expect up to 40k visitors per hour.
luck with the project. Some kind of horizontal or vertical scaling seems to be needed, to handle that amount of visitors.
The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
- hvgard
- Topic Author
- Offline
- Junior Member
Less
More
- Posts: 28
- Thank you received: 10
5 years 5 months ago #176023
by hvgard
Harold van Garderen
Replied by hvgard on topic What is the max response-id limesurvey can handle?
. For that we have hired professional server managers and there will be an appropriate service level agreement. From the top of my head: 16 hours/day with 2 hour response time.
Harold van Garderen
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11658
- Thank you received: 2742
5 years 5 months ago #176060
by holch
So the whole population of Finland...
Sounds interesting. However, a campaign via regular media probably means a response rate far below my pretty high estimate of 10%. I'd rather go towards 1%. I assume that potential audience means you can theoretically reach 5.5 Million. However, if regular media means TV, newspapers, etc, then the actual audience is probably a lot lower (not everyone will watch TV or read the newspapers), and people, if not targeted directly are less likely to respond than when invited directly. Anyway, as I don't know anything about your actual target group I might be totally wrong.
Sounds like you have put some thoughts into this with professional server managers and I guess you and them have made some stress tests already.
Good luck! And please report back once the project is running or has finished.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic What is the max response-id limesurvey can handle?
The potential audience is indeed 5.5 million.
So the whole population of Finland...
Sounds interesting. However, a campaign via regular media probably means a response rate far below my pretty high estimate of 10%. I'd rather go towards 1%. I assume that potential audience means you can theoretically reach 5.5 Million. However, if regular media means TV, newspapers, etc, then the actual audience is probably a lot lower (not everyone will watch TV or read the newspapers), and people, if not targeted directly are less likely to respond than when invited directly. Anyway, as I don't know anything about your actual target group I might be totally wrong.
Sounds like you have put some thoughts into this with professional server managers and I guess you and them have made some stress tests already.
Good luck! And please report back once the project is running or has finished.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The topic has been locked.