Welcome to the LimeSurvey Community Forum

Ask the community, share ideas, and connect with other LimeSurvey users!

Is it possible to export survey data in the background?

  • alucard001
  • alucard001's Avatar Topic Author
  • Offline
  • New Member
  • New Member
More
2 months 22 hours ago #256884 by alucard001
Please help us help you and fill where relevant:
Your LimeSurvey version: 6.4.2+240115 
Own server or LimeSurvey hosting: Own Server (AWS Linux)
Survey theme/template: default
==================
I have some survey result with over 30 fields and 2000+ response.  My manager would like to export it in Excel format.

Yet the time exporting that file is beyond 1 min, which is the maximum timeout period from AWS cloudfront.

Other than increasing the timeout of PHP, may I ask if Limesurvey can export result on the background, so that it can bypass the timeout issue?

Thank you in advance for your help.

Please Log in to join the conversation.

  • DenisChenu
  • DenisChenu's Avatar
  • Online
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
2 months 21 hours ago #256900 by DenisChenu
I think the only way is to create a plugin for this (but i don't know how to start).

Else : export 200 by 200 with api.limesurvey.org/classes/remotecontrol...hod_export_responses

Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
The following user(s) said Thank You: tpartner

Please Log in to join the conversation.

  • holch
  • holch's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
2 months 17 hours ago #256936 by holch
Check if exporting to CSV is maybe quicker. If so, convert the downloaded CSV to Excel later.

I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.

The following user(s) said Thank You: tpartner

Please Log in to join the conversation.

  • tpartner
  • tpartner's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
2 months 13 hours ago #256943 by tpartner

Check if exporting to CSV is maybe quicker. If so, convert the downloaded CSV to Excel later.
Yeah, and maybe export using codes only.

Cheers,
Tony Partner

Solutions, code and workarounds presented in these forums are given without any warranty, implied or otherwise.
The following user(s) said Thank You: DenisChenu

Please Log in to join the conversation.

  • alucard001
  • alucard001's Avatar Topic Author
  • Offline
  • New Member
  • New Member
More
2 months 6 hours ago #256951 by alucard001
Thanks for your reference.

Please Log in to join the conversation.

  • alucard001
  • alucard001's Avatar Topic Author
  • Offline
  • New Member
  • New Member
More
2 months 6 hours ago #256952 by alucard001
Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.

Please Log in to join the conversation.

  • DenisChenu
  • DenisChenu's Avatar
  • Online
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
1 month 4 weeks ago #256985 by DenisChenu

Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.
 
Then seems you need to export 5000 by 5000 :)

Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.

Please Log in to join the conversation.

  • holch
  • holch's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
1 month 4 weeks ago #257018 by holch

Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.


The initial discussion was about 2000+ responses. While 20000 is of course within "2000+" I assumed that the responses might be between 2000-3000 max. Not 20000 or more.

It is not overly surprising that you might run into some issues when exporting 20000+ responses and the maximum execution time is 1 minute. If you can't adapt the max execution time, you need to speed up the process. Either by exporting in batches or trying to get a quicker processer that can run the script in less time. But there might be also other factors that impact (the way how you connect to the database, etc). And you might also run into max_vars limits with this amount of responses.

I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.

The following user(s) said Thank You: DenisChenu

Please Log in to join the conversation.

Lime-years ahead

Online-surveys for every purse and purpose