It should be basically the same way as it is with upgrading. You basically substitute the files you have with the files of the version you want to have, with a couple of exceptions that you need to save (config.php, custom templates, etc). This should not have changed much, but I would do some research in the forum if there have been discussions about that lately.
www.limesurvey.org/manual/upgrading_from_a_previous_version
However, I must confess, I haven't done a manual update/upgrade for a while.
If you don't want to risk anything, make a fresh install of 4.0.0 beta somewhere else (you can even copy your current database to use it for this test install to make it as similar as possible). Ideally even install it in parallel on the same server (different subdomain for example). It is just for testing and checking what happens. Once that is done (should be done in a couple of minutes - create a database dump -> create a new database with this dump -> install LS 4 beta using this copied database -> "update" to LS 3.17.4 -> See how your survey works on this test installation. If it works fine, you should be fine with your downgrade.
Don't forget, there is always a risk involved. But you seem to be the risky type, otherwise you wouldn't have upgraded your productive environment to a unstable branch of LS while running live surveys...
Always backup your files...
If you still have your backup from during the upgrade to LS 4, this should contain all your necessary files and you can probably delete/overwrite all files with that. You probably need to delete all files from 4.0.0 anyway, because there might be additional ones.