Using wget safely
Posted on 2011-02-21
I have a directory, lets call it:
I would like to use wget to backup everything in this directory, including subdirectories. But I don't want it to grab the files that sit in the directory before it, i.e. http://www.mysite.com/index.html
I don't want to tax the server while performing this backup so I think the wait, or rate-limit, option should be used.
I would tell you everything I've tried so far but that would just confuse the issue.