alternative to wget to grab entire asp site

I've been using wget for years, and love it. Unfortuantely it seems to miss some pages of a site i am trying to mirror locally. This site uses a post form on an asp page to retrieve product details. It seems that wget only retrieves some of the products.

Are there any other solutions that will grab me a local copy of this site?

the two commands i have tried are:
  nohup wget -nc -r -w14 --random-wait -olog http://www.SITENAME.com &
and
  nohup wget -m http://www.sitename.com &

both lacked the same files..
Wibble_Asked:
Who is Participating?
 
AdHe5Commented:
WebHTTrack is a good alternative...
I use it mostly under windows but there's also a linux port, you can get it there:

http://www.httrack.com/page/2/en/index.html
0
 
LiganicCommented:
Try adding -U "Mozilla/5.0 (compatible; MSIE 6.0; Windows NT 5.1)"  to disguise wget as Browser, a lot sites are blocking wget.
0
 
ezatonCommented:
In addition to the suggestion above, 'curl' is a similar command with similar capabilities.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.