Difference between WGET and CURL command and find equivalent solution

What is the difference between these two commands?
1) wget
2) curl

I have wget command in this format: wget --spider -t2 -T3 -F -i ${file}.html 2> output.txt
Basically, this wget will parse through all the links in a html page and return the results into the output.txt file.

I am trying to do same thing using CURL. Does anybody has solution for this. The reason for me to switch to CURL or something else which is similar to WGET is that WGET is getting stuck on one particular file which has multiple redirect links (about 20) which are all same and it's just gets stuck..

Hopefully CURL will provide better solution if there is a way to do it.
Thanks.
desiaashikAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

slyongCommented:
Hi desiaashik,

cURL doesn't do things like wget --spider as decribed in the FAQ (http://curl.mirrors.cyberservers.net/docs/faq.html#3.15).  There are a lot of crawlers/spiders on Linux that you can use, an example would be http://www.w3.org/Robot/
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Linux

From novice to tech pro — start learning today.