What is the fastest way to scrape data from the web?

I run a small online bookstore and I scrape prices from sites like Amazon to make sure my prices are competitive. I use an Excel sheet and download the data direct into the Excel sheet. However it seems to me this process is very slow and somewhat unreliable (due to Excel "freezes"). Can somebody suggest a faster, mor reliable way to scrape data from the web into a database?
bpfsrAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

rangasumanCommented:
If you are looking for comparing prices from Amazon, I would suggest you to use the api provided by them to get the prices. Can you please give me more details on what you mean by downloading data to Excel sheet?
0
evangineerXCommented:
Check this tool out, it accesses the Amazon web services for information:

i-myZon
http://www.codesworth.com/imyzon.jpg
http://www.codesworth.com/inetLock.aspx?file=imyzonSetup.msi

To install it, you'll need the .Net Framework 2.0:
http://www.microsoft.com/downloads/details.aspx?FamilyID=0856eacb-4362-4b0d-8edd-aab15c5e04f5&DisplayLang=en
0
evangineerXCommented:
Alternatively, if you can code or are willing to hire someone who can you can have your own custom solution using the Amazon E-Commerce Service:
http://www.amazon.com/gp/browse.html/ref=sc_fe_c_0_15763381_1/102-9534510-0712920?%5Fencoding=UTF8&node=12738641&no=15763381&me=A36L942TSJ2AJA
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Web Development

From novice to tech pro — start learning today.