What is the fastest way to scrape data from the web?

I run a small online bookstore and I scrape prices from sites like Amazon to make sure my prices are competitive. I use an Excel sheet and download the data direct into the Excel sheet. However it seems to me this process is very slow and somewhat unreliable (due to Excel "freezes"). Can somebody suggest a faster, mor reliable way to scrape data from the web into a database?
bpfsrAsked:
Who is Participating?

[Webinar] Streamline your web hosting managementRegister Today

x
 
evangineerXConnect With a Mentor Commented:
Alternatively, if you can code or are willing to hire someone who can you can have your own custom solution using the Amazon E-Commerce Service:
http://www.amazon.com/gp/browse.html/ref=sc_fe_c_0_15763381_1/102-9534510-0712920?%5Fencoding=UTF8&node=12738641&no=15763381&me=A36L942TSJ2AJA
0
 
rangasumanCommented:
If you are looking for comparing prices from Amazon, I would suggest you to use the api provided by them to get the prices. Can you please give me more details on what you mean by downloading data to Excel sheet?
0
 
evangineerXConnect With a Mentor Commented:
Check this tool out, it accesses the Amazon web services for information:

i-myZon
http://www.codesworth.com/imyzon.jpg
http://www.codesworth.com/inetLock.aspx?file=imyzonSetup.msi

To install it, you'll need the .Net Framework 2.0:
http://www.microsoft.com/downloads/details.aspx?FamilyID=0856eacb-4362-4b0d-8edd-aab15c5e04f5&DisplayLang=en
0
All Courses

From novice to tech pro — start learning today.