Solved

Crawling website for new listings script

Posted on 2013-01-06
3
290 Views
Last Modified: 2013-01-29
Hello, does anyone know if there is a piece of software/script that let me crawl websites such as ebay to find new listings and email them to me?  

The reason i ask this is that i subscribe to new listings but when i get them on email the really interesting items are already sold.

It would be cool if i had a software/script that would crawl the website every 10 min or so  and send me the information in an email.

If not what do you suggest i should have somebody have it developed in?

Thank you all.
0
Comment
Question by:daxa78
  • 2
3 Comments
 
LVL 42

Expert Comment

by:sedgwick
Comment Utility
AFAIK, there's no one piece of code which can crawl any given website for notifications.
you need to adjust the code cause each web site (usually) is coded differently.
ebay has a notification mechanism but only for items you are involve with, for instance, items you placed a bid and u wish to know when you were outbid or items which you added to wish list, etc.
as far as i know, there's no way to get notifications on items in general, for instance get a notification every time item is put for sell in some category.
if you wish to build some kind of ebay notifier (or any other website) that would require a research of how the web site pages which display the items are being rendered/constructed.
for an intermediate web programmer it won't be a difficult task (depends of the website obviously).
cheers
0
 
LVL 1

Author Comment

by:daxa78
Comment Utility
Thx  So what programming language should we use ?
0
 
LVL 42

Accepted Solution

by:
sedgwick earned 500 total points
Comment Utility
, i'd use javascript or php but it can be done with python, perl whatever u comfortable with.
0

Featured Post

Maximize Your Threat Intelligence Reporting

Reporting is one of the most important and least talked about aspects of a world-class threat intelligence program. Here’s how to do it right.

Join & Write a Comment

If you haven’t already, I encourage you to read the first article (http://www.experts-exchange.com/articles/18680/An-Introduction-to-R-Programming-and-R-Studio.html) in my series to gain a basic foundation of R and R Studio.  You will also find the …
This article will show, step by step, how to integrate R code into a R Sweave document
The viewer will learn how to use the return statement in functions in C++. The video will also teach the user how to pass data to a function and have the function return data back for further processing.
In this fourth video of the Xpdf series, we discuss and demonstrate the PDFinfo utility, which retrieves the contents of a PDF's Info Dictionary, as well as some other information, including the page count. We show how to isolate the page count in a…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

7 Experts available now in Live!

Get 1:1 Help Now