Solved

Crawling website for new listings script

Posted on 2013-01-06
3
323 Views
Last Modified: 2013-01-29
Hello, does anyone know if there is a piece of software/script that let me crawl websites such as ebay to find new listings and email them to me?  

The reason i ask this is that i subscribe to new listings but when i get them on email the really interesting items are already sold.

It would be cool if i had a software/script that would crawl the website every 10 min or so  and send me the information in an email.

If not what do you suggest i should have somebody have it developed in?

Thank you all.
0
Comment
Question by:daxa78
  • 2
3 Comments
 
LVL 42

Expert Comment

by:sedgwick
ID: 38750232
AFAIK, there's no one piece of code which can crawl any given website for notifications.
you need to adjust the code cause each web site (usually) is coded differently.
ebay has a notification mechanism but only for items you are involve with, for instance, items you placed a bid and u wish to know when you were outbid or items which you added to wish list, etc.
as far as i know, there's no way to get notifications on items in general, for instance get a notification every time item is put for sell in some category.
if you wish to build some kind of ebay notifier (or any other website) that would require a research of how the web site pages which display the items are being rendered/constructed.
for an intermediate web programmer it won't be a difficult task (depends of the website obviously).
cheers
0
 
LVL 1

Author Comment

by:daxa78
ID: 38750437
Thx  So what programming language should we use ?
0
 
LVL 42

Accepted Solution

by:
sedgwick earned 500 total points
ID: 38750452
, i'd use javascript or php but it can be done with python, perl whatever u comfortable with.
0

Featured Post

Free Tool: Postgres Monitoring System

A PHP and Perl based system to collect and display usage statistics from PostgreSQL databases.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I hope you'll find this tutorial useful and interesting. So let's try to extend Tcl with a new package.  For anyone more deeply interested please check out the book "Practical Programming in Tcl and Tk". It's really one of the best written books abo…
Navigation is an important part of web design from a usability perspective. But it is often a pain when it comes to a developer’s perspective. By navigation, it often means menuing. This is less theory and more practical of how to get a specific gro…
The goal of the video will be to teach the user the difference and consequence of passing data by value vs passing data by reference in C++. An example of passing data by value as well as an example of passing data by reference will be be given. Bot…
The viewer will learn how to clear a vector as well as how to detect empty vectors in C++.

808 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question