Solved

Crawling website for new listings script

Posted on 2013-01-06
3
344 Views
Last Modified: 2013-01-29
Hello, does anyone know if there is a piece of software/script that let me crawl websites such as ebay to find new listings and email them to me?  

The reason i ask this is that i subscribe to new listings but when i get them on email the really interesting items are already sold.

It would be cool if i had a software/script that would crawl the website every 10 min or so  and send me the information in an email.

If not what do you suggest i should have somebody have it developed in?

Thank you all.
0
Comment
Question by:daxa78
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 42

Expert Comment

by:sedgwick
ID: 38750232
AFAIK, there's no one piece of code which can crawl any given website for notifications.
you need to adjust the code cause each web site (usually) is coded differently.
ebay has a notification mechanism but only for items you are involve with, for instance, items you placed a bid and u wish to know when you were outbid or items which you added to wish list, etc.
as far as i know, there's no way to get notifications on items in general, for instance get a notification every time item is put for sell in some category.
if you wish to build some kind of ebay notifier (or any other website) that would require a research of how the web site pages which display the items are being rendered/constructed.
for an intermediate web programmer it won't be a difficult task (depends of the website obviously).
cheers
0
 
LVL 1

Author Comment

by:daxa78
ID: 38750437
Thx  So what programming language should we use ?
0
 
LVL 42

Accepted Solution

by:
sedgwick earned 500 total points
ID: 38750452
, i'd use javascript or php but it can be done with python, perl whatever u comfortable with.
0

Featured Post

Stressed Out?

Watch some penguins on the livecam!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In threads here at EE, each comment has a unique Identifier (ID). It is easy to get the full path for an ID via the right-click context menu. However, we often want to post a short link within a thread rather than the full link. This article shows a…
The Windows functions GetTickCount and timeGetTime retrieve the number of milliseconds since the system was started. However, the value is stored in a DWORD, which means that it wraps around to zero every 49.7 days. This article shows how to solve t…
The goal of the video will be to teach the user the concept of local variables and scope. An example of a locally defined variable will be given as well as an explanation of what scope is in C++. The local variable and concept of scope will be relat…
The viewer will be introduced to the technique of using vectors in C++. The video will cover how to define a vector, store values in the vector and retrieve data from the values stored in the vector.

695 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question