?
Solved

Crawling website for new listings script

Posted on 2013-01-06
3
Medium Priority
?
355 Views
Last Modified: 2013-01-29
Hello, does anyone know if there is a piece of software/script that let me crawl websites such as ebay to find new listings and email them to me?  

The reason i ask this is that i subscribe to new listings but when i get them on email the really interesting items are already sold.

It would be cool if i had a software/script that would crawl the website every 10 min or so  and send me the information in an email.

If not what do you suggest i should have somebody have it developed in?

Thank you all.
0
Comment
Question by:daxa78
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
3 Comments
 
LVL 42

Expert Comment

by:sedgwick
ID: 38750232
AFAIK, there's no one piece of code which can crawl any given website for notifications.
you need to adjust the code cause each web site (usually) is coded differently.
ebay has a notification mechanism but only for items you are involve with, for instance, items you placed a bid and u wish to know when you were outbid or items which you added to wish list, etc.
as far as i know, there's no way to get notifications on items in general, for instance get a notification every time item is put for sell in some category.
if you wish to build some kind of ebay notifier (or any other website) that would require a research of how the web site pages which display the items are being rendered/constructed.
for an intermediate web programmer it won't be a difficult task (depends of the website obviously).
cheers
0
 
LVL 1

Author Comment

by:daxa78
ID: 38750437
Thx  So what programming language should we use ?
0
 
LVL 42

Accepted Solution

by:
sedgwick earned 1500 total points
ID: 38750452
, i'd use javascript or php but it can be done with python, perl whatever u comfortable with.
0

Featured Post

Get 15 Days FREE Full-Featured Trial

Benefit from a mission critical IT monitoring with Monitis Premium or get it FREE for your entry level monitoring needs.
-Over 200,000 users
-More than 300,000 websites monitored
-Used in 197 countries
-Recommended by 98% of users

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The purpose of this article is to demonstrate how we can use conditional statements using Python.
Active Directory replication delay is the cause to many problems.  Here is a super easy script to force Active Directory replication to all sites with by using an elevated PowerShell command prompt, and a tool to verify your changes.
The viewer will learn how to user default arguments when defining functions. This method of defining functions will be contrasted with the non-default-argument of defining functions.
In this fifth video of the Xpdf series, we discuss and demonstrate the PDFdetach utility, which is able to list and, more importantly, extract attachments that are embedded in PDF files. It does this via a command line interface, making it suitable …
Suggested Courses

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question