How do price comparison sites work

Posted on 2007-10-20
Medium Priority
Last Modified: 2013-12-09
Could anyone shed some light on how a price comparison site works, as in, do they use bots to search out product information or is it more labor intensive. For example a site like kelkoo.com

Question by:nathan1038
LVL 70

Expert Comment

by:Jason C. Levine
ID: 20120909
Hi nathan1038,

They use bots to scrape the current price of the site either at the time of your request or every so often.  

Although I'd kind of like to see the operation that did that all manually.  That would be one set of stressed out people.


Expert Comment

ID: 20304025
moneysupermarket.com (one of the biggest in UK) comtakes commission from the companies who get sales from the site.  Direct Line Insurance (who are one of the more competetive Insurance companies in the UK) do not get listed in Moneysupermarket because they won't pay commission and also because they have threatened moneysupermarket.com with legal action. They feel that price comparison sites only compare on price without anyother criteria taken into account.
For reference go to this link:  http://www.telegraph.co.uk/money/main.jhtml?xml=/money/2007/06/11/cmdirect11.xml

Also when you book insurance on moneysupermarket you often then have to complete the transaction by phone which seems a little backward to me.  Why would you stick a middle man in when you don't need to?
LVL 74

Accepted Solution

Jeffrey Kane - TechSoEasy earned 2000 total points
ID: 20304394
Actually, most of them don't use bots to grab information from other sites.  They only list merchants who have uploaded their catalogue to the site.  While this is generally done automatically whenever the merchant modifies something on their own site, there is a fair amount of analysis and tweaking of pennies in order for a merchant's popular products to appear at the top of the list.

You can usually find out how a site works by clicking on their "information for merchants" link... such as:


These links are always at the BOTTOM of the page rather than in the general navigation areas.


Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

CTAs encourage people to do something specific to show interest in your company, product or service. Keep reading to learn why CTAs should always be thought of as extremely important, albeit small, sections of websites.
Over time, the online landscape has altered considerably, but that’s nothing compared to the up-and-coming trends that will shape the web design industry in the coming year. Keep reading to find out which trends will shape B2B web design in 2018.
This tutorial walks through the best practices in adding a local business to Google Maps including how to properly search for duplicates, marker placement, and inputing business details. Login to your Google Account, then search for "Google Mapmaker…
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.
Suggested Courses
Course of the Month13 days, 16 hours left to enroll

809 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question